Reading a generic text file with string and number
Show older comments
Hello I have this text file:
FLEX_UNIT_CONFIGURATION_FILE_V1.12
! Description: flexConfig_S01
!========
FLEX RESERVOIR INFO
status max number of reservoirs
.true. 1 ! enableWR
.false. 1 ! enableIR ! UR-A-ID: supported= 0,1,2,3,10,11,20,21,22,30,31,32
.true. 1 ! enableUR ! UR-B-ID: supported= 0,1 (more options easy to add)
.false. 1 ! enableCR ! UR-E-ID: supported= 0,1,2,3,20,21,22,30,31,32
.false. 1 ! enableRR ! UR-D-ID: supported= 0
.true. 1 ! enableFR !
.true. 1 ! enableSR !
!========
FLEX CONSTITUTIVE RELATIONSHIPS
21,1,31,0 ! URFunID - {A,B,E,D} [see cpsm_dmsl_kit], 0=zero*, 1=linear*, 2=power, 3=refPow, 10=logistic, 11=quadroid*, 20=exp, 21=hyperExp*, 22=con2lin*, 30=tessier, 31=michMentes*, 32=lin2con*, *=algebraic, D-recommends {21,1,31,0}
0,21 ! IRFunID - EIRmeth[see cpsm_dmsl_kit]: 0=rawETpot, -1=no E when rains; IRsmoothType=2(power),21(hyperbolic-recommended)
2,31,21 ! CRFunID - {A from U - (2,3,31,10), E from U (2,31), A from S (2,3,21)} recomm: 2,31,21
.false.,2 ! FRFunID - EsplitFrSr - true: splits evaporation between Fr and Sr according to Split_C - .false.: only from Fr; FSFunID - 2=power, 23=line2line
!========
FLEX LAG FUNCTION INFORMATION
convShape smthID max number of conv states ! convolution function options: "none","halfTri"(tR),"symTri"(tS,tR),"genTri"(tS,rR,tF)
"none" -1 1 ! RR
"none" -1 50 ! FR
"none" -1 50 ! SR smthID: -1=original, 0=quadrature, 1=midpoint, 2=trapezoidal (Lag function smoothing)
!========
FLEX INITIAL CONDITIONS INFO
.1,0.01 ! annual rainfall(mm/ts) and runoff coefficient (used only to determine initial condition with option 2 below)
!========
RESERVOIRS_STATE_INFO
stateName iniFlag stateIni stateLo stateHi stateScal ! absolute_inCond=0,relative_inCond=1,steadyState_inCond=2,calib_inCond=3
"Sw,mm " 0 0.0 0.0 1.e4 10.0 ! WR reservoir (snow) [supported iniFlag: 0] (see Kavetski and Kuczera., WRR 2007 for snow res and smoothing strategies)
"Si,mm " 0 0.0 0.0 20.0 10.0 ! IR reservoir (interception) [supported iniFlag: 0,1]
"Su,mm " 0 0 0.0 1.e4 10.0 ! UR reservoir (unsaturated) [supported iniFlag: 0,1]
"Uc,- " 0 0 0.0 1.e4 10.0 ! CR_unsat reservoir (combined) (theta) [supported iniFlag: 0]
"Sc,mm " 1 1 0.0 1.e4 10.0 ! CR_sat reservoir (combined) [supported iniFlag: 0,1]
"Sr,mm " 0 0.0 0.0 1.e4 10.0 ! RR reservoir (riparian) [supported iniFlag: 0]
"Sf,mm " 0 0.0 0.0 1.e4 10.0 ! FR reservoir (fast) [supported iniFlag: 0,2,3]
"Ss,mm " 0 0.0 0.0 1.e4 10.0 ! SR reservoir (slow) [supported iniFlag: 0,2,3]
!========
ACTIVE_PARAMETER_INFO ! (parameters visible to BATEA)
parName parDef parLo parHi parScal parSD parTran parFit linkTo Comment
"Cmlt_E, - " 1.0 1.e-1 3.0 10.0 -9999.9 0 T 0 (cannot be dead) evaporation multiplication factor
"Dspl_SD, - " 1.000000000000e+00 0.0 1.0 10.0 -9999.9 0 T 0 (cannot be dead) Dspl_SD->1 diverts input from FR to SR
"Cmlt_P, - " 1.2 0.9 2.0 10.0 -9999.9 0 T 0 (cannot be dead) precipitation multiplication factor
"Cmlt_Q, - " 1.000000000000e+00 1.e-4 1.e4 10.0 -9999.9 0 T 0 (cannot be dead) streamflow multiplication factor
"Dspl_RD, - " 0.0 0.0 1.0 10.0 -9999.9 0 T 0 (cannot be dead) Dspl_RD->1 shortcuts to RR reservoir (1-res-path)
"Dspl_FD, - " 0.0 0.0 1.0 10.0 -9999.9 0 T 0 (cannot be dead) Dspl_FD->1 diverts input from UR to FR
"Pmax_ED, mm/t " 1.e6 0.1 1.e7 10.0 -9999.9 1 T 0 (cannot be dead) threshold for Inf_Exc_Ov_Fl. High values effectively disable Inf_Exc_Ov_Fl
"MsmtP_ED, mm/t " 1.e-2 1.e-3 1.e1 10.0 -9999.9 0 T 0 (cannot be dead) smoothing for Inf_Exc_Ov_Fl. MsmtP_ED->0 gives less smoothing
"Smax_UR, mm " 2.800000000000e+01 1e-1 1.e3 10.0 -9999.9 0 T 0 UR, store capacity
"BetaQq_UR, - " 1.748084112387e+00 1.e-3 1.e2 10.0 -9999.9 0 T 0 UR, runoff coefficient function parameter, (power, logistic & quadroid) BetaQq_UR->0 gives stronger step-threshold in UR A(S) function
"BetaE_UR, - " 8.205330113019e-01 1.e-2 1.e2 10.0 -9999.9 0 T 0 UR, (michMentes) BetaE_UR->0 gives Evaporation approaching potential if S>0
"K_Qb_UR, 1/t " 9.967250580244e-05 0 2.0 10.0 -9999.9 0 T 0 UR, (linear) controls percolation from UR to SR
"K_Qb_FR, 1/t " 1.7654813754935E-3 0 1.0 10.0 -9999.9 0 T 0 UR, (linear) controls percolation from UR to SR
"K_Qq_FR, mm^b/t " 1E-6 1.e-6 10 10.0 -9999.9 0 T 0 FR, K in Q=K*S^alfa
"Alfa_Qq_FR, - " 1 1.e-4 10 10.0 -9999.9 0 T 0 FR, alfa in Q=K*S^alfa
"MsmtE_S0_FR, mm " 0.5 1.e-2 2.0 10.0 -9999.9 1 T 0 FR, smoothing factor for evaporation (only when UR is disabled, otherwise evap is from UR)
"nRes_FR, - " 1.0 1.e-3 50.0 10.0 -9999.9 1 F 0 FR, number of reservoir states in FR cascade
"nRes_SR, - " 1.0 1.e-1 1.0 10.0 -9999.9 0 F 0 SR, number of reservoir states in SR cascade
"K_Qq_SR, mm^b/t " 1.297986559312e-07 1.e-10 1.e0 10.0 -9999.9 0 T 0 SR, K in Q=K*S^alfa
"Alfa_Qq_SR, - " 2.438373183591e+00 1e-1 1.e1 10.0 -9999.9 0 T 0 SR, alfa in Q=K*S^alfa
"MsmtP_Tp_WR, °C " 1.5 1.e-2 2.0 10.0 -9999.9 1 T 0 WR, smoothing parameter for Tp_WR
"MsmtMmTm_WR, °C " 1.5 1.e-2 2.0 10.0 -9999.9 1 T 0 WR, smoothing parameter for Tm_WR
"K_Qm_WR, mm/°C/t" 1.0 1.e-2 10.0 10.0 -9999.9 1 T 0 WR, degree day factor
"Cmlt_P_WR, - " 1.0 0.5 3.0 10.0 -9999.9 0 T 0 WR, snowfall multiplication factor
"Tm_WR, °C " 1.0 0.0 5.0 10.0 -9999.9 0 T 0 WR, melting point of snow on the ground
"Tp_WR, °C " 1.0 0.0 10.0 10.0 -9999.9 0 T 0 WR, temperature where precipitation becomes snow
"KmQq_FR, 1/t " 0.2 1.e-6 1.0 10.0 -9999.9 0 T 0 FR, K minus, (line2line) K in Q=K*S for the first piece of the piecewise linear Q-S relation
"KpQq_FR, 1/t " 1.1 1.e-3 2.0 10.0 -9999.9 0 T 0 FR, K plus, (line2line) K in Q=K*S for the second piece of the piecewise linear Q-S relation
"Sb_FR, mm " 12.0 0.0 100.0 10.0 -9999.9 0 T 0 FR, (line2line) storage at which there is the transition between Km_FR and Kp_FR
"MsmtQmS0_WR, mm " 2.0 1.e-2 2.0 10.0 -9999.9 1 T 0 WR, smoothing parameter for storage in snow reservoir
!========
MORTO_PARAMETER_INFO ! (parameters that dont exist for this configuration)
"tStart_SL, t " 1.0 1.0 10.0 10.0 -9999.9 0 T 0 SL, time before start of rising limb with zero weight, when LAGsmthID=1, nStateConv>tStart[hi] to avoid chopping recession of lag function
"tRise_SL, t " 1.0 1.0 10.0 10.0 -9999.9 0 T 0 SL, base of rising limb
"tStart_FL, t " 1.0 1.0 10.0 10.0 -9999.9 0 T 0 FL, time before start of rising limb with zero weight, when LAGsmthID=1, nStateConv>tStart[hi] to avoid chopping recession of lag function
"tRise_FL, t " 1.0 1.0 10.0 10.0 -9999.9 0 T 0 FL, base of rising limb
"Dspl_ID, - " 0.0 0.0 1.0 10.0 -9999.9 0 T 0 IR, Dspl_ID->1 diverts input from IR to UR (e.g. to represent throughfall)
"Smax_IR, mm " 10.0 1.e-2 20.0 10.0 -9999.9 1 T 0 IR, store capacity
"MsmtQE_S0_IR, - " 1.e-1 1.e-3 1.0 10.0 -9999.9 1 T 0 IR, smoothing parameter in interception reservoir, controls IR smoothness when odeSolverIRR={0,1,2}: MsmtQE_S0_IR->0 yields stronger threshold in IR reservoir. DK-NB1: probably should be kept fixed; DK-NB2: must be MORTO when odeSolverIRR={-1,-2}. For power smoothing IRsmth~0.3-0.5 is sufficient
"tFall_SL, t " 1.0 1.0 10.0 10.0 -9999.9 1 F 0 SL, base of falling limb
"Gamma_FL, - " 1.0 1.e-1 10.0 10.0 -9999.9 1 F 0 FL, makes lag triangle non-linear
"tFall_FL, t " 1.0 1.0 100.0 10.0 -9999.9 0 T 0 FL, base of falling limb
"tStart_RL, t " 1.0 1.0 10.0 10.0 -9999.9 1 F 0 RL, time before start of rising limb with zero weight, when LAGsmthID=1, nStateConv>tStart[hi] to avoid chopping recession of lag function
"tRise_RL, t " 1.0 1.0 10.0 10.0 -9999.9 1 F 0 RL, base of rising limb
"tFall_RL, t " 1.0 1.0 10.0 10.0 -9999.9 1 F 0 RL, base of falling limb
"MedQq_UR, - " 0.5 0.1 1.0 10.0 -9999.9 0 F 0 UR, Runoff coefficient function parameter, center for logistic function (see SF 2011 papers, Table 1 parameter lambda)
"K_Qq_RR, 1/t " 1.0 5.e-2 4.0 10.0 -9999.9 1 T 0 RR, K in Q=K*S
"Sini_FR, mm " 0.01 0.01 1.e4 10.0 -9999.9 0 F 0 FR, initial state
"Sini_SR, mm " 1.0 1.0 1.e4 10.0 -9999.9 1 F 0 SR, initial state
"MsmtQqSb_FR, mm " 0.5 1.e-2 2.0 10.0 -9999.9 1 F 0 FR, (line2line) smoothing factor for piecewise linear Q-S relation (with KmQq_FR and KpQq_FR)
"MedQq_uCR, - " 1 0.1 1.0 10.0 -9999.9 0 T 0 CR, runoff coefficient function parameter, center for logistic function (see SF 2011 papers, Table 1 parameter lambda)
"Dspl_CD, - " 0.000000000000e+00 0.0 1.0 10.0 -9999.9 0 F 0 CR, Dspl_CD->1 diverts input from Slow convolution store to sat zone in CR
"BetaE_CR, - " 1.374499379112e+00 1.e-2 10.0 10.0 -9999.9 0 T 0 CR, (michMentes) BetaE_CR->0 gives Evaporation approaching potential if S>0
"SevMax_CR, mm " 8.400000000000e+01 1.e-2 500.0 10.0 -9999.9 0 F 0 CR, Evaporation influence zone
"Umax_uCR, - " 9.882352941176e-01 0.0 1.0 10.0 -9999.9 0 F 0 CR, max theta, 0.0<thetaMax<1.0, cannot be 1.0, should not be calibrated
"K_Qb_uCR, 1/t " 0.000000000000e+00 0 0.2 10.0 -9999.9 0 F 0 CR, matrix flow from unsat (saturation U) to sat (storage S) zone in CR
"Smax_CR, mm " 8.500000000000e+01 8.4000000e+01 500 10.0 -9999.9 0 F 0 CR, maximum capacity
"Smin_uCR, mm " 8.400000000000e+01 1.0 250 10.0 -9999.9 0 F 0 CR, minimum capacity of unsat zone must be smaller than parLo(Smax_CR)
"BetaQq_uCR, - " 1.438875948360e+00 0.1 10.0 10.0 -9999.9 0 T 0 CR, runoff coefficient function parameter, (power) Beta->0 gives stronger step-threshold in A(S) function
"BetaQq_sCR, - " 1E32 1.e-2 10.0 10.0 -9999.9 0 F 0 CR, (power) Beta->0 gives stronger step-threshold in A(S) function
"K_Qb_sCR, 1/t " 0 0 0.2 10.0 -9999.9 0 F 0 CR, K in Q=K*S for matrix flow
"K_Qd_sCR, 1/t " 0 0 2.0 10.0 -9999.9 0 F 0 CR, K in Q=K*S for flow to drainage network
!========
ACTIVE_STATE_INFO
stateName stateDef stateLo stateHi stateScal
"Qstrm " 0.0 0.0 1.e4 10.0
"Qpcor " 0.0 0.0 1.e4 10.0
"Eact " 0.0 0.0 1.e4 10.0
!========
MORTO_STATE_INFO ! (states that dont exist for this configuration)
!========
I want to skip the 41 first lines and obtain the numeric values in the columns "parDef", "parLo" and "parHi". For the moment I have this code that read correctly the first line after "ACTIVE_PARAMETER_INFO ! (parameters visible to BATEA)" dividing string and numbers into separate cells:
fid = fopen(filename);
line1 = textscan(fid, '%s%s%s%f%f%f%f%f%f%s%f%s\r\n','HeaderLines',41);
fclose(fid);
The only issue is that the following lines are not taken into account. Do you know why and how I can obtain the values for the the next lines until "MORTO_PARAMETER_INFO ! (parameters that dont exist for this configuration) "?
1 Comment
dpb
on 18 Jun 2018
Ah! Fignewton of the display size; I didn't notice there are more columns off to the right..see updated/corrected Answer
Accepted Answer
line1 = textscan(fid, '%s%s%s%f%f%f%f%f%f%s%f%s\r\n','HeaderLines',41);
>> fmt='%s%s%s%f%f%f%f%f%f%s%f%s'
fmt =
'%s%s%s%f%f%f%f%f%f%s%f%s'
>> sum(fmt=='s')
ans =
5
>> sum(fmt=='f')
ans =
7
>
Actually, this is a difficult file to parse because there's not a delimiter other than blank and only the leading string column is quoted string whereas the comments aren't. That will make for a difficult time in parsing the complete file without using the new fixed-width import options stuff.
However, since you say you only want the three specific numeric columns, that's not so bad to do alone...
fmt=['%*q' repmat('%f',1,3) '%*[^\n]']; % skip one string, read three floats, skip rest of line
parDat=cell2mat(textscan(fid,fmt,'HeaderLines',41,'collectoutput',1)); % read the data
Will repeat until a failure to parse a record occurs which will happen when reach the end of the section
3 Comments
Concetta Di Mauro
on 18 Jun 2018
dpb
on 19 Jun 2018
See the updated Answer that addresses the specific data wanted...
Concetta Di Mauro
on 20 Jun 2018
Edited: Concetta Di Mauro
on 20 Jun 2018
More Answers (0)
Categories
Find more on Text Data Preparation in Help Center and File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!
