Ocean Color Forum - Not logged in
Forum Ocean Color Home Help Search Login
Previous Next Up Topic Products and Algorithms / Satellite Data Products & Algorithms / l2gen starts to fail today (locked) (2611 hits)
By bmurch Date 2011-04-18 19:35
I have a very simple par file that worked yesterday and fails today (the seadas generated par file below works .. both tested commandline from the same shell ">l2gen par=parname.par"
):

>cat A20111071910.QKM.SECOORA.L2_LAC_OC.par


ifile=/tmp/s4p_proc_l2_roi_0.04_Vm2paqZy/MYD021KM.2011107.1910.SECOORA.hdf
geofile=/tmp/s4p_proc_l2_roi_0.04_Vm2paqZy/MYD03.2011107.1910.SECOORA.hdf
ofile1=/tmp/s4p_proc_l2_roi_0.04_Vm2paqZy/A20111071910.QKM.SECOORA.L2_LAC_OC
l2prod1=chlor_a,l2_flags,tau_869,epsilon,sst,qual_sst,flh,Rrs_412,Rrs_443,Rrs_469,Rrs_488,Rrs_531,Rrs_547,Rrs_555,Rrs_645,Rrs_667,Rrs_678,Rrs_748,adg_443_qaa,aph_443_qaa,bbp_547_qaa,Kd_488_lee,Kd_547_lee,Zeu_lee,senz
resolution= 250
met1=/optics1/software/seadas/seadas_6.1/var/anc//2011/107/S201110718_NCEP.MET
met2=/optics1/software/seadas/seadas_6.1/var/anc//2011/108/S201110800_NCEP.MET
met3=/optics1/software/seadas/seadas_6.1/var/anc//2011/108/S201110800_NCEP.MET
sstfile=/optics1/software/seadas/seadas_6.1/var/anc//2011/107/N2011107_SST_OIV2AVAM_24h.nc
icefile=/optics1/software/seadas/seadas_6.1/var/anc//2011/106/N201110600_SEAICE_NSIDC_24h.hdf

It fails here:

Loading water-vapor correction coefficients.

Loading Morel f/Q table from file /optics1/software/seadas/seadas_6.2/run/data/common/morel_fq.dat

Applying ocean BRDF including:
    Reflection/refraction for upwelling radiance.
    Reflection/refraction for downwelling radiance.
    Morel f/Q
QAA processing for 10 bands
QAA bands: (0) 412 nm, (1) 443 nm, (3) 488 nm, (5) 547 nm, (8) 667 nm
QAA wav  : 412.000000 443.000000 469.000000 488.000000 531.000000 547.000000 555.000000 645.000000 667.000000 678.000000
QAA aw   :   0.004641   0.007098   0.010499   0.014579   0.043935   0.053375   0.059649   0.326658   0.433916   0.460971
QAA bbw  :   0.003327   0.002438   0.001909   0.001611   0.001123   0.000989   0.000930   0.000490   0.000425   0.000397
IOP-based Kd_lee product requires iop model selection (iop_opt).  Using default model.
-E- hdf_utils.c line 312: SDwritedata(4456485,[0,0,0],NULL,[140733193388033,4648004897537528152,4640375382057418753],0xa3a4f2bc) failed.
-E- l2gen: error writing to /tmp/s4p_proc_l2_roi_0.04_Vm2paqZy/A20111071910.QKM.SECOORA.L2_LAC_OC

The seadas generated par file looks like this:
seadog 472 :/tmp/s4p_proc_l2_roi_0.04_Vm2paqZy> cat A011107.910.00.L2_LAC.par
ifile=/tmp/s4p_proc_l2_roi_0.04_Vm2paqZy/MYD021KM.2011107.1910.SECOORA.hdf
geofile=/tmp/s4p_proc_l2_roi_0.04_Vm2paqZy/MYD03.2011107.1910.SECOORA.hdf
ofile1=/tmp/s4p_proc_l2_roi_0.04_Vm2paqZy/A011107.910.00.L2_LAC
l2prod1=chlor_a,l2_flags,tau_869,epsilon,sst,qual_sst,flh,Rrs_412,Rrs_443,Rrs_469,Rrs_488,Rrs_531,Rrs_547,Rrs_555,Rrs_645,Rrs_667,Rrs_678,Rrs_748,adg_443_qaa,aph_443_qaa,bbp_547_qaa,Kd_488_lee,Kd_547_lee,Zeu_lee,senz
spixl=       1
epixl=      -1
dpixl=       1
sline=       1
eline=      -1
dline=       1
ctl_pt_incr=       1
proc_ocean=       1
atmocor=       1
proc_land=       1
proc_sst=       1
resolution=    1000
gas_opt=      15
pol_opt=       3
aer_opt=      -3
aermodmin=      -1
aermodmax=      -1
aermodrat=      0.00000
mumm_alpha=      1.94500
mumm_gamma=      1.00000
mumm_epsilon=      1.00000
aer_rrs_short=     -1.00000
aer_rrs_long=     -1.00000
aer_swir_short=    1240
aer_swir_long=    2130
aer_wave_short=     748
aer_wave_long=     869
aer_iter_max=      10
brdf_opt=       7
iop_opt=       0
qaa_opt=       0
glint_opt=       1
outband_opt=       2
filter_opt=       1
filter_file=$OCDATAROOT/modisa/msl12_filter.dat
met1=/optics1/software/seadas/seadas_6.1/var/anc//2011/107/S201110718_NCEP.MET
met2=/optics1/software/seadas/seadas_6.1/var/anc//2011/108/S201110800_NCEP.MET
met3=/optics1/software/seadas/seadas_6.1/var/anc//2011/108/S201110800_NCEP.MET
ozone1=$OCDATAROOT/common/ozone_climatology.hdf
no2file=$OCDATAROOT/common/no2_climatology.hdf
sstfile=/optics1/software/seadas/seadas_6.1/var/anc//2011/107/N2011107_SST_OIV2AVAM_24h.nc
icefile=/optics1/software/seadas/seadas_6.1/var/anc//2011/106/N201110600_SEAICE_NSIDC_24h.hdf
land=$OCDATAROOT/common/landmask.dat
water=$OCDATAROOT/common/watermask.dat
gain=[0.9768,0.9936,1.0113,0.9972,0.9946,0.995,0.9999,1.0252,0.9961,0.9974,0.9977,1.0244,1.0, 1.0, 1.0, 1.0]
offset=[0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0]
albedo=    0.0270000
rhoamin=  0.000200000
qaa_adg_s=    0.0150000
chloc2_wave=[488,547]
chloc2_coef=[0.2500,-2.4752,1.4061,-2.8237, 0.5405]
chloc3_wave=[443,488,547]
chloc3_coef=[0.2424,-2.7423,1.8017, 0.0015,-1.2280]
chloc4_wave=[]
chloc4_coef=[]
chlclark_wave=[443,488,547]
chlclark_coef=[0.789273,-3.925523,11.637764,-27.157997,27.936958,-10.398587]
nlwmin=     0.150000
wsmax=      12.0000
tauamax=     0.300000
epsmin=     0.800000
epsmax=      1.35000
glint=   0.00500000
windspeed=   -1000
windangle=   -1000
pressure=   -1000
ozone=   -1000
watervapor=   -1000
relhumid=   -1000
sunzen=      70.0000
satzen=      60.0000
maskland=       1
maskcloud=       1
maskglint=       0
maskbath=       0
masksunzen=       0
masksatzen=       0
maskhilt=       1
maskstlight=       0
giop_wave=[412,443,469,488,531,547,555]
giop_fit_opt=       1
giop_maxiter= 500
giop_aph_opt=       2
giop_adg_opt=       1
giop_bbp_opt=       3
giop_aph_file=$OCDATAROOT/common/aph_default.txt
giop_adg_file=$OCDATAROOT/common/adg_default.txt
giop_bbp_file=$OCDATAROOT/common/bbp_default.txt
giop_aph_s= 0.500000
giop_adg_s= 0.0145000
giop_bbp_s= 1.03373
seadog 473 :/tmp/s4p_proc_l2_roi_0.04_Vm2paqZy> echo $OCDATAROOT
/optics1/software/seadas/seadas_6.2/run/data
seadog 474 :/tmp/s4p_proc_l2_roi_0.04_Vm2paqZy> cat A011107.910.00.L2_LAC.par
ifile=/tmp/s4p_proc_l2_roi_0.04_Vm2paqZy/MYD021KM.2011107.1910.SECOORA.hdf
geofile=/tmp/s4p_proc_l2_roi_0.04_Vm2paqZy/MYD03.2011107.1910.SECOORA.hdf
ofile1=/tmp/s4p_proc_l2_roi_0.04_Vm2paqZy/A011107.910.00.L2_LAC
l2prod1=aot_869 angstrom Rrs_vvv chlor_a Kd_490 pic poc cdom_index ipar nflh par
spixl=       1
epixl=      -1
dpixl=       1
sline=       1
eline=      -1
dline=       1
ctl_pt_incr=       1
proc_ocean=       1
atmocor=       1
proc_land=       1
proc_sst=       1
resolution=    1000
gas_opt=      15
pol_opt=       3
aer_opt=      -3
aermodmin=      -1
aermodmax=      -1
aermodrat=      0.00000
mumm_alpha=      1.94500
mumm_gamma=      1.00000
mumm_epsilon=      1.00000
aer_rrs_short=     -1.00000
aer_rrs_long=     -1.00000
aer_swir_short=    1240
aer_swir_long=    2130
aer_wave_short=     748
aer_wave_long=     869
aer_iter_max=      10
brdf_opt=       7
iop_opt=       0
qaa_opt=       0
glint_opt=       1
outband_opt=       2
filter_opt=       1
filter_file=$OCDATAROOT/modisa/msl12_filter.dat
met1=/optics1/software/seadas/seadas_6.1/var/anc//2011/107/S201110718_NCEP.MET
met2=/optics1/software/seadas/seadas_6.1/var/anc//2011/108/S201110800_NCEP.MET
met3=/optics1/software/seadas/seadas_6.1/var/anc//2011/108/S201110800_NCEP.MET
ozone1=$OCDATAROOT/common/ozone_climatology.hdf
no2file=$OCDATAROOT/common/no2_climatology.hdf
sstfile=/optics1/software/seadas/seadas_6.1/var/anc//2011/107/N2011107_SST_OIV2AVAM_24h.nc
icefile=/optics1/software/seadas/seadas_6.1/var/anc//2011/106/N201110600_SEAICE_NSIDC_24h.hdf
land=$OCDATAROOT/common/landmask.dat
water=$OCDATAROOT/common/watermask.dat
gain=[0.9768,0.9936,1.0113,0.9972,0.9946,0.995,0.9999,1.0252,0.9961,0.9974,0.9977,1.0244,1.0, 1.0, 1.0, 1.0]
offset=[0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0]
albedo=    0.0270000
rhoamin=  0.000200000
qaa_adg_s=    0.0150000
chloc2_wave=[488,547]
chloc2_coef=[0.2500,-2.4752,1.4061,-2.8237, 0.5405]
chloc3_wave=[443,488,547]
chloc3_coef=[0.2424,-2.7423,1.8017, 0.0015,-1.2280]
chloc4_wave=[]
chloc4_coef=[]
chlclark_wave=[443,488,547]
chlclark_coef=[0.789273,-3.925523,11.637764,-27.157997,27.936958,-10.398587]
nlwmin=     0.150000
wsmax=      12.0000
tauamax=     0.300000
epsmin=     0.800000
epsmax=      1.35000
glint=   0.00500000
windspeed=   -1000
windangle=   -1000
pressure=   -1000
ozone=   -1000
watervapor=   -1000
relhumid=   -1000
sunzen=      70.0000
satzen=      60.0000
maskland=       1
maskcloud=       1
maskglint=       0
maskbath=       0
masksunzen=       0
masksatzen=       0
maskhilt=       1
maskstlight=       0
giop_wave=[412,443,469,488,531,547,555]
giop_fit_opt=       1
giop_maxiter= 500
giop_aph_opt=       2
giop_adg_opt=       1
giop_bbp_opt=       3
giop_aph_file=$OCDATAROOT/common/aph_default.txt
giop_adg_file=$OCDATAROOT/common/adg_default.txt
giop_bbp_file=$OCDATAROOT/common/bbp_default.txt
giop_aph_s= 0.500000
giop_adg_s= 0.0145000
giop_bbp_s= 1.03373

And it appears to succeed.

What has happened?
By @sean Date 2011-04-19 13:27
Sure it ever succeeded?  With that l2prod list and resolution=250 you're likely exceeding 2GB for the output file.
HDF doesn't like that.  Choose fewer products, or a smaller scene.

Sean
By bmurch Date 2011-04-19 15:02
Sean,

It appears you are correct and the 2GB file size limit was exceeded. I have determined the reason for this.

Thanks
Brock
Previous Next Up Topic Products and Algorithms / Satellite Data Products & Algorithms / l2gen starts to fail today (locked) (2611 hits)



Responsible NASA Official: Gene C. Feldman
Curator: OceanColor Webmaster
Authorized by: Gene C. Feldman
Updated: 27 November 2007 		Privacy Policy and Important Notices NASA logo