Not logged inOcean Color Forum

The forum is locked.

The Ocean Color Forum has transitioned over to the Earthdata Forum (https://forum.earthdata.nasa.gov/). The information existing below will be retained for historical reference. Please sign into the Earthdata Forum for active user support.

Up Topic SeaDAS / SeaDAS - General Questions / viirsn processing after SeaDAS 7.4 upgrade
- By jcoca Date 2017-03-10 05:26
Hello

After installing SeaDAS 7.4 we are experiencing problems with VIIRSN processing (Also reprojecting files with gpt.sh, solved thanks to the aynur response to the alakes post). After the instalation, we have run  update_luts.py for viirsn, aqua and terra.

- Example of the output of geolocate_viirs:

Main:: Geolocating L1A V2017068033600.L1A_SNPP.nc

VcstCmnGeoNetcdfInputItem:: Failure opening LUT file: /seadas/ocssw/run/var/viirsn/cal/OPER/VIIRS_NPP_CMN_LUT_v1.1.0.1_vcst.nc
VcstCmnGeoNetcdfInputItem:: Failure reading netCDF file for LUT JPL_PLANET_EPHEM
VcstCmnGeo::Unable to read JPL.
Main:: Geolocation processing failure for ifile=V2017068033600.L1A_SNPP.nc

- The content for viirsn instruments_default.par file, do not match the directory tree/content of the seadas installation:

static_lut_file=$OCVARROOT/viirsn/cal/OPER/VIIRS_NPP_CAL_STATIC_LUT_v1.1.0.1_obpg.nc

rsb_dynamic_lut_file=$OCVARROOT/viirsn/cal/OPER/VIIRS_NPP_CAL_RSB_DYNAMIC_LUT_v1.1.0.1_obpg.nc
dnb_dynamic_lut_file=$OCVARROOT/viirsn/cal/OPER/VIIRS_NPP_CAL_DNB_DYNAMIC_LUT_v1.1.0.1_vcst.nc

straylight_lut_file=$OCVARROOT/viirsn/cal/OPER/VIIRS_NPP_CAL_STRAYLIGHT_DYNAMIC_LUT_v1.1.0.1_vcst.nc

cmn_lut_file=$OCVARROOT/viirsn/cal/OPER/VIIRS_NPP_CMN_LUT_v1.1.0.1_vcst.nc
geo_lut_file=$OCVARROOT/viirsn/cal/OPER/VIIRS_NPP_GEO_LUT_v1.1.0.1_obpg.nc

polar_wander_file=$OCVARROOT/viirsn/polar_wander.ascii
leapsec_path=$OCVARROOT/viirsn/

terrain_path=$OCDATAROOT/viirsn/dem/

- content of /seadas/ocssw/run/var/viirsn/cal/OPER directory:

VIIRS_NPP_CAL_DNB_DYNAMIC_LUT_v2.0.0.2_obpg.nc
VIIRS_NPP_CAL_RSB_DYNAMIC_LUT_v2.0.0.2_obpg.nc
VIIRS_NPP_CAL_STATIC_LUT_v2.0.0.2_obpg.nc
VIIRS_NPP_CAL_STRAYLIGHT_DYNAMIC_LUT_v2.0.0.2_obpg.nc
VIIRS_NPP_CMN_LUT_v2.0.0.2_obpg.nc
VIIRS_NPP_GEO_LUT_v2.0.0.2_obpg.nc
VIIRS-SDR-F-LUT_npp_OBPG20140716_v3.h5

- terrain_path=$OCDATAROOT/viirsn/dem/ dem subdirectory do not exists in our SeaDAS 7.4 installation

- The corresponding environmental variables correctly set:

echo $OCVARROOT
/seadas/ocssw/run/var
echo $OCDATAROOT
/seadas/ocssw/run/data

- The linux operating system version:
LSB Version: core-9.20160110ubuntu0.2-amd64:core-9.20160110ubuntu0.2-noarch:security-9.20160110ubuntu0.2-amd64:security-9.20160110ubuntu0.2-noarch
Distributor ID: Ubuntu
Description: Ubuntu 16.04.2 LTS
Release: 16.04
Codename: xenial

We experienced the same problem in two computers, that have the same tree seadas installation and operating system. MODIS processing is working fine.

Regards
Josep
- By oo_processing Date 2017-03-10 11:31
I had the same issue, I just posted here, but it not just seadas 7.4. I am still using seadas 7.3, and it was an automated LUT update that changed the files last night. Neither 7.3 or 7.4 work now.

https://oceancolor.gsfc.nasa.gov/forum/oceancolor/topic_show.pl?tid=6521
- By gnwiii Date 2017-03-10 13:57
I have SeaDAS 7.4 on Linux Mint 18.1 (based on Ubuntu 16.04).  After running update_luts.py I also have the new $OCVARROOT/viirsn/cal/OPER/*_LUT_v2.0.0.2_obpg.nc files but ocssw/run/data/viirsn/instrument_defaults.par still has *_LUT_v1.1.0.1_obpg.nc.
- By oo_processing Date 2017-03-10 14:24 Edited 2017-03-10 15:20
That is what here:
https://oceandata.sci.gsfc.nasa.gov/Ancillary/LUTs/viirsn/cal/OPER/
But as you said, not ./ocssw/run/data/viirsn/instrument_defaults.par

It would be simple to hack the instrument_defaults par by replacing the - with the + as per the LUT update, but I have to wonder if the new files we placed in error?

- OPER:VIIRS_NPP_CMN_LUT_v1.1.0.1_vcst.nc
+ OPER:VIIRS_NPP_CMN_LUT_v2.0.0.2_obpg.nc

- OPER:VIIRS_NPP_CAL_RSB_DYNAMIC_LUT_v1.1.0.1_obpg.nc
+ OPER:VIIRS_NPP_CAL_RSB_DYNAMIC_LUT_v2.0.0.2_obpg.nc

- OPER:VIIRS_NPP_CAL_STRAYLIGHT_DYNAMIC_LUT_v1.1.0.1_vcst.nc
+ OPER:VIIRS_NPP_CAL_STRAYLIGHT_DYNAMIC_LUT_v2.0.0.2_obpg.nc

- OPER:VIIRS_NPP_GEO_LUT_v1.1.0.1_obpg.nc
+ OPER:VIIRS_NPP_GEO_LUT_v2.0.0.2_obpg.nc

- OPER:VIIRS_NPP_CAL_STATIC_LUT_v1.1.0.1_obpg.nc
+ OPER:VIIRS_NPP_CAL_STATIC_LUT_v2.0.0.2_obpg.nc

- OPER:VIIRS_NPP_CAL_DNB_DYNAMIC_LUT_v1.1.0.1_vcst.nc
+ OPER:VIIRS_NPP_CAL_DNB_DYNAMIC_LUT_v2.0.0.2_obpg.nc
- By seanbailey Date 2017-03-10 15:20
As Brock noted this was not related to the v7.4 update.  It's a long and boring story, but the synopsis is this.  We've updated the VIIRS processing code in our production environment to a new version, however the "var" tree is shared and as the Highlander knows, there can be only one.  I've pushed updated versions of the affected binaries and updated the VIIRS defaults files to the v7.3 and v7.4 branches.  If you update your OCSSW code, you should be once again able to process VIIRS.

Regards,
Sean
- By oo_processing Date 2017-03-10 15:24 Edited 2017-03-10 15:30
Yes, that works.... of course :grin:
There can be only one, and it appears that be you :wink:

And as a reminder for those working with 7.3, you will need to setup your environment and run:
./install_ocssw.py --viirsn
Because the "Update OC Processers" doesn't work in 7.3

Cheers!
- By jcoca Date 2017-03-12 13:43
Hello

I have updated the ocssw, however there is still a problem related to terrain_path=$OCDATAROOT/viirsn/dem/ dem subdirectory.
The dem subdirectory is still missing. Are dem data placed in other location?

The ouput of geolocate_viirs:

geolocate_viirs ifile=V2017068132400.L1A_SNPP.nc

Main:: Geolocating L1A V2017068132400.L1A_SNPP.nc
Unable to open directory (/seadas/ocssw/run/data/viirsn/dem/) for reading DEM files.
Unable to open directory (/seadas/ocssw/run/data/viirsn/dem/) for reading DEM files.
Unable to open directory (/seadas/ocssw/run/data/viirsn/dem/) for reading DEM files.
Unable to open directory (/seadas/ocssw/run/data/viirsn/dem/) for reading DEM files.
Unable to open directory (/seadas/ocssw/run/data/viirsn/dem/) for reading DEM files.
Unable to open directory (/seadas/ocssw/run/data/viirsn/dem/) for reading DEM files.
Unable to open directory (/seadas/ocssw/run/data/viirsn/dem/) for reading DEM files.
Unable to open directory (/seadas/ocssw/run/data/viirsn/dem/) for reading DEM files.                                                                  
                                                                                                                                                      
VcstViirsGeo:: Failure creating GEO MOD file:                                                                                                        
                                                                                                                                                      
Unable to open directory (/seadas/ocssw/run/data/viirsn/dem/) for reading DEM files.                                                                  
Unable to open directory (/seadas/ocssw/run/data/viirsn/dem/) for reading DEM files.                                                                  
Unable to open directory (/seadas/ocssw/run/data/viirsn/dem/) for reading DEM files.                                                                  
Unable to open directory (/seadas/ocssw/run/data/viirsn/dem/) for reading DEM files.
Unable to open directory (/seadas/ocssw/run/data/viirsn/dem/) for reading DEM files.
Unable to open directory (/seadas/ocssw/run/data/viirsn/dem/) for reading DEM files.
Unable to open directory (/seadas/ocssw/run/data/viirsn/dem/) for reading DEM files.
Unable to open directory (/seadas/ocssw/run/data/viirsn/dem/) for reading DEM files.
terminate called after throwing an instance of 'netCDF::exceptions::NcBadId'
  what():  NcBadId: Not a netcdf id
file: ncVar.cpp  line:998
Abortado (`core' generado)

Josep
- By gnwiii Date 2017-03-12 17:39 Edited 2017-03-13 08:24
If you want to do VIIRS geolocation you need to install the files manually, see What is needed to geolocate NASA L1 VIIRS data?-SeaDAS 7 FAQ
- By jcoca Date 2017-03-14 05:20
Hello

I have dowloaded and extracted the   file DEM-LWM.tar.gz (ftp://samoa.gsfc.nasa.gov/pub/VIIRSL1/) in my $OCDATAROOT/viirsn directory. The dem/ and lw/ directories have been created. However I am still experiencing problems. This is the current output of geolocate_viirs:

geolocate_viirs ifile=V2017072153000.L1A_SNPP.nc

Main:: Geolocating L1A V2017072153000.L1A_SNPP.nc

VcstViirsGeo:: Failure creating GEO MOD file:

terminate called after throwing an instance of 'netCDF::exceptions::NcBadId'
  what():  NcBadId: Not a netcdf id
file: ncVar.cpp  line:998
Abortado (`core' generado)

Josep
- By gnwiii Date 2017-03-14 08:44
I get the same error on 2 different systems (macOS and linux).  Using "strace geolocate_viirs verbose=true ifile=V2017072153000.L1A_SNPP.nc" reveals that the problem is with "$OCDATAROOT/viirsn/dem//NPP_VIIRS_Terrain-Eco-ANC-Tile_N0722_v1.5.04.00_LP.teb".   I have "geolocate_viirs 2.0 (Mar 10 2017 13:52:39)".  Maybe this new version wants the advertised smaller dem files.
- By dshea Date 2017-03-15 12:14 Edited 2017-03-16 12:47
I noticed that there was no output file listed on the command line.  Sure enough, this command fails:

$ geolocate_viirs verbose=true ifile=V2017072153000.L1A_SNPP.nc

Main:: Geolocating L1A V2017072153000.L1A_SNPP.nc
scan: 0 of 202

VcstViirsGeo:: Failure creating GEO MOD file:

scan: 1 of 202
terminate called after throwing an instance of 'netCDF::exceptions::NcBadId'
  what():  NcBadId: Not a netcdf id
file: ncVar.cpp  line:998
Aborted


while this command works fine:

$ geolocate_viirs verbose=true ifile=V2017072153000.L1A_SNPP.nc geofile_mod=V2017072153000.GEO_M.nc

Main:: Geolocating L1A V2017072153000.L1A_SNPP.nc
scan: 0 of 202
scan: 1 of 202
scan: 2 of 202
...
scan: 201 of 202
Geolocation completed.


Admittedly the program should not core dump just because a command line option is missing.  I have a lot of other cleanup work to do on the VIIRS code, so I will add this one to the list.  Let me know if you can successfully geolocate this VIIRS file with the latest OCSSW processors.

don
- By jcoca Date 2017-03-16 08:50
Hello

I have test geolocate_viirs in comandline test execution adding the geofile_mod option, it is working now.

In my operational script  the option geofile_mod  was already set, however I had to remove the options  terrain_path  and  land_water_mask_path to to accomplish
the processing.

Thank you very much
Josep
- By gnwiii Date 2017-03-16 09:29
Thanks.  geolocate_viirs is working here.  I've been spoiled by all the helpful software that points out when options are missing or incorrect -- need to remember that such luxuries aren't always present.
- By dshea Date 2017-03-16 10:55
I am in the process of adding such luxuries now.  Thanks for pointing this one out.

don
Up Topic SeaDAS / SeaDAS - General Questions / viirsn processing after SeaDAS 7.4 upgrade

Powered by mwForum 2.29.7 © 1999-2015 Markus Wichitill