Hello

After installing SeaDAS 7.4 we are experiencing problems with VIIRSN processing (Also reprojecting files with gpt.sh, solved thanks to the aynur response to the alakes post). After the instalation, we have run  update_luts.py for viirsn, aqua and terra.

- Example of the output of geolocate_viirs:

Main:: Geolocating L1A V2017068033600.L1A_SNPP.nc

VcstCmnGeoNetcdfInputItem:: Failure opening LUT file: /seadas/ocssw/run/var/viirsn/cal/OPER/VIIRS_NPP_CMN_LUT_v1.1.0.1_vcst.nc
VcstCmnGeoNetcdfInputItem:: Failure reading netCDF file for LUT JPL_PLANET_EPHEM
VcstCmnGeo::Unable to read JPL.
Main:: Geolocation processing failure for ifile=V2017068033600.L1A_SNPP.nc

- The content for viirsn instruments_default.par file, do not match the directory tree/content of the seadas installation:

static_lut_file=$OCVARROOT/viirsn/cal/OPER/VIIRS_NPP_CAL_STATIC_LUT_v1.1.0.1_obpg.nc

rsb_dynamic_lut_file=$OCVARROOT/viirsn/cal/OPER/VIIRS_NPP_CAL_RSB_DYNAMIC_LUT_v1.1.0.1_obpg.nc
dnb_dynamic_lut_file=$OCVARROOT/viirsn/cal/OPER/VIIRS_NPP_CAL_DNB_DYNAMIC_LUT_v1.1.0.1_vcst.nc

straylight_lut_file=$OCVARROOT/viirsn/cal/OPER/VIIRS_NPP_CAL_STRAYLIGHT_DYNAMIC_LUT_v1.1.0.1_vcst.nc

cmn_lut_file=$OCVARROOT/viirsn/cal/OPER/VIIRS_NPP_CMN_LUT_v1.1.0.1_vcst.nc
geo_lut_file=$OCVARROOT/viirsn/cal/OPER/VIIRS_NPP_GEO_LUT_v1.1.0.1_obpg.nc

polar_wander_file=$OCVARROOT/viirsn/polar_wander.ascii
leapsec_path=$OCVARROOT/viirsn/

terrain_path=$OCDATAROOT/viirsn/dem/

- content of /seadas/ocssw/run/var/viirsn/cal/OPER directory:

VIIRS_NPP_CAL_DNB_DYNAMIC_LUT_v2.0.0.2_obpg.nc
VIIRS_NPP_CAL_RSB_DYNAMIC_LUT_v2.0.0.2_obpg.nc
VIIRS_NPP_CAL_STATIC_LUT_v2.0.0.2_obpg.nc
VIIRS_NPP_CAL_STRAYLIGHT_DYNAMIC_LUT_v2.0.0.2_obpg.nc
VIIRS_NPP_CMN_LUT_v2.0.0.2_obpg.nc
VIIRS_NPP_GEO_LUT_v2.0.0.2_obpg.nc
VIIRS-SDR-F-LUT_npp_OBPG20140716_v3.h5

- terrain_path=$OCDATAROOT/viirsn/dem/ dem subdirectory do not exists in our SeaDAS 7.4 installation

- The corresponding environmental variables correctly set:

echo $OCVARROOT
/seadas/ocssw/run/var
echo $OCDATAROOT
/seadas/ocssw/run/data

- The linux operating system version:
LSB Version: core-9.20160110ubuntu0.2-amd64:core-9.20160110ubuntu0.2-noarch:security-9.20160110ubuntu0.2-amd64:security-9.20160110ubuntu0.2-noarch
Distributor ID: Ubuntu
Description: Ubuntu 16.04.2 LTS
Release: 16.04
Codename: xenial

We experienced the same problem in two computers, that have the same tree seadas installation and operating system. MODIS processing is working fine.

Regards
Josep

I had the same issue, I just posted here, but it not just seadas 7.4. I am still using seadas 7.3, and it was an automated LUT update that changed the files last night. Neither 7.3 or 7.4 work now.

https://oceancolor.gsfc.nasa.gov/forum/oceancolor/topic_show.pl?tid=6521

I have SeaDAS 7.4 on Linux Mint 18.1 (based on Ubuntu 16.04).  After running update_luts.py I also have the new $OCVARROOT/viirsn/cal/OPER/*_LUT_v2.0.0.2_obpg.nc files but ocssw/run/data/viirsn/instrument_defaults.par still has *_LUT_v1.1.0.1_obpg.nc.

That is what here:
https://oceandata.sci.gsfc.nasa.gov/Ancillary/LUTs/viirsn/cal/OPER/
But as you said, not ./ocssw/run/data/viirsn/instrument_defaults.par

It would be simple to hack the instrument_defaults par by replacing the - with the + as per the LUT update, but I have to wonder if the new files we placed in error?

- OPER:VIIRS_NPP_CMN_LUT_v1.1.0.1_vcst.nc
+ OPER:VIIRS_NPP_CMN_LUT_v2.0.0.2_obpg.nc

- OPER:VIIRS_NPP_CAL_RSB_DYNAMIC_LUT_v1.1.0.1_obpg.nc
+ OPER:VIIRS_NPP_CAL_RSB_DYNAMIC_LUT_v2.0.0.2_obpg.nc

- OPER:VIIRS_NPP_CAL_STRAYLIGHT_DYNAMIC_LUT_v1.1.0.1_vcst.nc
+ OPER:VIIRS_NPP_CAL_STRAYLIGHT_DYNAMIC_LUT_v2.0.0.2_obpg.nc

- OPER:VIIRS_NPP_GEO_LUT_v1.1.0.1_obpg.nc
+ OPER:VIIRS_NPP_GEO_LUT_v2.0.0.2_obpg.nc

- OPER:VIIRS_NPP_CAL_STATIC_LUT_v1.1.0.1_obpg.nc
+ OPER:VIIRS_NPP_CAL_STATIC_LUT_v2.0.0.2_obpg.nc

- OPER:VIIRS_NPP_CAL_DNB_DYNAMIC_LUT_v1.1.0.1_vcst.nc
+ OPER:VIIRS_NPP_CAL_DNB_DYNAMIC_LUT_v2.0.0.2_obpg.nc

As Brock noted this was not related to the v7.4 update.  It's a long and boring story, but the synopsis is this.  We've updated the VIIRS processing code in our production environment to a new version, however the "var" tree is shared and as the Highlander knows, there can be only one.  I've pushed updated versions of the affected binaries and updated the VIIRS defaults files to the v7.3 and v7.4 branches.  If you update your OCSSW code, you should be once again able to process VIIRS.

Regards,
Sean

Yes, that works.... of course
There can be only one, and it appears that be you

And as a reminder for those working with 7.3, you will need to setup your environment and run:
./install_ocssw.py --viirsn
Because the "Update OC Processers" doesn't work in 7.3

Cheers!

Hello

I have updated the ocssw, however there is still a problem related to terrain_path=$OCDATAROOT/viirsn/dem/ dem subdirectory.
The dem subdirectory is still missing. Are dem data placed in other location?

The ouput of geolocate_viirs:

geolocate_viirs ifile=V2017068132400.L1A_SNPP.nc

Main:: Geolocating L1A V2017068132400.L1A_SNPP.nc
Unable to open directory (/seadas/ocssw/run/data/viirsn/dem/) for reading DEM files.
Unable to open directory (/seadas/ocssw/run/data/viirsn/dem/) for reading DEM files.
Unable to open directory (/seadas/ocssw/run/data/viirsn/dem/) for reading DEM files.
Unable to open directory (/seadas/ocssw/run/data/viirsn/dem/) for reading DEM files.
Unable to open directory (/seadas/ocssw/run/data/viirsn/dem/) for reading DEM files.
Unable to open directory (/seadas/ocssw/run/data/viirsn/dem/) for reading DEM files.
Unable to open directory (/seadas/ocssw/run/data/viirsn/dem/) for reading DEM files.
Unable to open directory (/seadas/ocssw/run/data/viirsn/dem/) for reading DEM files.                                                                  
                                                                                                                                                      
VcstViirsGeo:: Failure creating GEO MOD file:                                                                                                        
                                                                                                                                                      
Unable to open directory (/seadas/ocssw/run/data/viirsn/dem/) for reading DEM files.                                                                  
Unable to open directory (/seadas/ocssw/run/data/viirsn/dem/) for reading DEM files.                                                                  
Unable to open directory (/seadas/ocssw/run/data/viirsn/dem/) for reading DEM files.                                                                  
Unable to open directory (/seadas/ocssw/run/data/viirsn/dem/) for reading DEM files.
Unable to open directory (/seadas/ocssw/run/data/viirsn/dem/) for reading DEM files.
Unable to open directory (/seadas/ocssw/run/data/viirsn/dem/) for reading DEM files.
Unable to open directory (/seadas/ocssw/run/data/viirsn/dem/) for reading DEM files.
Unable to open directory (/seadas/ocssw/run/data/viirsn/dem/) for reading DEM files.
terminate called after throwing an instance of 'netCDF::exceptions::NcBadId'
  what():  NcBadId: Not a netcdf id
file: ncVar.cpp  line:998
Abortado (`core' generado)

Josep

If you want to do VIIRS geolocation you need to install the files manually, see What is needed to geolocate NASA L1 VIIRS data?-SeaDAS 7 FAQ

Hello

I have dowloaded and extracted the   file DEM-LWM.tar.gz (ftp://samoa.gsfc.nasa.gov/pub/VIIRSL1/) in my $OCDATAROOT/viirsn directory. The dem/ and lw/ directories have been created. However I am still experiencing problems. This is the current output of geolocate_viirs:

geolocate_viirs ifile=V2017072153000.L1A_SNPP.nc

Main:: Geolocating L1A V2017072153000.L1A_SNPP.nc

VcstViirsGeo:: Failure creating GEO MOD file:

terminate called after throwing an instance of 'netCDF::exceptions::NcBadId'
  what():  NcBadId: Not a netcdf id
file: ncVar.cpp  line:998
Abortado (`core' generado)

Josep

I get the same error on 2 different systems (macOS and linux).  Using "strace geolocate_viirs verbose=true ifile=V2017072153000.L1A_SNPP.nc" reveals that the problem is with "$OCDATAROOT/viirsn/dem//NPP_VIIRS_Terrain-Eco-ANC-Tile_N0722_v1.5.04.00_LP.teb".   I have "geolocate_viirs 2.0 (Mar 10 2017 13:52:39)".  Maybe this new version wants the advertised smaller dem files.

I noticed that there was no output file listed on the command line.  Sure enough, this command fails:

$ geolocate_viirs verbose=true ifile=V2017072153000.L1A_SNPP.nc

Main:: Geolocating L1A V2017072153000.L1A_SNPP.nc
scan: 0 of 202

VcstViirsGeo:: Failure creating GEO MOD file:

scan: 1 of 202
terminate called after throwing an instance of 'netCDF::exceptions::NcBadId'
  what():  NcBadId: Not a netcdf id
file: ncVar.cpp  line:998
Aborted


while this command works fine:

$ geolocate_viirs verbose=true ifile=V2017072153000.L1A_SNPP.nc geofile_mod=V2017072153000.GEO_M.nc

Main:: Geolocating L1A V2017072153000.L1A_SNPP.nc
scan: 0 of 202
scan: 1 of 202
scan: 2 of 202
...
scan: 201 of 202
Geolocation completed.


Admittedly the program should not core dump just because a command line option is missing.  I have a lot of other cleanup work to do on the VIIRS code, so I will add this one to the list.  Let me know if you can successfully geolocate this VIIRS file with the latest OCSSW processors.

don

Hello

I have test geolocate_viirs in comandline test execution adding the geofile_mod option, it is working now.

In my operational script  the option geofile_mod  was already set, however I had to remove the options  terrain_path  and  land_water_mask_path to to accomplish
the processing.

Thank you very much
Josep

Thanks.  geolocate_viirs is working here.  I've been spoiled by all the helpful software that points out when options are missing or incorrect -- need to remember that such luxuries aren't always present.

I am in the process of adding such luxuries now.  Thanks for pointing this one out.

don