modis_GEO.csh: ERROR: Unable to determine start time from L1A file

By Katja.H Date 2011-05-20 11:15

Hello,

I have recently installed the MODIS Level1 DB software (modisl1db_linux.tar.gz) on my
system (SuSE Linux Enterprise Server 10 Service Pack 2, 64 bit) using the online installation tool.

First, I had to comment out the line

>>>> if $OCSSW_DEBUG set bindir = ${bindir}_debug

in the scripts modis_L1A.csh, modis_L1B.csh and modis_GEO.csh to avoid an
error meassage 'OCSSW_DEBUG not defined'.

Do I have to define OCSSW_DEBUG somewhere?

Second, I run the benchmark script (log file see below) and it seems to work.

Then, I downloaded a Terra Modis pdf file (MOD00.A2010131.1215_1.PDS) and I
run

> modis_L1A.csh /home/eosnpp/PROGRAMMES/modisl1db1.7/data/level0/MOD00.A2010131.1215_1.PDS

which generated a level 1a file.

A real problem starts when I execute modis_GEO.csh:

> modis_GEO.csh $DBHOME/T2010131121500.L1A -verbose-http -geocheck_threshold 95

*** /home/eosnpp/PROGRAMMES/modisl1db1.7/run/bin/ncdump: ncopen failed on /home/eosnpp/PROGRAMMES/modisl1db1.7/T2010131121500.L1����i
modis_GEO.csh: ERROR: Unable to determine start time from L1A file.

Does this relate to an incorrect installation ?
The output of ncdump (manually) is given below, too.
Do you have any ideas how I could fix the problem, please?

Thank you very much.

Best regards,
Katja

By @sean Date 2011-05-20 15:03

Katja,

The OCSSW_DEBUG issue is on that was fixed in the last SeaDAS release,
I've just been negligent in getting out an update for the MODISL1DB.

You may either comment out the line as you've done, or define the
variable as 0 (zero).

Now, as to the ncdump error, it appears that the filename has some
non-printing characters appended to it as a series of "�"
I don't know if these are just an misinterpretation by the HTML representation
of the forum or if these actually appear in you error message on the terminal window.

In any event, the problem is with the filename. The modis_GEO.csh script splits the
input filename into a path and filename using 'basename' and 'dirname', then puts them
back together when calling the modis_timestamp binary - which is what is calling ncdump.

It may be possible that something isn't happy with that process within the script, but I can
imagine what that might be.

I also noticed that you listed your machine as being a 64bit system, and that the file you
downloaded was modisl1db_linux.tar.gz. Seems the online installation script is not properly
setting up the download for 64 bit systems - I'll have to fix that. You should download this
file: ftp://samoa.gsfc.nasa.gov/seadas/modisl1db/modisl1db/modisl1db_linux_64.tar.gz
and explode the tarball in your modisl1db directory to ensure you have the 64bit binaries.

I should also address that path - quite a lot of modisl1db's in a row ;-)

Sean

By Katja.H Date 2011-05-23 13:57

Sean,

thank you very much for your help.

I installed the 64bit version using your link. The ncdump error (the
non-printing characters appeared also on the terminal window) did not occur.
It took me a while until was able to run the modis_GEO.csh using the right
attitute and emphemeris files, but after some tries I was able
to process one file from level 0 up to level 1B. That's great.

Running the benchmark resulted in an error while creating the GEO file (see
Appendix A). The log files (see Appendix B)) showed that the
run/data/modis/static/dem30ARC_E60N90.hdf file was missing . Hence, I copied the hdf (dem30ARC_E60N0.hdf dem30ARC_E60N90.hdf
dem30ARC_W180N0.hdf dem30ARC_W180N90.hdf dem30ARC_W60N0.hdf
dem30ARC_W60N90.hdf) manually from a 32bit version I tried before.
After this, the benchmark worked.

Thanks again !

Katja

APPENDIX A: benchmark logfile

===============================================================
SeaDAS Benchmarking Script - MODIS processing
===============================================================

Mo 23. Mai 07:16:21 UTC 2011
MODISL1DB v1.7 running on Linux 2.6.32.27-0.2-xen x86_64 x86_64
OS Release: undetermined

===============================================================
Creating L1A file (modis_L1A.csh)...
===============================================================

modis_L1A.csh A2006167181000.L0 \
-o A2006167181000.L1A

Determining pass start and stop times...
/home/eosnpp/PROGRAMMES/modisl1db1.7/run/bin/l0cnst_write_modis A2006167181000.L0

Input Level 0 : ./A2006167181000.L0
Output Level 1A: ./A2006167181000.L1A

Satellite: aqua
starttime: 2006-06-16T18:10:00.084206Z
stoptime: 2006-06-16T18:14:49.938020Z
duration: 289.853814 seconds

Processing MODIS L0 file to L1A...
/home/eosnpp/PROGRAMMES/modisl1db1.7/run/bin/l1agen_modis
L1A version: 5.0.5 built on Jan 3 2011 (13:27:51)
Scan Number: 0 Mon May 23 07:16:21 2011
Scan Number: 10 Mon May 23 07:16:22 2011
Scan Number: 20 Mon May 23 07:16:22 2011
Scan Number: 30 Mon May 23 07:16:22 2011
Scan Number: 40 Mon May 23 07:16:22 2011
Scan Number: 50 Mon May 23 07:16:23 2011
Scan Number: 60 Mon May 23 07:16:23 2011
Scan Number: 70 Mon May 23 07:16:23 2011
Scan Number: 80 Mon May 23 07:16:23 2011
Scan Number: 90 Mon May 23 07:16:23 2011
Scan Number: 100 Mon May 23 07:16:23 2011
Scan Number: 110 Mon May 23 07:16:23 2011
Scan Number: 120 Mon May 23 07:16:23 2011
Scan Number: 130 Mon May 23 07:16:23 2011
Scan Number: 140 Mon May 23 07:16:23 2011
Scan Number: 150 Mon May 23 07:16:24 2011
Scan Number: 160 Mon May 23 07:16:24 2011
Scan Number: 170 Mon May 23 07:16:24 2011
Scan Number: 180 Mon May 23 07:16:24 2011
Scan Number: 190 Mon May 23 07:16:24 2011
l1agen_modis exit status: 0
MODIS L1A processing complete.

real 3.38
user 2.14
sys 1.13

===============================================================
Creating GEO file (modis_GEO.csh)...
===============================================================

modis_GEO.csh A2006167181000.L1A \
-o A2006167181000.GEO \
-a1 ./ancillary/PM1ATTNR.P2006167.1800.002 \
-e1 ./ancillary/PM1EPHND.P2006167.1200.001

Using user-specified attitude and ephemeris files.

att_file1: ./ancillary/PM1ATTNR.P2006167.1800.002
att_file2: NULL
eph_file1: ./ancillary/PM1EPHND.P2006167.1200.001
eph_file2: NULL

Input Level 1A : ./A2006167181000.L1A
Output Geolocation: ./A2006167181000.GEO

Satellite: aqua
Year: 2006 Day: 167 Hour: 18 Minute: 10
*Terrain Correction Enabled*

Creating MODIS geolocation file...
/home/eosnpp/PROGRAMMES/modisl1db1.7/run/bin/geogen_modis
GEO version: 5.0.14 built on Jan 3 2011 (13:28:06)
geogen_modis exit status: 1

Running validation test on geolocation file...
/home/eosnpp/PROGRAMMES/modisl1db1.7/run/scripts/modis_geocheck.csh A2006167181000.GEO 95
*** ERROR: geogen_modis failed to produce a geolocation file.
*** Validation test failed for geolocation file A2006167181000.GEO.

modis_GEO.csh: ERROR: MODIS geolocation processing failed.
Please ensure utcpole.dat and leapsec.dat are up-to-date in
/home/eosnpp/PROGRAMMES/modisl1db1.7/run/var/modis
Please examine the LogStatus and LogUser files for more information.

Command exited with non-zero status 1
real 0.25
user 0.04
sys 0.07

APPENDIX B: LogStatus.A2006167181000.GEO

****************************************
BEGIN_PGE: Mon May 23 07:16:24 2011
MSG_TAG: 11
FILE: ./LogStatus.A2006167181000.GEO
LOGGING: status message logging enabled
TRACE_LEVEL: tracing disabled
PID_LOGGING: disabled
DISABLED_LEVELS: none
DISABLED_SEEDS: none
DISABLED_CODES: PGSCSC_W_PREDICTED_UT1 PGSDEM_M_FILLVALUE_INCLUDED
THREAD-SAFE MODE: disabled
TOOLKIT_VERSION: SCF TK5.2.17
****************************************

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
!! W A R N I N G !!
!! The Toolkit version found in the PCF does not !!
!! match the current Toolkit version. The PCF in use !!
!! should be replaced with a PCF constructed from the !!
!! template PCF delivered with THIS version of the !!
!! Toolkit (see TOOLKIT_VERSION in banner, above). !!
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

GEO_location_main.c, main():MODIS_U_GEO_BEGIN:288778295
Mon May 23 07:16:24 2011
Seed file: 5.5 Running MOD_PR03 MODIS Geolocation main() 5.2 compiled on Jan 3 2011 at 13:28:06 using makefile 1.1

PGS_TD_timeCheck():PGSTD_M_ASCII_TIME_FMT_B:26112
the time string passed in is in proper CCSDS ASCII Time Format B

PGS_TD_timeCheck():PGSTD_M_ASCII_TIME_FMT_B - 290 additional occurrences

PGS_DEM_OrderSubset():PGSDEM_E_CANNOT_ACCESS_DATA:118273
cannot access datasets...HDF file (/home/eosnpp/PROGRAMMES/modisl1db1.7/run/data/modis/static/dem30ARC_E60N90.hdf), not properly staged

PGS_DEM_Open():PGSDEM_E_IMPROPER_TAG:118272
improper resolution tag or layer...Improper resolution (2) and/or layer (10000000)

GEO_location_main.c, main():MODIS_E_GEO:288779785
Mon May 23 07:16:24 2011
Error returned by function PGS_DEM_Open() for land-sea mask

PGS_DEM_OrderSubset():PGSDEM_E_CANNOT_ACCESS_DATA:118273
cannot access datasets...HDF file (/home/eosnpp/PROGRAMMES/modisl1db1.7/run/data/modis/static/dem30ARC_E60N90.hdf), not properly staged

PGS_DEM_Open():PGSDEM_E_IMPROPER_TAG:118272
improper resolution tag or layer...Improper resolution (2) and/or layer (1)

GEO_location_main.c, main():MODIS_E_GEO:288779785
Mon May 23 07:16:24 2011
Error returned by function GEO_initialize_DEM()

GEO_location_main.c, main():MODIS_U_GEO_END:288778296
Mon May 23 07:16:24 2011
MOD_PR03 controlled exit, with exit code = 1