Not logged inOcean Color Forum
Forum Ocean Color Home Help Search Login
Up Topic SeaDAS / SeaDAS 6.x - General Questions / modis_GEO.csh modis_atteph.py fail (locked)
- By daurin Date 2011-10-18 14:24
Hello,

I have a new installation of Seadas 6.2b on a RHEL 6.1 with IDL 8.1.  Out of the gate, I am encountering the following error when trying to generate the geolocation file for Aqua L1A_LAC:

  dirk@oceanbio3:~/Imagery/amazon$ seadas
  IDL Version 8.1 (linux x86_64 m64). (c) 2011, ITT Visual Information Solutions
  Installation number: 12936.
  Licensed for use by: Globe

  SeaDAS Version 6.2 Update 2b (pid = 8850)
  SeaDAS>
  unix cmd =
  $SEADAS/run/scripts/modis_GEO.csh /home/dirk/Imagery/amazon/modisa/L1A/A2009148164500.L1A_LAC -o /home/dirk/Imagery/amazon/modisa/L1A/A2009148164500.GEO -verbose-http -geocheck_threshold 95
  Determining required attitude and ephemeris files...
  modis_atteph.py /home/dirk/Imagery/amazon/modisa/L1A/A2009148164500.L1A_LAC --verbose
  Determining pass start and end times..

  Start Time: 2009148164500
  Stop Time: 2009148164959
  Mission: A

  Downloading 'PM1ATTNR.P2009148.1600.003'
  Traceback (most recent call last):
    File "/home/dirk/seadas6.2/run/scripts/modis_atteph.py", line 57, in <module>
      m.locate()
    File "/home/dirk/seadas6.2/run/scripts/modules/modis_atteph_utils.py", line 191, in locate
      status = ProcUtils.httpdl(''.join([self.data_site, "/cgi/getfile/", FILE]), os.path.join(attephpath, FILE))
    File "/home/dirk/seadas6.2/run/scripts/modules/ProcUtils.py", line 37, in httpdl
      f = open(file, 'wb')
  IOError: [Errno 13] Permission denied: 'PM1ATTNR.P2009148.1600.003'
  ** Failed to determine/retrieve attitude and ephemeris files **
  No attitude and ephemeris information available for this Aqua granule.
  Processing cannot proceed; exiting.

  exit_status=            1
  SeaDAS>

Based on an earlier post (http://oceancolor.gsfc.nasa.gov/forum/oceancolor/topic_show.pl?pid=17450;hl=#pid17450), I replaced the modis_atteph_utils.py, ProcUtils.py, and modis_geocheck.py files with the ones attached to that post.  Incidentally, the only files in /ancillary are:

  dirk@oceanbio3:~/seadas6.2/benchmarks/ancillary$ l
  total 36316
  drwxr-xr-x. 2 dirk dirk     4096 Nov 30  2010 .
  drwxr-xr-x. 3 dirk dirk     4096 Nov 30  2010 ..
  -rw-r--r--. 1 dirk dirk   173419 Nov 17  2010 MYD02_Emissive_LUTs.V6.1.5.0g.hdf
  -rw-r--r--. 1 dirk dirk    47022 Nov 17  2010 MYD02_QA_LUTs.V6.1.5.0g.hdf
  -rw-r--r--. 1 dirk dirk  3146655 Nov 17  2010 MYD02_Reflective_LUTs.V6.1.5.0g.hdf
  -rw-r--r--. 1 dirk dirk 15559592 Nov 17  2010 N200616700_NO2_OMI_24h.hdf
  -rw-r--r--. 1 dirk dirk   201150 Nov 17  2010 N200616700_O3_TOMSOMI_24h.hdf
  -rw-r--r--. 1 dirk dirk   245328 Nov 17  2010 N200616700_SEAICE_NSIDC_24h.hdf
  -rw-r--r--. 1 dirk dirk  1641767 Nov 17  2010 N200616718_MET_NCEPN_6h.hdf
  -rw-r--r--. 1 dirk dirk  8305488 Nov 17  2010 N2006167_SST_OIV2AVAM_24h.nc
  -rw-r--r--. 1 dirk dirk  1641767 Nov 17  2010 N200616800_MET_NCEPN_6h.hdf
  -rw-r--r--. 1 dirk dirk   201150 Nov 17  2010 N200616800_O3_TOMSOMI_24h.hdf
  -rw-r--r--. 1 dirk dirk   462848 Nov 17  2010 PM1ATTNR.P2006167.1800.002
  -rw-r--r--. 1 dirk dirk  5531104 Nov 17  2010 PM1EPHND.P2006167.1200.001
  dirk@oceanbio3:~/seadas6.2/benchmarks/ancillary$

...and the permissions on that directory are:
  drwxr-xr-x. 2 dirk dirk      4096 Nov 30  2010 ancillary

Thanks,
Dirk
- By gwyn Date 2011-10-19 10:16
Dirk,

That's a puzzler; you're doing everything right as far as I can tell.  Do you get the same error when you call modis_atteph.py directly from the unix command line?

modis_atteph.py /home/dirk/Imagery/amazon/modisa/L1A/A2009148164500.L1A_LAC --verbose

Do you have write permission in the working directory, and were any files written there?

How is $MODIS_ATTEPH defined, and do you have write permission there?
- By daurin Date 2011-10-19 11:47
Gwyn,

It gets weirder.  That python script appears to work fine:

dirk@oceanbio3:~/rs_scripts$ modis_atteph.py /home/dirk/Imagery/amazon/modisa/L1A/A2009148164500.L1A_LAC --verbose
Determining pass start and end times..

Start Time: 2009148164500
Stop Time: 2009148164959
Mission: A

All required definitive attitude and ephemeris files successfully determined and downloaded.
att_file1=/home/dirk/seadas6.2/run/var/modis/atteph/2009/148/PM1ATTNR.P2009148.1600.003
eph_file1=/home/dirk/seadas6.2/run/var/modis/atteph/2009/148/PM1EPHND.P2009148.1200.003

However, calling it with modis_GEO.csh does not work; although today it is giving me a new and different error than what I posted yesterday:

dirk@oceanbio3:~/rs_scripts$ ./test1.sh
<<<<<<<<<<<<<<<<<<<<<<<<<<***********~~~~~~~~~~~~~~~~~~~~~~~~~~~************>>>>>>>>>>>>>>>>>>>>>>>
Begin processing. Filebasename:
A2009148164500
Determining required attitude and ephemeris files...
modis_atteph.py /home/dirk/Imagery/amazon/modisa/L1A/A2009148164500.L1A_LAC
Input  Level 1A   : /home/dirk/Imagery/amazon/modisa/L1A/A2009148164500.L1A_LAC
Output Geolocation: /home/dirk/Imagery/amazon/modisa/L1A/A2009148164500.GEO

Satellite: aqua
Year: 2009  Day: 148  Hour: 16  Minute: 45
*Terrain Correction Enabled*

Creating MODIS geolocation file...
/home/dirk/seadas6.2/run/bin/geogen_modis
GEO version: 5.0.14 built on Apr  8 2011 (09:22:14)
scan: 0 out of 203 Wed Oct 19 11:42:04 2011
scan: 10 out of 203 Wed Oct 19 11:42:06 2011
scan: 20 out of 203 Wed Oct 19 11:42:07 2011
scan: 30 out of 203 Wed Oct 19 11:42:08 2011
scan: 40 out of 203 Wed Oct 19 11:42:10 2011
scan: 50 out of 203 Wed Oct 19 11:42:11 2011
scan: 60 out of 203 Wed Oct 19 11:42:12 2011
scan: 70 out of 203 Wed Oct 19 11:42:13 2011
scan: 80 out of 203 Wed Oct 19 11:42:14 2011
scan: 90 out of 203 Wed Oct 19 11:42:15 2011
scan: 100 out of 203 Wed Oct 19 11:42:16 2011
scan: 110 out of 203 Wed Oct 19 11:42:17 2011
scan: 120 out of 203 Wed Oct 19 11:42:18 2011
scan: 130 out of 203 Wed Oct 19 11:42:19 2011
scan: 140 out of 203 Wed Oct 19 11:42:20 2011
scan: 150 out of 203 Wed Oct 19 11:42:21 2011
scan: 160 out of 203 Wed Oct 19 11:42:22 2011
scan: 170 out of 203 Wed Oct 19 11:42:24 2011
scan: 180 out of 203 Wed Oct 19 11:42:25 2011
scan: 190 out of 203 Wed Oct 19 11:42:26 2011
scan: 200 out of 203 Wed Oct 19 11:42:27 2011
geogen_modis exit status: 0

Running validation test on geolocation file...
modis_geocheck.py A2009148164500.GEO 95 --verbose
/home/dirk/seadas6.2/run/scripts/modis_geocheck.py: Permission denied.

modis_GEO.csh: ERROR: MODIS geolocation processing failed.
Please ensure utcpole.dat and leapsec.dat are up-to-date in
/home/dirk/seadas6.2/run/var/modis
Please examine the LogStatus and LogUser files for more information.

I am attaching the test1.sh script.  I get the exact same response from the Seadas gui.  Here are the permissions on the L1A directory:

dirk@oceanbio3:~/Imagery/amazon/modisa$ l
total 40
drwxrwxrwx. 5 dirk dirk  4096 Oct 19 08:30 .
drwxrwxrwx. 4 dirk dirk  4096 Oct 19 09:44 ..
-rw--w-rw-. 1 dirk dirk    97 Oct 17 09:22 .directory
drwxrwxrwx. 3 dirk dirk 12288 Oct 19 11:34 L1A
drwxrwxrwx. 2 dirk dirk  4096 Oct 19 06:30 L1B
drwxrwxrwx. 2 dirk dirk 12288 Oct 19 09:57 L2

Here are the files produced in the L1A directory:

-rw-rw-r--. 1 dirk dirk  60672614 Oct 19 11:42 A2009148164500.GEO
-rw-rw-r--. 1 dirk dirk     12532 Oct 19 11:42 A2009148164500.GEO.met
-rw-rw-r--. 1 dirk dirk     21684 Oct 19 11:42 A2009148164500.GEO.pcf
-rw-rw-rw-. 1 dirk dirk 571515376 Oct 19 11:42 A2009148164500.L1A_LAC
-rw-rw-r--. 1 dirk dirk      8458 Oct 19 11:42 A2009148164500.L1A_LAC.met
...and:
-rw-rw-r--. 1 dirk dirk      1482 Oct 19 11:42 GetAttr.temp
-rw-rw-r--. 1 dirk dirk      1888 Oct 19 11:42 LogReport.A2009148164500.GEO
-rw-rw-r--. 1 dirk dirk      5190 Oct 19 11:42 LogStatus.A2009148164500.GEO
-rw-rw-r--. 1 dirk dirk      1892 Oct 19 11:42 LogUser.A2009148164500.GEO
-rw-rw-r--. 1 dirk dirk       201 Oct 19 11:42 ShmMem

I'm attaching the logs.
Attachment: test1.sh (2k)
- By daurin Date 2011-10-19 11:57
Ah, I see the problem:

-rw-rw-r--. 1 dirk dirk  1328 Oct 18 14:08 modis_geocheck.py

solution:

dirk@oceanbio3:~/seadas6.2/run/scripts$ chmod +x modis_geocheck.py

and result:

Running validation test on geolocation file...
modis_geocheck.py A2009148164500.GEO 95 --verbose
Percentage of pixels with missing geolocation: 0.000000
Validation test passed for geolocation file A2009148164500.GEO
MODIS geolocation processing complete.

exit_status=            0

Thanks for letting me talk it through...

Dirk
- By gwyn Date 2011-10-19 12:51
Dirk,

It looks like processing went fine, but returned an error since geo file checker couldn't run:
/home/dirk/seadas6.2/run/scripts/modis_geocheck.py: Permission denied.

Please do the following, then try again:
chmod +x /home/dirk/seadas6.2/run/scripts/*.py
- By gwyn Date 2011-10-19 12:51
Oops, we crossed responses!  Glad it's working out.
Up Topic SeaDAS / SeaDAS 6.x - General Questions / modis_GEO.csh modis_atteph.py fail (locked)



Responsible NASA Official: Gene C. Feldman
Curator: OceanColor Webmaster
Authorized by: Gene C. Feldman
Updated: 03 July 2013
Privacy Policy and Important Notices NASA logo