modis_GEO.csh modis_atteph.py fail

Ocean Color Forum - Not logged in

Forum Ocean Color Home Help Search Login

Topic SeaDAS / SeaDAS 6.x - General Questions / modis_GEO.csh modis_atteph.py fail (locked) (2865 hits)

By daurin Date 2011-10-18 18:24

Hello,

I have a new installation of Seadas 6.2b on a RHEL 6.1 with IDL 8.1. Out of the gate, I am encountering the following error when trying to generate the geolocation file for Aqua L1A_LAC:

dirk@oceanbio3:~/Imagery/amazon$ seadas
IDL Version 8.1 (linux x86_64 m64). (c) 2011, ITT Visual Information Solutions
Installation number: 12936.
Licensed for use by: Globe

SeaDAS Version 6.2 Update 2b (pid = 8850)
SeaDAS>
unix cmd =
$SEADAS/run/scripts/modis_GEO.csh /home/dirk/Imagery/amazon/modisa/L1A/A2009148164500.L1A_LAC -o /home/dirk/Imagery/amazon/modisa/L1A/A2009148164500.GEO -verbose-http -geocheck_threshold 95
Determining required attitude and ephemeris files...
modis_atteph.py /home/dirk/Imagery/amazon/modisa/L1A/A2009148164500.L1A_LAC --verbose
Determining pass start and end times..

Start Time: 2009148164500
Stop Time: 2009148164959
Mission: A

Downloading 'PM1ATTNR.P2009148.1600.003'
Traceback (most recent call last):
File "/home/dirk/seadas6.2/run/scripts/modis_atteph.py", line 57, in <module>
m.locate()
File "/home/dirk/seadas6.2/run/scripts/modules/modis_atteph_utils.py", line 191, in locate
status = ProcUtils.httpdl(''.join([self.data_site, "/cgi/getfile/", FILE]), os.path.join(attephpath, FILE))
File "/home/dirk/seadas6.2/run/scripts/modules/ProcUtils.py", line 37, in httpdl
f = open(file, 'wb')
IOError: [Errno 13] Permission denied: 'PM1ATTNR.P2009148.1600.003'
** Failed to determine/retrieve attitude and ephemeris files **
No attitude and ephemeris information available for this Aqua granule.
Processing cannot proceed; exiting.

exit_status= 1
SeaDAS>

Based on an earlier post (http://oceancolor.gsfc.nasa.gov/forum/oceancolor/topic_show.pl?pid=17450;hl=#pid17450), I replaced the modis_atteph_utils.py, ProcUtils.py, and modis_geocheck.py files with the ones attached to that post. Incidentally, the only files in /ancillary are:

dirk@oceanbio3:~/seadas6.2/benchmarks/ancillary$ l
total 36316
drwxr-xr-x. 2 dirk dirk    4096 Nov 30 2010 .
drwxr-xr-x. 3 dirk dirk    4096 Nov 30 2010 ..
-rw-r--r--. 1 dirk dirk   173419 Nov 17 2010 MYD02_Emissive_LUTs.V6.1.5.0g.hdf
-rw-r--r--. 1 dirk dirk 47022 Nov 17 2010 MYD02_QA_LUTs.V6.1.5.0g.hdf
-rw-r--r--. 1 dirk dirk 3146655 Nov 17 2010 MYD02_Reflective_LUTs.V6.1.5.0g.hdf
-rw-r--r--. 1 dirk dirk 15559592 Nov 17 2010 N200616700_NO2_OMI_24h.hdf
-rw-r--r--. 1 dirk dirk   201150 Nov 17 2010 N200616700_O3_TOMSOMI_24h.hdf
-rw-r--r--. 1 dirk dirk   245328 Nov 17 2010 N200616700_SEAICE_NSIDC_24h.hdf
-rw-r--r--. 1 dirk dirk 1641767 Nov 17 2010 N200616718_MET_NCEPN_6h.hdf
-rw-r--r--. 1 dirk dirk 8305488 Nov 17 2010 N2006167_SST_OIV2AVAM_24h.nc
-rw-r--r--. 1 dirk dirk 1641767 Nov 17 2010 N200616800_MET_NCEPN_6h.hdf
-rw-r--r--. 1 dirk dirk   201150 Nov 17 2010 N200616800_O3_TOMSOMI_24h.hdf
-rw-r--r--. 1 dirk dirk   462848 Nov 17 2010 PM1ATTNR.P2006167.1800.002
-rw-r--r--. 1 dirk dirk 5531104 Nov 17 2010 PM1EPHND.P2006167.1200.001
dirk@oceanbio3:~/seadas6.2/benchmarks/ancillary$

...and the permissions on that directory are:
drwxr-xr-x. 2 dirk dirk 4096 Nov 30 2010 ancillary

Thanks,
Dirk

By gwyn Date 2011-10-19 14:16

Dirk,

That's a puzzler; you're doing everything right as far as I can tell. Do you get the same error when you call modis_atteph.py directly from the unix command line?

modis_atteph.py /home/dirk/Imagery/amazon/modisa/L1A/A2009148164500.L1A_LAC --verbose

Do you have write permission in the working directory, and were any files written there?

How is $MODIS_ATTEPH defined, and do you have write permission there?

By daurin Date 2011-10-19 15:47

Gwyn,

It gets weirder. That python script appears to work fine:

dirk@oceanbio3:~/rs_scripts$ modis_atteph.py /home/dirk/Imagery/amazon/modisa/L1A/A2009148164500.L1A_LAC --verbose
Determining pass start and end times..

Start Time: 2009148164500
Stop Time: 2009148164959
Mission: A

All required definitive attitude and ephemeris files successfully determined and downloaded.
att_file1=/home/dirk/seadas6.2/run/var/modis/atteph/2009/148/PM1ATTNR.P2009148.1600.003
eph_file1=/home/dirk/seadas6.2/run/var/modis/atteph/2009/148/PM1EPHND.P2009148.1200.003

However, calling it with modis_GEO.csh does not work; although today it is giving me a new and different error than what I posted yesterday:

dirk@oceanbio3:~/rs_scripts$ ./test1.sh
<<<<<<<<<<<<<<<<<<<<<<<<<<***********~~~~~~~~~~~~~~~~~~~~~~~~~~~************>>>>>>>>>>>>>>>>>>>>>>>
Begin processing. Filebasename:
A2009148164500
Determining required attitude and ephemeris files...
modis_atteph.py /home/dirk/Imagery/amazon/modisa/L1A/A2009148164500.L1A_LAC
Input Level 1A   : /home/dirk/Imagery/amazon/modisa/L1A/A2009148164500.L1A_LAC
Output Geolocation: /home/dirk/Imagery/amazon/modisa/L1A/A2009148164500.GEO

Satellite: aqua
Year: 2009 Day: 148 Hour: 16 Minute: 45
*Terrain Correction Enabled*

Creating MODIS geolocation file...
/home/dirk/seadas6.2/run/bin/geogen_modis
GEO version: 5.0.14 built on Apr 8 2011 (09:22:14)
scan: 0 out of 203 Wed Oct 19 11:42:04 2011
scan: 10 out of 203 Wed Oct 19 11:42:06 2011
scan: 20 out of 203 Wed Oct 19 11:42:07 2011
scan: 30 out of 203 Wed Oct 19 11:42:08 2011
scan: 40 out of 203 Wed Oct 19 11:42:10 2011
scan: 50 out of 203 Wed Oct 19 11:42:11 2011
scan: 60 out of 203 Wed Oct 19 11:42:12 2011
scan: 70 out of 203 Wed Oct 19 11:42:13 2011
scan: 80 out of 203 Wed Oct 19 11:42:14 2011
scan: 90 out of 203 Wed Oct 19 11:42:15 2011
scan: 100 out of 203 Wed Oct 19 11:42:16 2011
scan: 110 out of 203 Wed Oct 19 11:42:17 2011
scan: 120 out of 203 Wed Oct 19 11:42:18 2011
scan: 130 out of 203 Wed Oct 19 11:42:19 2011
scan: 140 out of 203 Wed Oct 19 11:42:20 2011
scan: 150 out of 203 Wed Oct 19 11:42:21 2011
scan: 160 out of 203 Wed Oct 19 11:42:22 2011
scan: 170 out of 203 Wed Oct 19 11:42:24 2011
scan: 180 out of 203 Wed Oct 19 11:42:25 2011
scan: 190 out of 203 Wed Oct 19 11:42:26 2011
scan: 200 out of 203 Wed Oct 19 11:42:27 2011
geogen_modis exit status: 0

Running validation test on geolocation file...
modis_geocheck.py A2009148164500.GEO 95 --verbose
/home/dirk/seadas6.2/run/scripts/modis_geocheck.py: Permission denied.

modis_GEO.csh: ERROR: MODIS geolocation processing failed.
Please ensure utcpole.dat and leapsec.dat are up-to-date in
/home/dirk/seadas6.2/run/var/modis
Please examine the LogStatus and LogUser files for more information.

I am attaching the test1.sh script. I get the exact same response from the Seadas gui. Here are the permissions on the L1A directory:

dirk@oceanbio3:~/Imagery/amazon/modisa$ l
total 40
drwxrwxrwx. 5 dirk dirk 4096 Oct 19 08:30 .
drwxrwxrwx. 4 dirk dirk 4096 Oct 19 09:44 ..
-rw--w-rw-. 1 dirk dirk 97 Oct 17 09:22 .directory
drwxrwxrwx. 3 dirk dirk 12288 Oct 19 11:34 L1A
drwxrwxrwx. 2 dirk dirk 4096 Oct 19 06:30 L1B
drwxrwxrwx. 2 dirk dirk 12288 Oct 19 09:57 L2

Here are the files produced in the L1A directory:

-rw-rw-r--. 1 dirk dirk 60672614 Oct 19 11:42 A2009148164500.GEO
-rw-rw-r--. 1 dirk dirk    12532 Oct 19 11:42 A2009148164500.GEO.met
-rw-rw-r--. 1 dirk dirk    21684 Oct 19 11:42 A2009148164500.GEO.pcf
-rw-rw-rw-. 1 dirk dirk 571515376 Oct 19 11:42 A2009148164500.L1A_LAC
-rw-rw-r--. 1 dirk dirk 8458 Oct 19 11:42 A2009148164500.L1A_LAC.met
...and:
-rw-rw-r--. 1 dirk dirk 1482 Oct 19 11:42 GetAttr.temp
-rw-rw-r--. 1 dirk dirk 1888 Oct 19 11:42 LogReport.A2009148164500.GEO
-rw-rw-r--. 1 dirk dirk 5190 Oct 19 11:42 LogStatus.A2009148164500.GEO
-rw-rw-r--. 1 dirk dirk 1892 Oct 19 11:42 LogUser.A2009148164500.GEO
-rw-rw-r--. 1 dirk dirk    201 Oct 19 11:42 ShmMem

I'm attaching the logs.

Attachment: test1.sh (1.6k)

Attachment: LogStatus.A2009148164500.GEO (5.1k)

Attachment: LogUser.A2009148164500.GEO (1.8k)

By daurin Date 2011-10-19 15:57

Ah, I see the problem:

-rw-rw-r--. 1 dirk dirk 1328 Oct 18 14:08 modis_geocheck.py

solution:

dirk@oceanbio3:~/seadas6.2/run/scripts$ chmod +x modis_geocheck.py

and result:

Running validation test on geolocation file...
modis_geocheck.py A2009148164500.GEO 95 --verbose
Percentage of pixels with missing geolocation: 0.000000
Validation test passed for geolocation file A2009148164500.GEO
MODIS geolocation processing complete.

exit_status= 0

Thanks for letting me talk it through...

Dirk

By gwyn Date 2011-10-19 16:51

Dirk,

It looks like processing went fine, but returned an error since geo file checker couldn't run:
/home/dirk/seadas6.2/run/scripts/modis_geocheck.py: Permission denied.

Please do the following, then try again:
chmod +x /home/dirk/seadas6.2/run/scripts/*.py

By gwyn Date 2011-10-19 16:51

Oops, we crossed responses! Glad it's working out.

Topic SeaDAS / SeaDAS 6.x - General Questions / modis_GEO.csh modis_atteph.py fail (locked) (2865 hits)