Ocean Color Forum - Not logged in
Forum Ocean Color Home Help Search Login
Previous Next Up Topic Products and Algorithms / Satellite Data Access / MODISA extracts (locked) (3638 hits)
By frederic Date 2011-09-14 12:13
Dear support,

I'm regularly ordering MODISA L1A data over a European window. For the last couple of months, the number of files affected by the comments: "The following extract files couldnot be generated since sufficient data was not found for  the coordinates and|or parameters passed" have increased considerably, to ~25%.

For instance for the window 10N-80N, 40W-55E, and the day 2011162 (full 8-day order currently in ftp://ocdist3.sci.gsfc.nasa.gov/d0906000e067ec42), the following files are not staged:

A2011162013500.L1A_LAC.x.hdf
A2011162031000.L1A_LAC.x.hdf
A2011162031500.L1A_LAC.x.hdf
A2011162075500.L1A_LAC.x.hdf
A2011162110000.L1A_LAC.x.hdf
A2011162110500.L1A_LAC.x.hdf
A2011162111000.L1A_LAC.x.hdf
A2011162124000.L1A_LAC.x.hdf
A2011162124500.L1A_LAC.x.hdf
A2011162125000.L1A_LAC.x.hdf
A2011162142000.L1A_LAC.x.hdf
A2011162142500.L1A_LAC.x.hdf
A2011162155500.L1A_LAC.x.hdf

This behavior does not seem to apply to MODIST.

Could it be related to the post:
http://oceancolor.gsfc.nasa.gov/forum/oceancolor/topic_show.pl?tid=4171

Thanks for any feedback.
Best,
frederic
By @sean Date 2011-09-14 15:44
Frederic,

There was an issue with the code the identifies the pixel/line ranges for extract creation.
The code was corrected and the updated code installed in production last week. 
If you notice the problem persisting with recent data, let us know.

Regards,
Sean
By frederic Date 2011-09-15 11:53
Dear Sean,

I've tried another order for MODISA and the behavior is similar.
The order is for the 8-day period, 2011, days 177-186, over the window 10N-80N, 40W-55E (order  ftp://ocdist4.sci.gsfc.nasa.gov/301090d00170ed4e).

94 out of 369 files are not generated, and looking at the Level-2, at least some of these files seem interesting (like A2011178124500.L1A_LAC.x.hdf to name one). This exclusion rate is really higher percentage than it used to be.

Thanks for any help.
Best,
frederic
By @sean Date 2011-09-15 23:09
Frederic,
I'll confirm with our data processing guru that the fix to the code for which there was an error is indeed in place,
but I have a question for you.

Why are you asking for extracts when the ROI is significantly larger than any single granule will ever be?

MOST of the files retrieved by this search criteria are not extractable - as the entire scene is contained.
By placing an extract order such as this, you only slow down your ability to access the data, as our system
will have to stage the files and attempt an extract.  If you do not request extraction, you'll get a list of files
that you can download immediately.

Regards,
Sean
By @john Date 2011-09-16 15:43
Frederic,

The science software was not up to date on the distribution servers.  I updated that yesterday, and i resubmitted your orders.  Both are in the process of being restaged.  It's not clear to me from your post whether you were saying that the file A2011178124500.L1A_LAC.x.hdf was missing but should have been included or that it was just interesting.  I see it in the requested_files folder for the 301090d00170ed4e order now.  Hopefully you will find more files staged this time for both orders.

john
By frederic Date 2011-09-21 09:53
Dear John and Sean,

thanks a lot for re-posting these 2 orders, that have extended the previous ones.
A2011178124500.L1A_LAC was just an example of a file that was not provided whereas apparently it should have been.

Sean, for the extraction: actually we had the feeling that asking for extracted data was saving a significant amount of space, on the basis of tests performed years ago (and long lost...). This is an interesting point and probably the best thing to do is to perform a new test with and w/o extraction. I'll try that.

Thanks again for your support,
Best,
f.
Previous Next Up Topic Products and Algorithms / Satellite Data Access / MODISA extracts (locked) (3638 hits)



Responsible NASA Official: Gene C. Feldman
Curator: OceanColor Webmaster
Authorized by: Gene C. Feldman
Updated: 27 November 2007
Privacy Policy and Important Notices NASA logo