Reduce number of CMR calls to get collection granule details

[jamesfwood]

JIRA Link:

https://jira.jpl.nasa.gov/browse/PODAAC-6247

Fix this too:

https://jira.jpl.nasa.gov/browse/PODAAC-6314

Problem:
hitide is calling cmr too many times per collection (to get granule info) and cmr can't handle the load

Solution:
Related to how many years of data a collection has. Currently hitide makes a new request for each year, it should do one request for all data and parse it in the client instead.

Solution 2:
Update the request to get all data in one call and minimize the data requested (graphql)

[jamesfwood]

@jbyrne6 Make sure Hitide works in SIT also

[davidcolemanjpl]

HiTIDE-UI UAT v4.17.2-rc.10:
HiTIDE -Profile v4.11.0-4-a02b64f9f23d21815d1a76debe0d5d98a163bd65

User can Trigger errors by selecting icon for MERGED_TP_J1_OSTM_OST_CYCLES_V52, and then selecting info icon for other collections in UAT UI:

[jamesfwood]

@davidcolemanjpl please test again in HiTIDE UAT. Hopefully it is fixed now.
Thanks!

[davidcolemanjpl]

HiTIDE-UI UAT v4.17.2-rc.10
HiTIDE -Profile v4.10.1-rc.16
Chrome browser v127.0.6533.100 (Official Build) (arm64)

500 (Internal Server Error) and 400 (Bad Request) errors are still displaying in UI console:

note:
User can Trigger 400/500 errors by selecting icon for MERGED_TP_J1_OSTM_OST_CYCLES_V52, and then selecting the info icon for other collections in the UAT UI

[jbyrne6]

Conversation related to adding cmr feature to specify temporal facets for granules

Jimmy Byrne
Aug 2nd at 2:16 PM
Hi, I was wondering how I can specify temporal facets for granules in a graphql cmr query? I see that I can include facets for collections but am not seeing it for granules. I am trying to convert this cmr call to graphql
https://cmr.earthdata.nasa.gov:443/search/granules.json?include_facets=v2&page_size=0&collection_concept_id=C2075141524-POCLOUD&temporal[]=2007-03-27T00:00:00Z,2021-12-01T23:59:59Z&temporal_facet[0][year]=2007
Thanks for your help! (edited)
4 replies

Aug 6th at 9:18 AM
It does not look like we currently support facets on the granule search for the temporal piece we can pass something like this as a POST request body to the https://graphql.earthdata.nasa.gov/api endpoint I’ll investigate at why that is and come back; since it is supported by CMR (edited)

Eudoro Olivares Raniolo
| Example without facets

query ($params: GranulesInput) {
granules(params: $params) {
items {
conceptId
}
Click to expand inline (15 lines)

Jimmy Byrne
Aug 6th at 9:40 AM
Ok got it, thank you for your help! Having this in graphql would help speed up our loading time significantly for HiTIDE UI.

Jimmy Byrne
Aug 8th at 10:47 AM
@eudoro.a.olivaresraniolo
, I was wondering if you know how long it would take to support facets on granule search? I am not currently able to get the month counts work correctly when I do a single rest cmr call with all the applicable years. The initial issue was that it was doing one call per year that the collection was active and I wanted to reduce it to one call to get the granule counts per year, month, and day. Thank you for your help! (edited)

Jimmy Byrne
Aug 29th at 3:04 PM
Hi
@eudoro.a.olivaresraniolo
, I would like to just re-up my question and see if there is a graphql update in the works anytime soon relating to adding facets on granule search?

[jbyrne6]

I sent a direct message to Eudoro today (9/23/24) to remind him of the question so am waiting for that response.