Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error during Harmony request that includes concatenate=true #12

Closed
wveit opened this issue Dec 15, 2021 · 3 comments
Closed

Error during Harmony request that includes concatenate=true #12

wveit opened this issue Dec 15, 2021 · 3 comments
Labels
bug Something isn't working

Comments

@wveit
Copy link

wveit commented Dec 15, 2021

Making a subset request through harmony with this request causes an error:
https://harmony.uat.earthdata.nasa.gov/C1234724471-POCLOUD/ogc-api-coverages/1.0.0/collections/all/coverage/rangeset?forceAsync=true&maxResults=1000000&turbo=true&subset=lat(-90%3A90)&subset=lon(-180%3A180)&subset=time(%222021-09-17T00%3A00%3A00.000Z%22%3A%222021-09-17T23%3A59%3A59.999Z%22)&granuleId=G1241749081-POCLOUD&granuleId=G1241749162-POCLOUD&granuleId=G1241749174-POCLOUD&concatenate=true

Here is the Harmony response:
{
"username": "wveit",
"status": "failed",
"message": "WorkItem [5723] failed with error: ghcr.io/podaac/concise:0.2.0-rc.2: Unexpected token p in JSON at position 1",
"progress": 0,
"createdAt": "2021-12-15T21:05:12.955Z",
"updatedAt": "2021-12-15T21:05:35.422Z",
"links": [
{
"href": "https://harmony.uat.earthdata.nasa.gov/jobs/3201a7ab-eee5-421b-b886-75ed09e407be?page=1&limit=2000",
"title": "The current page",
"type": "application/json",
"rel": "self"
}
],
"request": "https://harmony.uat.earthdata.nasa.gov/C1234724471-POCLOUD/ogc-api-coverages/1.0.0/collections/all/coverage/rangeset?forceAsync=true&maxResults=1000000&turbo=true&subset=lat(-90%3A90)&subset=lon(-180%3A180)&subset=time(%222021-09-17T00%3A00%3A00.000Z%22%3A%222021-09-17T23%3A59%3A59.999Z%22)&granuleId=G1241749081-POCLOUD&granuleId=G1241749162-POCLOUD&granuleId=G1241749174-POCLOUD&concatenate=true",
"numInputGranules": 3,
"jobID": "3201a7ab-eee5-421b-b886-75ed09e407be"
}

The job succeeds if it is submitted without concatenate=true.

The job also succeeds if I request the same way but using a different collection and associated granules. (C1234208438-POCLOUD: JASON-1_L2_OST_GPS_E)

Filing this issue in concise repo since it seems that the job is failing at concise, although it is possible that harmony/cmr is providing concise with the wrong inputs.

@wveit wveit added the bug Something isn't working label Dec 15, 2021
@frankinspace
Copy link
Member

I noticed this as well but just re-submitting the exact same request then succeeded. I've asked the harmony folks to return the proper error message to us instead of this JSON parsing error

@wveit
Copy link
Author

wveit commented Jan 7, 2022

Looks like the harmony folks made the change so we can get a better error message.

The above request still fails, but now gives a new error message:

"message":"WorkItem [6284] failed with error: ghcr.io/podaac/concise:0.2.0-rc.2: Variable schemas are inconsistent between granules",

Edited: It looks like for the three raw granules for this request, two of them have the variables quality_level_4um, sea_surface_temperature_4um, sses_bias_4um, sses_standard_deviation_4um. The third granule does not have these variables. So it makes sense that concise would complain about a variable shema inconsistency.

Here's the output from the subsetter for two of the granules:

granule-comparison

@frankinspace
Copy link
Member

Fixed in #24

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants