chile_compra_api_records/chile_compra_api_releases return 502

[jpmckinney]

e.g. https://open-contracting-partnership.sentry.io/issues/2631582176/?project=5287294&query=is%3Aunresolved&referrer=issue-stream&statsPeriod=14d&stream_index=1

Not sure what proportion of requests time out.

[yolile]

Frozen in the registry

[jpmckinney]

In the above issue, can filter out the Chile events with !title:"Gave up retrying <GET http://api.mercadopublico.cl/APISOCDS/OCDS/listaOCDSAgnoMes*"

TCPTimedOutError
TCP connection timed out: 110: Connection timed out.

https://open-contracting-partnership.sentry.io/issues/4834711386/

Can filter out the Chile events in Sentry with !message:"Error downloading <GET http://api.mercadopublico.cl/APISOCDS/OCDS/listaOCDSAgnoMes*"

The URLs also fail for me locally, e.g. http://api.mercadopublico.cl/APISOCDS/OCDS/listaOCDSAgnoMesConvenio/2022/07/0/10

[yolile]

The requests are now working but they are returning 502 when requesting them from scrapy (either locally or from the server). They work via the browser or with curl (locally and on the server).

[jpmckinney]

Where are the docs? The Swagger URL in the spider is 404: https://desarrolladores.mercadopublico.cl/docs/services/5a9ed02f718ed712f4403e75/operations/data-listaa-omes-agno-mes

desarrolladores.mercadopublico.cl doesn't respond.

api.mercadopublico.cl has no OCDS docs that I can find.

[yolile]

The new API documentation is available at https://datos-abiertos.chilecompra.cl/descargas/procesos-ocds

[jpmckinney]

Do they still respond with e.g. {"status": 500, "detail": "error"} according to the docs? status used to be in every response, but it's no longer there.

[jpmckinney]

Fixed in 0a88662 (had to use https not http). I deleted parse_list_loader, since status isn't set (at least not for successful responses – no idea what happens with error responses).

[yolile]

Do they still respond with e.g. {"status": 500, "detail": "error"} according to the docs?

Hard to test and the spider is not working, but at least for 502 they respond with the actual 502 error

[jpmckinney]

Deployed

Edit: And unfrozen

[yolile]

Fixed in 0a88662 (had to use https not HTTP)

Cool, thanks, I only tried setting the browser user agent and similar (without success)

[jpmckinney]

Job automatically started, so we'll see what errors occur, if any.