When I try to run query from plugin, it gives me "Metric request error"

[Tugduall]

Here is the configuration of the request and the result

Is it necessary to use a specific identation for the csv? or what's wrong?

Thank you in advance

[vabatox]

I get the same error. I successfully connect to bucket. copy in the key for the csv file I want to query.

{
"request": {
"url": "api/ds/query",
"method": "POST",
"data": {
"queries": [
{
"compression": "NONE",
"csv_allow_quoted_record_delimiter": false,
"csv_comments": "#",
"csv_field_delimiter": ",",
"csv_file_header_info": "USE",
"csv_quote_character": """,
"csv_quote_escape_character": """,
"csv_record_delimiter": "\n",
"format": "CSV",
"json_time_bucket": 1000000,
"json_time_field": "",
"json_time_field_enable": false,
"json_time_month_first": false,
"json_type": "DOCUMENT",
"path": "data_uploads/prh_global_uk_sandbox/br_misc_snowflake_upload/bryan12.csv",
"query": "SELECT * FROM s3object",
"refId": "A",
"datasource": "AWS S3",
"datasourceId": 1,
"intervalMs": 30000,
"maxDataPoints": 598,
"orgId": 1
}
],
"range": {
"from": "2020-12-10T09:35:30.517Z",
"to": "2020-12-10T15:35:30.517Z",
"raw": {
"from": "now-6h",
"to": "now"
}
},
"from": "1607592930517",
"to": "1607614530517"
},
"hideFromInspector": false
},
"response": {
"error": "rpc error: code = Unavailable desc = transport is closing",
"message": "Metric request error"
}
}

[burningalchemist]

@vabatox @Tugduall Hi guys, if you're still interested, I've figured out what was the issue and happy to share. :)

[vabatox]

@vabatox @Tugduall Hi guys, if you're still interested, I've figured out what was the issue and happy to share. :)

Yes please, just started looking at this again

[Tugduall]

@vabatox @Tugduall Hi guys, if you're still interested, I've figured out what was the issue and happy to share. :)

Yes please, I avoided the problem for now but I would like to use this pulign

[burningalchemist]

@vabatox @Tugduall The issue comes from the error handling line (here). If you either remove/comment it out or wrap it properly, this should do the trick at least for processing CSVs.👍 I need to check if it works for the rest of the formats.

Screenshot:

I've also updated dependencies to include arm64 builds and added the profile field in the configuration for shared credentials file (~/.aws/credentials) for multi-account configurations. I'm going to push the release archive soon if you can't or don't want to build it locally. Hope this helps.😃

[vabatox]

Thanks @burningalchemist. Made the changes to s3-select.go & restarted docker container. Still getting same error though.

[burningalchemist]

@vabatox Oh no. 😢 Did you rebuild the whole thing? Could you also share your Dockerfile?
I'm happy to help, not sure if we can proceed here. Feel free to contact me via burning.alchemist@gmail.com 😃

[burningalchemist]

@vabatox Try the zip out - https://github.com/burningalchemist/grafana-s3-plugin/releases/tag/v1.0.1

[vabatox]

@vabatox Try the zip out - https://github.com/burningalchemist/grafana-s3-plugin/releases/tag/v1.0.1

Thanks I've got it working. Great stuff @burningalchemist 😄

[burningalchemist]

@vabatox Great! I'm happy it works for you! 👍

[starkblaze01]

Thanks for reporting the issue and also the fixes :)