Support jq-like filtering and transformation

[amotl]

It would be cool to support something like the jq query and transformation language for querying and filtering data requested from the Grafana API, like outlined within grafana/simple-json-datasource#111.

[amotl]

We started collecting some ideas about this at [1] and started a discussion topic dedicated to further development of grafana-wtf [2]. Feel welcome to join us there.

[1] https://community.panodata.org/t/tools-for-processing-json/65
[2] https://community.panodata.org/t/developing-grafana-wtf/67

[markmelville]

When it comes to JSON transformations, I have been loving Jsonata. The syntax is terse and powerful although sometimes hard to remember. It is also extensible by adding custom functions.

Another option would be to use JMESPATH, which is what is used in the aws-cli to transform the responses from various commands. I am not aware of a javascript implementation.

[amotl]

Dear Mark,

thanks for bringing up JSONata in this context. I recently stumbled upon it as well [1] and liked it on a first glimpse. Thanks also for suggesting JMESPath.

Feel free to come up with a respective implementation based on whatever you might like most.

With kind regards,
Andreas.

[1] https://community.panodata.org/t/jsonata-json-query-and-transformation-language/64

[amotl]

I just discovered an interesting technique to interactively override application settings when they are originally stored in a YAML file, using yq in the application, by @afbjorklund.

limactl start --set='.cpus = 2 | .memory = "2GiB"'

-- lima-vm/lima#1359

[amotl]

Hi again. We've built upon various ideas and experiences per Zyp Transformations, not exclusively coming from needs in grafana-wtf, but it could be used here as well on a future iteration.

Another option would be to use JMESPath, which is what is used in the aws-cli to transform the responses from various commands.

@markmelville: JMESPath became a first citizen of transformation languages in Zyp, as a companion to jqlang, and that is due to your excellent hint, see those snippets located within the zyp-collection example.

rules:
- expression: records[?not_null(meta.location) && !starts_with(meta.location, 'N')]
  type: jmes

rules:
- expression: .[] |= (.data.value /= 100)
  type: jq

Thanks!

[amotl]

@markmelville: There is a Python implementation for JSONata by @rayokota. I will also consider adding this to Zyp on another iteration, when possible. 🍀

• https://github.com/rayokota/jsonata-python