Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature request for the 6 version: add YAML format support #614

Open
aborruso opened this issue Aug 2, 2021 · 8 comments
Open

Feature request for the 6 version: add YAML format support #614

aborruso opened this issue Aug 2, 2021 · 8 comments

Comments

@aborruso
Copy link
Contributor

aborruso commented Aug 2, 2021

Hi @johnkerl ,
YAML is now a very popular file format. Miller already support JSON and I think that in GO there are a lot of YAML libraries.

It would be very convenient to be able to use a yaml file, as today it is already possible with a json file (I mean with the same limitations).

Thank you

@johnkerl
Copy link
Owner

johnkerl commented Aug 2, 2021

@aborruso thanks!

Support for a subset of YAML, is doable. Full YAML I don't want to deal with -- including possible cyclic references.

@JensRoland
Copy link

I think a subset of YAML is really all that is needed, since complex/ridiculous self-referential YAMLs are likely not tabular in nature anyway, and I suspect almost all Miller users are using it to wrangle tabular-like data.

@johnkerl
Copy link
Owner

@aborruso @JensRoland thanks for the bar-lowering reassurances!! ;)

Does either of you have some examples of some YAML data you'd like to be able to process using Miller?

@aborruso
Copy link
Contributor Author

Does either of you have some examples of some YAML data you'd like to be able to process using Miller?

The first one is this https://github.com/johnkerl/miller/blob/main/docs/mkdocs.yml :)

@aborruso
Copy link
Contributor Author

Does either of you have some examples of some YAML data you'd like to be able to process using Miller?

This kind https://github.com/ministero-salute/it-dgc-opendata/blob/master/datapackage.yaml

@aborruso
Copy link
Contributor Author

Does either of you have some examples of some YAML data you'd like to be able to process using Miller?

To read OpenAPI schema https://app.data.opendatacovid.gssi.it/api/opendata/schema/

@johnkerl johnkerl changed the title feature request for the 6 version: add yaml format support Feature request for the 6 version: add YAML format support Feb 22, 2022
@johnkerl johnkerl removed the wishlist label Jun 25, 2023
@laubster
Copy link

A while ago I had put Miller on my list of interesting looking tools to look into someday (nushell is on there too). As of late I'm converting a bunch of old data - college cross country results - out of tables accessed with SQL, migrating into YAML. I initially started using yq for processing of the migrated files, but found it easier to use Perl's YAML module to load it into a hash for processing.

Until I start wading into the Miller pool, I can't say I've got any example analysis I'd like to perform with Miller on the YAML in 20231028.txt , but I expect to someday come up with something. I suppose it might be nice to pluck out race results for a given runner across all files in a directory, presenting results in a table.

@martinrieder
Copy link

martinrieder commented Aug 3, 2024

Hey, I stumbled across this great idea due to wireviz/WireViz#291. It would be great if Miller could process YAML files like the ones from the examples found here:
https://github.com/wireviz/WireViz/tree/master/examples (see README.md)

Please also note the issue about choice of libraries for different versions of the YAML standard in wireviz/WireViz#223.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

5 participants