csv2influxdb


Converts a CSV file into JSON for influxdb

Usage

Pass in --help for full options

-d, --database      Influxdb database name (Required)
-i, --in            CSV filename to read in
-o, --out           JSON filename to output to 
-p, --pretty        Output pretty formatted json
-h, --help          Display this help message.

Installation

gem install csv2influxdb

or

git clone https://github.com/spuder/csv2influxdb.git
bundle install

Tested with ruby 2.0.0 on OSX, if you encounter issues with any other versions, please open a github issue

What it does

Takes a csv:

year	internet-explorer-usage	murders-per-capita
2014	67	60
2015	51	55
2016	42	45

Outputs json with influxdb table headers (name,columns,points)

{
    "name": "murders",
    "columns": [
        "year",
        "internet-explorer-usage",
        "murders-per-capita"
    ],
    "points": [
        [
            "2014",
            "67",
            "60"
        ],
        [
            "2015",
            "51",
            "55"
        ],
        [
            "2016",
            "42",
            "45"
        ]
    ]
}

Examples

#####From CSV file, to JSON file

csv2influxdb -d derp -i murders.csv -o /tmp/influxdb_murders.json

#####Use stdin -> stdout

echo '"year","internet_explorer_usage","murders_per_capita"
2004,67,60
2005,51,55
2006,42,45' | csv2influxdb -d derp
{"name":"derp","columns":["year","internet_explorer_usage","murders_per_capita"],"points":[["2004","67","60"],["2005","51","55"],["2006","42","45"]]}

Obviously the stdin/stdout option won't work well for large amounts of data

#####Pretty

csv2influxdb -p -d derp -i foo.csv -o /tmp/bar.json

Avoid using -p unnecessarily since it wastes network bandwidth

Migrating Data

• Export data from your relational database to csv.
• Use csv2influxdbto convert to json
• Use a tool like influxdb-backup to import push to influxdb

Why

There are plently of online csv to json converters, why not just use that one?

I tried all the online converters (this is the best one), but none of them could quite convert a csv into json that was compatible with influxdb. (no column headers, no json with multiple keys)

###Legal csv2influxdb is created by spuder, a fan of influxdb. It comes with no guarantee. It is a community project and is not supported nor afiliated with the creators of influxdb.