spark-sql-prometheus-exporter

Run a spark-sql query and export results to Prometheus Pushgateway.

Usage:

spark-submit \
  --class co.movio.sparksqlprometheusexporter.Main
  spark-sql-prometheus-exporter.jar \
  --pushgateway https://url-to-pushgateway/ \
  --job member_dataset_exporter \
  --metric 'member_count=SELECT COUNT(*) AS value FROM parquet.`hdfs:///etl/members`' \
  --metric 'members_by_country=SELECT country, COUNT(*) AS value FROM parquet.`hdfs:///etl/members` GROUP BY country'