Skip to content

Commit

Permalink
Fix load_api_data french csv & add load_file json example without sch…
Browse files Browse the repository at this point in the history
…ema/struct inference (#172)
  • Loading branch information
AntoineGiraud authored Oct 18, 2024
1 parent ee7ac34 commit 996b860
Show file tree
Hide file tree
Showing 2 changed files with 15 additions and 2 deletions.
4 changes: 2 additions & 2 deletions bigfunctions/load_api_data.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -143,7 +143,7 @@ examples:
'''
dataset_name: "my_stream"
format: "csv"
url: https://raw.githubusercontent.com/AntoineGiraud/dbt_hypermarche/refs/heads/main/input/achats.csv
url: https://raw.githubusercontent.com/MobilityData/gbfs/refs/heads/master/systems.csv
provider:
storage: "HTTPS"
'''
Expand All @@ -165,7 +165,7 @@ examples:
'''
dataset_name: "my_stream"
format: "csv"
url: https://raw.githubusercontent.com/AntoineGiraud/dbt_hypermarche/refs/heads/main/input/achats.csv
url: https://raw.githubusercontent.com/MobilityData/gbfs/refs/heads/master/systems.csv
provider:
storage: "HTTPS"
'''
Expand Down
13 changes: 13 additions & 0 deletions bigfunctions/load_file.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -61,6 +61,19 @@ examples:
+--------+
+ ok +
+--------+
- description: |
load json as string without records/struct inference (from DuckDB & BigQuery) - (cf. [issue #171](https://github.com/unytics/bigfunctions/issues/171#issuecomment-2419346439))
arguments:
- "\n 'https://geo.api.gouv.fr/departements?fields=nom,code,codeRegion,region'"
- "\n 'json'"
- "'your_project.your_dataset.dim_french_departements'"
- '{"records":false, "columns":{"json":"string"}}\n'
output: |
+--------+
+ status +
+--------+
+ ok +
+--------+
- description: "load parquet on Google Cloud Storage"
arguments:
- "\n 'gs://bike-sharing-history/toulouse/jcdecaux/2024/Feb.parquet'"
Expand Down

0 comments on commit 996b860

Please sign in to comment.