You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
2. Optionally (required for the [European Gas Inventory][GIEAPI-url] dataset) copy a `.env` file containing the <a href="#api-key">API key</a> as explained below:
156
+
-->
157
+
1. Create a container from the published docker image:
2. Optionally (required for the [European Gas Inventory][GIEAPI-url] dataset; this can safely be done at a later stage) copy a `.env` file containing the <a href="#api-key">API key</a> as explained below:
157
162
```docker
158
163
docker cp .env mimodast:/project/mimodast/.env
159
164
```
160
-
2. Start the container.
165
+
2. Start the container (using the Docker Desktop UI or command line).
161
166
2. For starters:
162
-
- Open the docker container terminal and peruse the meltano.yml file and other files/folders at `project\mimodast\`.
167
+
- Open the docker container terminal and peruse the meltano.yml file and other files/folders at `/project/mimodast/`.
163
168
- Navigate to localhost:8085 to see the Airflow orhestrator (incl scheduler) interface. Use admin/admin as username/password.
164
169
- Navigate to localhost:8093 to see the Superset dashboard. Use admin/admin as username/password.
170
+
- Navigate to localhost:8094 to see data pipeline documentation (from dbt).
165
171
- NOTE: allow for some time (~1 minute) for the container to start up all processes. On first startup wait for the completion of the first run of the USGS pipeline before reviewing Superset.
166
172
167
173
@@ -174,7 +180,7 @@ The image contains ELT pipelines for two data sets. The [USGS Earthquake][USGSEa
174
180
175
181
For the [GIE Gas Inventory][GIEAPI-url] dataset an API key is required. Create a free and immediate [GIE account][GIEAccount-url] to obtain the key.
176
182
177
-
This key needs to be available as an environment variable (ENV_GIE_XKEY) in the Docker container (it is referenced in the `meltano.yml` configuration file). One way to accomplish this is by creating a `.env` file in the `/projet/mimodast/` folder containing:
183
+
This key needs to be available as an environment variable (ENV_GIE_XKEY) in the Docker container (it is referenced in the `meltano.yml` configuration file) in order to run the GIE pipelines. One way to accomplish this is by creating a `.env` file in the `/projet/mimodast/` folder containing:
178
184
>`ENV_GIE_XKEY="YOUR-API-KEY"`
179
185
180
186
<p align="right">(<a href="#readme-top">back to top</a>)</p>
@@ -395,15 +401,13 @@ The following differences are noteworthy:
395
401
<!-- ROADMAP -->
396
402
## Roadmap
397
403
404
+
<!--
398
405
- [ ] Include [Great Expectations][GreatExpectations-url] for data quality purposes.
399
406
- [ ] Add a dbt model using [PRQL][PRQL-url] language instead of SQL.
400
407
- [ ] Add a metadata framework like Amundsen, OpenLineage or similar.
401
-
402
-
<!--
403
408
- [ ] Feature 3
404
409
- [ ] Nested Feature
405
410
-->
406
-
407
411
See the [open issues](https://github.com/EJOOSTEROP/mimodast/issues) for a full list of proposed features and known issues.
408
412
409
413
<p align="right">(<a href="#readme-top">back to top</a>)</p>
0 commit comments