Skip to content

Commit

Permalink
new dag for 2022 agency scrape
Browse files Browse the repository at this point in the history
  • Loading branch information
charlie-costanzo committed Dec 18, 2024
1 parent d3f0914 commit 43928ce
Showing 1 changed file with 7 additions and 0 deletions.
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
operator: operators.NtdDataProductXLSXOperator

product: 'annual_database_agency_information'
xlsx_file_url: 'https://www.transit.dot.gov/ntd/data-product/2022-annual-database-agency-information' # placeholder for scraped url from scrape_ntd_xlsx_urls task
year: '2022' # one of: 'historical' (long history), 'mutli-year' (select history), or a specific year (ex: 2022)
dependencies:
- scrape_ntd_xlsx_urls

0 comments on commit 43928ce

Please sign in to comment.