add job for good cause eviction data #172
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
austensen
changed the title
kiwansim
approved these changes
Jan 21, 2025
| @@ -73,6 +73,9 @@ RUN ln -s /who-owns-what/ocaevictions /usr/local/lib/python3.10/site-packages/oc | |||
| RUN ln -s /who-owns-what/signature /usr/local/lib/python3.10/site-packages/signature && \ | |||
| pip install boto3==1.28.44 | |||
|
|
|||
| # And again for good cause eviction... | |||
| RUN ln -s /who-owns-what/goodcause /usr/local/lib/python3.10/site-packages/goodcause | |||
|
|
|||
There was a problem hiding this comment.
does this need pip install boto3==1.28.44 ?
There was a problem hiding this comment.
no, that was only needed to get the csv files from S3 (shared from UNHP), but this GCE job doesn't actually take in any data - just runs SQL on existing tables. Thanks for checking!
austensen
added a commit
to JustFixNYC/who-owns-what
that referenced
this pull request
Jan 22, 2025
Adds a new module like portfoliograph, ocaevictions, etc. which creates two new tables entirely from SQL queries. gce_screener - a bbl-level table with all of the fields we need for the gce screener website to inform helper text for user survey and other building data that is combined to determine eligibility and populate guides for next steps to determine portfolio size. gce_eligibility - a bbl-level table using all of the same dat as above, but designed to use only public data (no user responses) to give our best guess for GCE eligibility to use for data requests and also powers the map of likely-GCE-covered properties that the housing data coalition is working on. We use this new module for a new jobs on nycdb-k8s-loader: JustFixNYC/nycdb-k8s-loader#172 This also adds a new API endpoint for GET requests for a bbl that returns the entire row from the gce_screener table that is used on https://github.com/JustFixNYC/gce-screener
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Sets up a new job for creating our two GCE tables. These are created just via SQL query - no CSV downloading or other complications.
We sohuld stick with daily updates since it's a relatively fast job and we'll want to keep as up-to-date as possible with wow portfolios, CofOs, etc.
Companion PR on who-owns-what: JustFixNYC/who-owns-what#971
[sc-15606]