-
Notifications
You must be signed in to change notification settings - Fork 7
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Cloud computing tutorial #21
Conversation
I will look into the clean notebooks failure. |
@scottyhq I'm having trouble getting cells not to run in this tutorial. There are 2 notebooks with code cells:
Let me know what you think and thanks in advance for your help. |
The way we've approached this in the past is adding it's path unnder Lines 37 to 39 in db547fe
Looks like you can use a |
I noticed the exclude pattern, but also that this line is commented out: https://github.com/ICESAT-2HackWeek/website-2024/blob/main/.github/workflows/ensure_clean_notebooks.py#L33 so I wasn't sure if I should use it. I'll try it with that line un-commented. |
0bb8cfc
to
233c9c8
Compare
I'm not sure why this link isn't working in your third notebook. Maybe it is sensitive to Caps or maybe it only works to do this within the same notebook... Feel free to try and fix or just link to the notebook without the section
|
@scottyhq |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Fantastic tutorial @abarciauskas-bgse thank you !'m on a plane back to seattle with limited wifi and the lonboard plot still worked well :)
"metadata": {}, | ||
"outputs": [], | ||
"source": [ | ||
"dataset = pq.ParquetDataset(\"atl08_parquet\", partitioning=\"hive\", filters=[('year', '>=', 2021),\n", |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
optional: could add some notes on what partitioning="hive"
is
"df['geometry'] = df['geometry'].apply(wkb.loads)\n", | ||
"\n", | ||
"\n", | ||
"gdf = gpd.GeoDataFrame(df, geometry='geometry')\n", |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
"gdf = gpd.GeoDataFrame(df, geometry='geometry')\n", | |
"gdf = gpd.GeoDataFrame(df, geometry='geometry', crs='EPSG:4326')\n", |
(to avoid UserWarning: No CRS exists on data. from lonboard)
"h_canopy = gdf_filtered['h_canopy']\n", | ||
"h_canopy_normalized = (h_canopy - min_bound) / (max_bound - min_bound)\n", | ||
"\n", | ||
"layer = ScatterplotLayer.from_geopandas(gdf_filtered, radius_min_pixels=0.5)\n", |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
optional: note on how radius_min_pixels works (I noticed that zooming in on the map points get very small)
Thanks @scottyhq so much for your review ❤️ I have addressed your comments and made a few more minor changes (added 4 introductory sentences to the 00 notebook, modified one image and added one image to the 03 notebook), but given these are minor changes I am going to merge. I am hoping to create a bonus notebook with more cloud computing resources 🤞🏽 if I have time. |
ref: uwhackweek/schedule-2024#35