CoP: Data Science: Create Data Ops Tutorial

[akhaleghi]

Overview

We need to have a Data Ops Tutorial page that will answer any q

Action Items

• Create a Google Doc in the folder provided under resources
• Draft an introductory paragraph explaining what the tutorial resources cover and why a new data scientist would use them for working with data at Hack For LA
• Identify resources with vetted tutorials covering important skills within the tutorial area, adding to the draft
• Write Clear Learning Objectives
  • State what the learner will be able to do by the end of the tutorial (e.g., “Set up a basic DataOps workflow with GitHub and Google Sheets”).
• Write Prerequisites
  • Required skills (e.g., basic Python, Git/GitHub familiarity).
  • Required tools/accounts (e.g., GitHub, Google Drive access, Looker viewer permissions).
• Write Setup Instructions
  • Links to repos, sample datasets, or starter scripts.
  • Environment setup (e.g., clone repo, install dependencies).
• Write Step-by-Step Walkthrough
  • Guided example showing one DataOps pipeline end-to-end.
  • Screenshots or code snippets illustrating key steps.
• Write Hands-On Exercise
  • A small project/task learners can replicate (e.g., build a lightweight validation script, update a dashboard, or run a data ingestion pipeline).
• Write Common Pitfalls & Troubleshooting
  • Document frequent mistakes (e.g., schema mismatch, GitHub permissions).
  • Tips for debugging errors in automation or dashboards.
• Write Discussion / Reflection
  • Prompts for learners to connect the tutorial to civic tech use cases.
  • Questions like: “How would you adapt this pipeline for a different dataset?”
• Write Next Steps / Advanced Topics
  • Suggested follow-ups (e.g., CI/CD for ETL pipelines, adding alerting, scaling beyond Google Sheets).
• Write Glossary / Key Concepts
  • Definitions of terms like ETL, schema governance, human-in-the-loop.
• Add additional content to References & Resources
  • link to relevant Hack for LA repos or dashboards (where possible).
• Review the draft with the Data Science CoP
• Add to the wiki page

Resources/Instructions

Wiki page

Data Ops Tutorial

Location for any files you might need to upload (drafts, images, etc.)

• Folder for files related to the Data Ops tutorial
  • DS: Data Ops Tutorial Google Doc

Tools that are core that should be mentioned:

• EC2
• Lambda
• RDS
• Athena/Hive
• Flask

Examples of resources that would be useful to include:

• Web how-to/tutorial/walk-throughs
• Youtube playlists or videos demonstrating tools
• Links to blogs or platforms with subject matter experts

[SANJCA]

Kindly unsubscribe from this email thread

…

On Sat, Apr 2, 2022 at 12:48 AM Abe ***@***.***> wrote: Overview Update the Data Ops <https://github.com/hackforla/data-science/wiki/Data-Ops> page with resources and an article header. Action Items Update the Tutorial with: - An introductory paragraph explaining what the tutorial resources cover and why a new data scientist would use them for working with data at Hack For LA - A resources section listing vetted tutorials covering important skills within the tutorial area Resources/Instructions Tools that are core that should be mentioned: - EC2, - Lambda - RDS - Athena/Hive - Flask Examples of resources that would be useful to include: - Web how-to/tutorial/walk-throughs - Youtube playlists or videos demonstrating tools - Links to blogs or platforms with subject matter experts — Reply to this email directly, view it on GitHub <#154>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ALTBF2C6L2P6DRKSAIVRAVDVC5DYHANCNFSM5SJSF2UA> . You are receiving this because you are subscribed to this thread.Message ID: ***@***.***>