Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Consider new name for OONI Data #41

Closed
hellais opened this issue Nov 10, 2023 · 2 comments
Closed

Consider new name for OONI Data #41

hellais opened this issue Nov 10, 2023 · 2 comments
Labels
help wanted Extra attention is needed priority/low question Further information is requested

Comments

@hellais
Copy link
Member

hellais commented Nov 10, 2023

We would like to disambiguate the name of OONI Data by calling it something different.

High up on the list are:

  • DataKraken: for handling monstrous amounts of data!
  • Radula: Inside the squid's sharp beak is a tongue-like organ called the radula. Covered with rows of tiny teeth, it rams bite size pieces of food down the squid's throat. The pieces must be small because the giant squid's esophagus passes through the brain on the way to the stomach.
@hellais hellais added help wanted Extra attention is needed question Further information is requested priority/low labels Nov 10, 2023
@jbonisteel
Copy link

Jeff.

@hellais hellais mentioned this issue Mar 17, 2024
Merged
hellais added a commit that referenced this issue Apr 15, 2024
@hellais
OONI Data, OONI Pipeline split (#60)
546f40e 
Major refactoring of oonidata into two separate
packages:
* oonidata, which is the end user pip installable package to download
and parse measurements (should have minimal dependencies and not require
additional components to run, eg. clickhouse)
* oonipipeline, which is the thing that actually performs the analysis
and processing of data. This does require external dependencies to run.

Eventually we might want to move them into their own respective repos.

This fixes the following issues:
* #41, we keep oonidata as the name
for the CLI tool, but oonipipeline is the actual component doing
analysis.
* #46, we are currently using
temporal.io. After this lands we might want to make prototypes of the
other orchestration systems to compare.
* #57, we might eventually not go for
monorepo, but for the moment this is what we got.
@hellais
Copy link
Member Author

hellais commented Apr 19, 2024

Fixed by #60 . OONI Data is now the OONI Data Pipeline v5

@hellais hellais closed this as completed Apr 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
help wanted Extra attention is needed priority/low question Further information is requested
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@hellais @jbonisteel