Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Evaluate and implement Apache Drill or similar for NoSQL access layer on S3 data #477

Closed
3 tasks
ca-scribner opened this issue Apr 7, 2021 · 2 comments
Closed
3 tasks
Labels
size/L 4-5 days

Comments

@ca-scribner
Copy link
Contributor

We need an easy data access layer to sit on top of S3 (minio or maybe some other tool) to allow for SQL-like querying of data. This would be akin to something like Apache Drill or Dremio (Dremio is not in scope, however, due to licensing - just mentioned here as an example).

Steps:

  • Research and choose the best solution (Apache Drill? Others?)
  • Implement
  • Develop example test cases (notebooks, doc page, etc) that give basic usage. This can link external tutorials if they're sufficient, but must cover how someone with data in MinIO can actually query their data.
@ca-scribner ca-scribner added the size/L 4-5 days label Apr 7, 2021
@brendangadd
Copy link
Contributor

Let's expand scope to include Dremio. If we have Dremio, are there still gaps to fill?

@brendangadd
Copy link
Contributor

Superceded by #912

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
size/L 4-5 days
Projects
None yet
Development

No branches or pull requests

2 participants