Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for TraceQL in Parquet WAL and Local Blocks #1966

Merged
merged 13 commits into from
Jan 9, 2023

Conversation

electron0zero
Copy link
Member

@electron0zero electron0zero commented Dec 26, 2022

What this PR does:
Add support for TraceQL in Parquet WAL and Local Blocks in ingester. We added Parquet WAL in #1878, but TraceQL Search is not supported in ingester

How?
In ingesters, a trace can be live, in headBlock, in the completing blocks and complete blocks.
we search in this order: HeadBlock, CompletingBlocks, and completeBlocks.
search is done by Iterating over blocks, executing TraceQL, and finally collecting results.

note: searching liveTraces is not supported yet

Which issue(s) this PR fixes:
Fixes #

Checklist

  • Tests updated
  • Documentation added
  • CHANGELOG.md updated - the order of entries should be [CHANGE], [FEATURE], [ENHANCEMENT], [BUGFIX]

@electron0zero electron0zero marked this pull request as draft December 26, 2022 18:02
@electron0zero electron0zero marked this pull request as ready for review December 27, 2022 16:31
Copy link
Member

@mapno mapno left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Left a few comments, but I like the changes 👍

modules/ingester/instance_search.go Outdated Show resolved Hide resolved
modules/ingester/instance_search.go Outdated Show resolved Hide resolved
modules/ingester/instance_search.go Outdated Show resolved Hide resolved
modules/ingester/instance_search.go Outdated Show resolved Hide resolved
modules/ingester/instance_search.go Outdated Show resolved Hide resolved
@electron0zero electron0zero requested a review from mapno December 28, 2022 15:49
modules/ingester/ingester_test.go Show resolved Hide resolved
modules/ingester/instance_test.go Show resolved Hide resolved
modules/ingester/instance_search.go Outdated Show resolved Hide resolved
@joe-elliott
Copy link
Member

I'm currently in the middle of a config refactor that has the potential to strongly conflict with this PR. Please ignore the review comments about adjusting tests. I will handle it on my side.

@electron0zero electron0zero changed the title Add support for TraceQL in Parquet WAL Add support for TraceQL in Parquet WAL and Local Blocks Jan 6, 2023
modules/ingester/instance_search.go Outdated Show resolved Hide resolved
modules/ingester/instance_search.go Outdated Show resolved Hide resolved
@joe-elliott joe-elliott merged commit c57394a into grafana:main Jan 9, 2023
@electron0zero electron0zero deleted the wal_traceql branch January 9, 2023 14:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants