vParquet3: Configurable dedicated columns for span/resource attributes

[stoewer]

This issue bundles tasks related to extending Tempo’s Parquet based block format such that a configurable subset of span attributes can be stored in dedicated columns. The goal is to improve the search performance of TraceQL in Tempo.

The extended format will be released as vParquet3.

Context

• Design proposal PR (replace with link to doc once merged)

Planning

Beta Give feedback

1. Create draft for design proposal
2. Set up development main branch (main-vparquet3)
3. Publish design proposal to Tempo (Design proposal: vParquet3 #2525)

Implementation

Beta Give feedback

1. vParquet3: Add dedicated columns to schema and block meta #2528
   +0
   
2. Add configuration and overrides for column assignments #2548
   +0
   
3. Wiring the config with the schema changes and make write path work #2552
   +0
   
4. Compactor handles blocks with different dedicated column assignments #2570
   +0
   
5. TraceQL searches through dedicated columns #2576
   +0
   
6. Method to identify candidates for dedicated columns #2630
   +0
   
7. Document vParquet3 features and how to use them #2663
   type/docs +1
   
8. Run dedicated attribute column benchmark on production data #2629
   +0
   
9. Validate dedicated configuration and override values #2610
   +0
   
10. Fix bugs in vParquet3 structural operators #2674
    +0

Release

Beta Give feedback

1. Create and release vParquet3 encoding from the development branch
2. Create dashboard to track TraceQL performance improvements
3. Rollout to ops and test configs
4. Rollout to production cells

[knylander-grafana]

FYI: Since vParquet3 wasn't included as part of release 2.2, I've rolled back some of the doc changes. They are still in the files, but are commented out.

• operations/dedicated_columns.md is set to not publish
• Analyze blocks and analyze block sections of the API doc have the sentences referencing v3 commented out.

I followed the doc changes in this PR for guidance: #2663

[knylander-grafana]

Doc issue for dedicated columns: https://github.com/grafana/tempo-squad/issues/293