Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

x-pack/plugin/otel: introduce x-pack-otel plugin #111091

Merged
merged 53 commits into from
Aug 19, 2024
Merged

x-pack/plugin/otel: introduce x-pack-otel plugin #111091

merged 53 commits into from
Aug 19, 2024

Commits on Aug 5, 2024

  1. Add YamlTemplateRegistry and OtelIndexTemplateRegistry with resource … 

    …YAML files
    @gregkalapos
    gregkalapos committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    96c5c22 View commit details
    Browse the repository at this point in the history

  2. Fix traces-otel template

    @gregkalapos
    gregkalapos committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    d5861bb View commit details
    Browse the repository at this point in the history

  3. Adding first yml tests

    @gregkalapos
    gregkalapos committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    e58d359 View commit details
    Browse the repository at this point in the history

  4. Base APMIndexTemplateRegistry on YamlTemplateRegistry

    @gregkalapos
    gregkalapos committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    4b7414c View commit details
    Browse the repository at this point in the history

  5. Update OTelPlugin.java

    @gregkalapos
    gregkalapos committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    b65bb90 View commit details
    Browse the repository at this point in the history

  6. Update APMIndexTemplateRegistry.java

    @gregkalapos
    gregkalapos committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    fc82339 View commit details
    Browse the repository at this point in the history

  7. Update YamlIngestPipelineConfig.java

    @gregkalapos
    gregkalapos committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    72a6769 View commit details
    Browse the repository at this point in the history

  8. Adding traces tests

    @gregkalapos
    gregkalapos committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    9cd50ee View commit details
    Browse the repository at this point in the history

  9. Update x-pack/plugin/otel-data/src/main/resources/component-templates… 

    …/ecs-tsdb@mappings.yaml

Co-authored-by: Felix Barnsteiner <felixbarny@users.noreply.github.com>
    @gregkalapos @felixbarny
    gregkalapos and felixbarny committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    953968f View commit details
    Browse the repository at this point in the history

  10. Add mapper-version

    @gregkalapos
    gregkalapos committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    6206ab3 View commit details
    Browse the repository at this point in the history

  11. Fix code-style

    @gregkalapos
    gregkalapos committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    c7ee94c View commit details
    Browse the repository at this point in the history

  12. Rename status.status_code to status.code

    @gregkalapos
    gregkalapos committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    effc9c3 View commit details
    Browse the repository at this point in the history

  13. Update otel@mappings.yaml 

    Revert back to date due to missing support in ES|QL for date_nanos
    @gregkalapos
    gregkalapos committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    ae4fc40 View commit details
    Browse the repository at this point in the history

  14. Move dynamic_templates to metrics@mappings in core

    @gregkalapos
    gregkalapos committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    909a8dd View commit details
    Browse the repository at this point in the history

  15. Run gradlew :x-pack:plugin:core:spotlessApply

    @gregkalapos
    gregkalapos committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    68ff941 View commit details
    Browse the repository at this point in the history

  16. Update x-pack/plugin/otel-data/src/main/resources/component-templates… 

    …/metrics-otel@mappings.yaml

Co-authored-by: Carson Ip <carsonip@users.noreply.github.com>
    @gregkalapos @carsonip
    gregkalapos and carsonip committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    f0f4e46 View commit details
    Browse the repository at this point in the history

  17. Update 20_metic_tests.yml 

    Workaround for TSDB timestamp issue: we push a custom template with higher priority and set  time_series.start_time.
    @gregkalapos
    gregkalapos committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    595d344 View commit details
    Browse the repository at this point in the history

  18. Update CODEOWNERS 

    Adding obs-ds-intake-services as owner of the new otel-data plugin.

Since we had some changes, also updating the owner of apm-data to the same team.
    @gregkalapos
    gregkalapos committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    9348218 View commit details
    Browse the repository at this point in the history

  19. Change dynamic: strict to false

    @gregkalapos
    gregkalapos committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    3c680b0 View commit details
    Browse the repository at this point in the history

  20. Skip "Reject invalid top level field" test

    @gregkalapos
    gregkalapos committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    e61b441 View commit details
    Browse the repository at this point in the history

  21. Update 20_metic_tests.yml

    @gregkalapos
    gregkalapos committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    ecee377 View commit details
    Browse the repository at this point in the history

  22. Add boolean as dimension test (skipping it for now)

    @gregkalapos
    gregkalapos committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    36be656 View commit details
    Browse the repository at this point in the history

  23. Add booleans_to_keywords and enable corresponding test

    @gregkalapos
    gregkalapos committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    1476c2c View commit details
    Browse the repository at this point in the history

  24. Remove processor.event top level mapping 

    Reason: for metrics and logs we can rely on the name of the datastream. For spans vs. transactions there are other fields we can use.
    @gregkalapos
    gregkalapos committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    1487373 View commit details
    Browse the repository at this point in the history

  25. Remove booleans_to_keywords 

    Because booleans are supported now as dimension on TSDB
    @gregkalapos
    gregkalapos committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    c47e086 View commit details
    Browse the repository at this point in the history

  26. Add alias service.language.name -> telemetry.sdk.language

    @gregkalapos
    gregkalapos committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    42673ce View commit details
    Browse the repository at this point in the history

  27. cleanup

    @gregkalapos
    gregkalapos committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    140bec0 View commit details
    Browse the repository at this point in the history

  28. Update README.md

    @gregkalapos
    gregkalapos committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    1c61929 View commit details
    Browse the repository at this point in the history

  29. Update README.md

    @gregkalapos
    gregkalapos committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    63690ed View commit details
    Browse the repository at this point in the history

Commits on Aug 6, 2024

  1. Update docs/changelog/111091.yaml

    @gregkalapos
    gregkalapos committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    c9b617f View commit details
    Browse the repository at this point in the history

  2. Move traces@settings and traces@mappings to core

    @gregkalapos
    gregkalapos committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    f427564 View commit details
    Browse the repository at this point in the history

  3. Update traces-otel@mappings.yaml

    @gregkalapos
    gregkalapos committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    7e06131 View commit details
    Browse the repository at this point in the history

Commits on Aug 7, 2024

  1. Review feedback

    @gregkalapos
    gregkalapos committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    717a29a View commit details
    Browse the repository at this point in the history

  2. Adapt match style in tests

    @gregkalapos
    gregkalapos committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    d5de2a1 View commit details
    Browse the repository at this point in the history

  3. Update docs/changelog/111091.yaml

    @gregkalapos
    gregkalapos committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    4ca5a21 View commit details
    Browse the repository at this point in the history

  4. Apply suggestions from code review 

    Co-authored-by: Vishal Raj <vishal.raj@elastic.co>
    @gregkalapos @lahsivjar
    gregkalapos and lahsivjar authored Aug 7, 2024
    Configuration menu
    Copy the full SHA
    65bfd0b View commit details
    Browse the repository at this point in the history

  5. Update x-pack/plugin/otel-data/src/main/resources/component-templates… 

    …/traces-otel@mappings.yaml

Co-authored-by: Carson Ip <carsonip@users.noreply.github.com>
    @gregkalapos @carsonip
    gregkalapos and carsonip authored Aug 7, 2024
    Configuration menu
    Copy the full SHA
    10287a7 View commit details
    Browse the repository at this point in the history

Commits on Aug 8, 2024

  1. Changing trace_flags to long 

    Related discussion: elastic#111091 (comment)
    @gregkalapos
    gregkalapos committed Aug 8, 2024
    Configuration menu
    Copy the full SHA
    a6baf46 View commit details
    Browse the repository at this point in the history

Commits on Aug 9, 2024

  1. Remove trace_flags 

    see: elastic/opentelemetry-dev#368 (review)
    @gregkalapos
    gregkalapos committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    7989b12 View commit details
    Browse the repository at this point in the history

  2. Apply suggestions from code review 

    Co-authored-by: Andrew Wilkins <axwalk@gmail.com>
    @gregkalapos @axw
    gregkalapos and axw authored Aug 9, 2024
    Configuration menu
    Copy the full SHA
    2a44ecd View commit details
    Browse the repository at this point in the history

  3. Review feedback

    @gregkalapos
    gregkalapos committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    a3837fc View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into otel_plugin

    @elasticmachine
    elasticmachine authored Aug 9, 2024
    Configuration menu
    Copy the full SHA
    90c8252 View commit details
    Browse the repository at this point in the history

Commits on Aug 12, 2024

  1. Add store_array_source for span links

    @gregkalapos
    gregkalapos committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    846db1d View commit details
    Browse the repository at this point in the history

  2. Define constant data_stream.type in template.yamls

    @gregkalapos
    gregkalapos committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    e1adb6a View commit details
    Browse the repository at this point in the history

  3. Create package-info.java

    @gregkalapos
    gregkalapos committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    dfdcf70 View commit details
    Browse the repository at this point in the history

Commits on Aug 13, 2024

  1. Move ecs-tsdb@mappings to index template 

    Add test to verify that @Custom template can add dynamic templates with a higher precedence
    @felixbarny
    felixbarny committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    16234d7 View commit details
    Browse the repository at this point in the history

  2. Update metrics@mappings.json 

    Remove summary_gauge and summary_counter since they are covered by summary_metrics
    @gregkalapos
    gregkalapos committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    0389c37 View commit details
    Browse the repository at this point in the history

  3. Move clusterService.getClusterSettings().addSettingsUpdateConsumer to… 

    … registry
    @gregkalapos
    gregkalapos committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    9b93b75 View commit details
    Browse the repository at this point in the history

  4. Fix code-style

    @gregkalapos
    gregkalapos committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    3152f99 View commit details
    Browse the repository at this point in the history

Commits on Aug 14, 2024

  1. Update x-pack/plugin/otel-data/src/yamlRestTest/resources/rest-api-sp… 

    …ec/test/20_logs.tests.yml

Co-authored-by: Felix Barnsteiner <felixbarny@users.noreply.github.com>
    @gregkalapos @felixbarny
    gregkalapos and felixbarny authored Aug 14, 2024
    Configuration menu
    Copy the full SHA
    680e519 View commit details
    Browse the repository at this point in the history

  2. Enable logsdb

    @gregkalapos
    gregkalapos committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    ef3468f View commit details
    Browse the repository at this point in the history

  3. Update traces@settings.json 

    No lifecycle needed for OTel at this point
    @gregkalapos
    gregkalapos committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    3bb6737 View commit details
    Browse the repository at this point in the history

Commits on Aug 19, 2024

  1. Merge branch 'main' into otel_plugin

    @elasticmachine
    elasticmachine authored Aug 19, 2024
    Configuration menu
    Copy the full SHA
    9f18034 View commit details
    Browse the repository at this point in the history