Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove dependency on go.opentelemetry.io/collector #279

Merged

Conversation

dashpole
Copy link
Contributor

@dashpole dashpole commented Jan 12, 2022

Based on open-telemetry/opentelemetry-collector-contrib#7132 (comment), we should try and reduce our dependencies on collector core to the bare minimum. After this change, this package only references go.opentelemetry.io/collector/model/pdata, and go.opentelemetry.io/collector/model/semconv/v1.8.0, which are all within the go.opentelemetry.io/collector/model go module.

This PR moves the go.opentelemetry.io/collector dependency, which includes the collector component interfaces, as well as exporterhelper packages.

It creates a new module for exporter/collector/internal/integrationtest so that tests can still use collector helpers to verify that config parsing, etc. still works.

The way this package would work is that the NewFactory() method would exist in collector-contrib, but would call into this package's new public methods:

  • DefaultConfig()
  • NewGoogleCloudTracesExporter()
  • NewGoogleCloudMetricsExporter()
  • MetricExporter.PushMetrics()
  • MetricExporter.Shutdown()
  • TraceExporter.PushTraces()
  • TraceExporter.Shutdown()

The collector.Config struct would be embedded into the Config struct with the mapstructure:",squash" tag to preserve backwards-compatibility, see config_test.go for an example of how it could be embedded within a config.

Removing the collector dependency required the following additional changes:

  • Remove the feature gate. This will live upstream.
  • Remove tests for exporterhelper-produced metrics. These will be replaced by upstream unit (not integration) tests.

@dashpole dashpole marked this pull request as ready for review January 12, 2022 21:32
@dashpole dashpole requested review from aabmass and punya January 12, 2022 21:32
Copy link
Contributor

@jsuereth jsuereth left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

read through all the back discussion and this LGTM as a path forward.

@dashpole dashpole force-pushed the reduce_deps branch 2 times, most recently from 435d070 to d8a338e Compare January 14, 2022 18:59
@dashpole dashpole requested a review from aabmass January 14, 2022 19:01
Copy link
Contributor

@aabmass aabmass left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚢

@dashpole dashpole merged commit 90403ea into GoogleCloudPlatform:col-exporter-rewrite Jan 14, 2022
@dashpole dashpole deleted the reduce_deps branch January 14, 2022 19:53
dashpole added a commit that referenced this pull request Feb 2, 2022
* Skip all fixture tests (#239)

* Initial structure for new pdata metrics exporter (#238)

* [Metrics Rewrite] add outline with todos for fragmenting work (#240)

* [Metrics Rewrite] attribute to label mapping (#243)

[Metrics Rewrite] attribute to label mapping

* [Metrics Rewrite] support for pdata Sum points (#242)

* [Metrics Rewrite] support for pdata Sum points

* update breaking-changes.md

* use concatentation instead of sprintf

* [Metrics Rewrite] support for pdata Gauge points (#244)

* Add logic to translate metric descriptors and initial flow (#247)

* Fixes from merge.

* Fix tests.

* Clean up test cases, re-disable integration tests.

* Add summary descriptors and label descriptors.

* Fix lint issues.

* Some fixes from review.

* Remove metric import.

* Fixes from review.
- Update default config method
- Simplify some of my lack-of-go expertise.

* Add unit test for metric domains.

* Fixes from review.

* Add breaking changes.

* Fixes from review.

* Update context to be TODO.

* Add support for exponential histograms and exemplars. (#251)

* Add support for exponential histograms and exemplars.

* Fixes from review.

* Fixes from review.

* Fixes from discussion.

* [Metrics Rewrite] implement monitored resource mapping (#252)

* [Metrics Rewrite] implement monitored resource mapping

* review fixes

* [Metrics Rewrite] update breaking-changes.md for monitored resource (#255)

* Add summary mapping to exporter. (#249)

* Add config to call `CreateServiceTimeSeries` (#259)

* Initial implementation of create service time series.

* Add a test case for create service timeseries.

* Add logic to auto-detect project id if not configured.

* Fix from code review

* Fix resource to be one that has retention policy for integration tests.

* Add support for histogram to metrics exporter. (#258)

BUG=210164184

* Re-enable ops-agent self-metric integration test. (#260)

* [Metrics Rewrite] add ExponentialHistogram fixture (#257)

* [Metrics Rewrite] add ExponentialHistogram fixture

* make tests deterministic

* few last changes

* close channel instead of sending a message

* Enable ops agent host metric integration test. (#264)

- There is a bug in upstream agent-metric-processor that sets incorrect units on usage metrics (GoogleCloudPlatform/opentelemetry-operations-collector#72)
- We update the expectations for inculsion of units in CreateTimeSeries
- We disable metric descriptors (for now).  Given the bug in agent-metric-processor, liekly ops-agent will need upstream fix for this first.

* add a feature gate, which defaults to false, for using the re-written exporter (#267)

* Enable Basic integration tests (#266)

* Enable basic counter test.

* Enable delta counter metrics.

- Note: Delta counters are NOW fake-delta (i.e. cumulatives with limited time windows)

* Enable non-monotonic-sum integration test.

* Re-enable summary integration test and fix design issues in summary translation.

- Summary exports percentiles, not quantiles
- Percentiles should include similar double precision in the string.

* Fix recordfixtures script to use featuregate (#270)

* Skip already seen attribute keys when creating LabelDescriptors (#272)

* Reenable GKE metrics agent fixtures (#271)

* Update breaking-changes.md for googlecloudmonitoring/point_count self observability (#277)

* Move logging to use zap-logger and set up self-observability to match collector expectations. (#275)

* Enable metric prefix integraiton tests. (#274)

* enable workloadapis prefix integration test.

* update unknown domain metrics expect.

* Add instrumentationLibraryToLabels method to metrics exporter. (#253)

* Add instrumentationLibraryToLabels method to metrics exporter.

BUG=https://b.corp.google.com/issues/210164355

* Remove custom_metrics_domains behaviour from metrics-exporter.

* Remove dependency on go.opentelemetry.io/collector (#279)

* remove dependency on go.opentelemetry.io/collector

* add ocgrpc metrics to exporters' self-obs metrics (#280)

* Use OC stackdriver exporter to capture self observability metrics as GCM protos (#282)

* Capture ocgrpc self observability metrics (#283)

* make integrationtest not internal (#285)

* Remove internal/ prefix for integrationtest (#288)

* Add batching support to metrics-exporter. (#286)

* Add batching support to metrics-exporter.

* Retry when we fail to write metric descriptors.

* Re-enable workload metrics integration tests (#278)

* update header year for new files (#296)

* Document new CreateMetricDescriptor behavior (#294)

* reenable disabled metrics test (#299)

Co-authored-by: Aaron Abbott <aaronabbott@google.com>
Co-authored-by: Josh Suereth <Joshua.Suereth@gmail.com>
Co-authored-by: Thomas Barker <tbarker25@gmail.com>
Co-authored-by: Punya Biswal <punya@google.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants