Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Task]: Migrate Beam I/O Metrics to use a platform that allows public embedding #33850

Open
17 tasks
damondouglas opened this issue Feb 4, 2025 · 0 comments
Open
17 tasks
Assignees

Comments

@damondouglas
Copy link
Contributor

damondouglas commented Feb 4, 2025

What needs to happen?

The output of this task is to migrate visualization of metrics in https://beam.apache.org/documentation/io/connectors/ using a platform that allows for public embedding. Looker Studio might be a candidate as well as Tableau Public.

Currently, metrics published via https://beam.apache.org/documentation/io/connectors/ does so through through a Looker instance produced Looks. Originally, the system design depended on the Public embedding feature that proved to get 404 errors with non-authenticated users. Images currently published on https://beam.apache.org/documentation/io/connectors/ were generated via Looker's API which became a brittle solution when needing to update the Look.

Whatever the choice in platform, it could still use the same underlying BigQuery Viewapache-beam-testing.public_looker_explores_us.public_us_io_performance_metrics.

Issue Priority

Priority: 2 (default / most normal work should be filed as P2)

Issue Components

  • Component: Python SDK
  • Component: Java SDK
  • Component: Go SDK
  • Component: Typescript SDK
  • Component: IO connector
  • Component: Beam YAML
  • Component: Beam examples
  • Component: Beam playground
  • Component: Beam katas
  • Component: Website
  • Component: Infrastructure
  • Component: Spark Runner
  • Component: Flink Runner
  • Component: Samza Runner
  • Component: Twister2 Runner
  • Component: Hazelcast Jet Runner
  • Component: Google Cloud Dataflow Runner
@github-actions github-actions bot added the P2 label Feb 4, 2025
@damondouglas damondouglas changed the title [Task]: Migrate Beam I/O Metrics to use a platform that allows public embed [Task]: Migrate Beam I/O Metrics to use a platform that allows public embedding Feb 4, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants