Skip to content

Conversation

@wchargin
Copy link
Contributor

@wchargin wchargin commented Mar 15, 2021

Summary:
This patch replaces the multiplexer code in the mesh plugin with data
provider code. It is not gated behind a flag.

We treat all mesh data as tensors, since that’s most expedient at this
time and the local data providers (multiplexer and RustBoard) don’t
actually have any size constraints. See also discussion in #4734.

Test Plan:
The dashboard still works with the standard demo data, both with and
without --load_fast=true.

wchargin-branch: mesh-generic

Summary:
This patch replaces the multiplexer code in the custom scalars plugin
with data provider code. It is not gated behind a flag. We treat the
layout protos as tensors, since they are of scalar shape and are
expected to be small. A case could be made for representing them as blob
sequences with a datacompat shape conversion, but this is simpler and
the plugin doesn’t get a ton of use.

Test Plan:
The dashboard still works with the standard demo data, both with and
without `--load_fast`.

wchargin-branch: custom-scalars-generic
wchargin-source: 91001190a543e99ba73c407df3bc801d81eaa2cf
Summary:
This patch replaces the multiplexer code in the mesh plugin with data
provider code. It is not gated behind a flag.

We treat all mesh data as tensors, since that’s most expedient at this
time and the local data providers (multiplexer and RustBoard) don’t
actually have any size constraints. See also discussion in #4734.

Test Plan:
The dashboard still works with the standard demo data, both with and
without `--load_fast`.

wchargin-branch: mesh-generic
wchargin-source: 2a995b31efea5c58dee9d05fc7e66bbdb833a32e
@wchargin wchargin added plugin:mesh core:rustboard //tensorboard/data/server/... labels Mar 15, 2021
@google-cla google-cla bot added the cla: yes label Mar 15, 2021
@wchargin wchargin requested a review from psybuzz March 15, 2021 18:01
@wchargin wchargin mentioned this pull request Mar 15, 2021
34 tasks
wchargin-branch: mesh-generic
wchargin-source: 75e006cc59401e05b0aa2b4ec49536ccc9f0aa9e
wchargin-branch: mesh-generic
wchargin-source: 75e006cc59401e05b0aa2b4ec49536ccc9f0aa9e
@wchargin wchargin changed the base branch from wchargin-custom-scalars-generic to master March 16, 2021 02:11
wchargin-branch: mesh-generic
wchargin-source: 75e006cc59401e05b0aa2b4ec49536ccc9f0aa9e
@wchargin
Copy link
Contributor Author

(I’ve rotated this below #4774, since that PR is still awaiting review
and these two are logically independent.)

wchargin-branch: mesh-generic
wchargin-source: 75e006cc59401e05b0aa2b4ec49536ccc9f0aa9e
@wchargin wchargin merged commit 2c04039 into master Mar 16, 2021
@wchargin wchargin deleted the wchargin-mesh-generic branch March 16, 2021 02:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cla: yes core:rustboard //tensorboard/data/server/... plugin:mesh

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants