…se a generated class as well for testing, and not only the current state

…hed)

Bumps [protobufjs](https://github.com/protobufjs/protobuf.js) from 6.11.2 to 6.11.3.
- [Release notes](https://github.com/protobufjs/protobuf.js/releases)
- [Changelog](https://github.com/protobufjs/protobuf.js/blob/v6.11.3/CHANGELOG.md)
- [Commits](protobufjs/protobuf.js@v6.11.2...v6.11.3)

---
updated-dependencies:
- dependency-name: protobufjs
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

…ge and grpcio-gcp

…n of google-cloud-bigquery-storage and google-cloud-core

This covers everything through section 4, Transforms.

Also implements missing transforms CoGroupByKey and Partition and
fixes a bug in DoubleCoder.

…che#22210)

…pache#22130)

This fixes apache#22129.

…/interactive/extensions/apache-beam-jupyterlab-sidepanel (apache#22200)

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Updated Regex and test

* Updated Regex and test

…apache#22134)

This is better aligned with standard javascript convention.

Often libraries have the default version be asynchronous, and
name the Sync one explicitly, we are marking the async ones as
they are by far the most common and usable for pipeline
construction.

Co-authored-by: tvalentyn <tvalentyn@users.noreply.github.com>

This has been red for a while https://github.com/apache/beam/actions/workflows/playground_deploy_examples.yml

…tion.

…ault in Java SDK

…ents in UIs.

Several requests to show experiments in UIs.

… packages to fix vendoring validation

* WC generics

* Partition generics

* GroupBy generics

* Flatten generics

* combine_globally generics

* Combine generics

* CoGBK generics

* BigQuery generics

* Remove old versions

…22247)

* Checkpointing Generics

* Drain generics

* ParDo generics

* Panes generics

* WindowInto generics

* Wordcount generic registration

* StringSplit generics

* Autocomplete Generics

* Contains generics

* Improve autocomplete

* Debugging wordcount generics

* Grades generics

* Taxi generics

* Large Wordcount Generics

* Multiout generics

* PingPong generics

* Windowed WC generics

* Yatzy Generics

* Update sdks/go/examples/grades/grades.go

Co-authored-by: Danny McCormick <dannymccormick@google.com>

* Remove unused import

Co-authored-by: Danny McCormick <dannymccormick@google.com>

Daniel is taking some time away from the project, removing him from the reviewer set

Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.86.0 to 0.87.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases)
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md)
- [Commits](googleapis/google-api-go-client@v0.86.0...v0.87.0)

---
updated-dependencies:
- dependency-name: google.golang.org/api
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

…che#22213)

Bumps [cloud.google.com/go/bigquery](https://github.com/googleapis/google-cloud-go) from 1.34.1 to 1.35.0.
- [Release notes](https://github.com/googleapis/google-cloud-go/releases)
- [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md)
- [Commits](googleapis/google-cloud-go@spanner/v1.34.1...bigquery/v1.35.0)

---
updated-dependencies:
- dependency-name: cloud.google.com/go/bigquery
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

)

Bumps [google.golang.org/grpc](https://github.com/grpc/grpc-go) from 1.47.0 to 1.48.0.
- [Release notes](https://github.com/grpc/grpc-go/releases)
- [Commits](grpc/grpc-go@v1.47.0...v1.48.0)

---
updated-dependencies:
- dependency-name: google.golang.org/grpc
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

…ries

[BEAM-14506] Adding testcases and examples for xlang Python RunInference

* Defocus iframe on blur or mouseout (apache#22153)

* Update akvelon_flutter_issue_106664_workaround to v0.1.2 (apache#22153)

…g into using Kafka SDF-wrapper

Previously we just split on spaces. Also adds a little logging.

Fixes apache#22269

* Playground DeployExamples: move gcloud auth to the first step

* Update playground_deploy_examples.yml

…sts included (apache#21765)

* [BEAM-14048] Add ConfigWrapper for building CDAP PluginConfigs

* [BEAM-14073] Add CdapIO and batch plugins PoC

* [BEAM-14048] Fix checkstyle

* [BEAM-14073] Fix checkstyle

* [BEAM-14048] Fix warnings

* [BEAM-14048] Fix warnings

* [BEAM-14048] Fix warning

* [BEAM-14048] Fix warning

* [BEAM-14048] Remove unused dependencies

* [BEAM-14048] Add needed dependencies

* [BEAM-14048] Fix spotless

* [BEAM-14048] Fix typo

* [BEAM-14048] Use fori instead of stream

* [BEAM-14048] Suppress warning

* [BEAM-14048] Add used undeclared artifacts

* [BEAM-14048] Change dependencies to test

* Add context.

* Fix dependencies issue

* Add null annotation

* Added CDAP plugin wrapper

* [BEAM-14048] Refactoring

* Add SuppressWarning.

* Fix style.

* Determine dependencies.

* Added JavaDoc for PluginConstants class

* Formatted code

* Refactored dependencies

* Made plugin fields nullable

* [BEAM-14073] Refactor dependencies

* Refactored getters

* retrigger checks

* Updated CdapIO with new implementation of Plugin

* [BEAM-14048] Use CDAP InstantiatorFactory for creating config objects

* [BEAM-14048] Suppress warning

* [BEAM-14081] Refactoring

* Update maven repo

* Update build.gradle

* [BEAM-14073] Use sonatype dependencies

* [BEAM-14073] Merge with Plugin changes

* [BEAM-14073] Use new Plugin wrapper

* [BEAM-14073] Merge with config

* [BEAM-14073] Instantiate cdapPlugin correctly

* [BEAM-14053] Add prepareRun method in Plugin

* [BEAM-14081] Refactoring

* [BEAM-14053] Add Nullable annotations

* [BEAM-14053] Suppress warning

* [BEAM-14053] Fix Spotless

* [BEAM-14053] Add avro dependency

* [BEAM-14073] Add Write Transform. Add test for Hubspot.

* [BEAM-14073] Add test for ServiceNow

* [BEAM-14048] Use ServiceNow CDAP dependency from Maven central

* [BEAM-14048] Set macroFields

* [BEAM-14081] Fix javadoc

* [BEAM-14053] Use ServiceNow dependency in tests

* [BEAM-14073] Refactoring

* [BEAM-14073] Suppress warnings

* [BEAM-14073] Refactoring

* [BEAM-14073] Refactoring

* [BEAM-14073] Add EmployeeBatchSource plugin for tests

* [BEAM-14073] Add Read tests

* [BEAM-14073] Add Write tests

* [BEAM-14073] Fix description

* [BEAM-14073] Fix build.gradle

* [BEAM-14073] Fix comments

* [BEAM-14073] Fix nullness warning

* [BEAM-14073] Move cdap plugin dependencies to local build.gradle

* [BEAM-14073] Move cdap plugin dependencies to BeamModulePlugin

* [BEAM-14073] Remove redundant suppress warnings

* [BEAM-14073] Fix comments

* [BEAM-14073] Fix typo

* [BEAM-14073] Fix nullness warning in Plugin

* [BEAM-14073] Add Experimental annotation

Co-authored-by: igor.krasavin <igor.krasavin@akvelon.com>
Co-authored-by: Ekaterina Tatanova <e.tatanova@mail.ru>
Co-authored-by: Alex Kosolapov <alex.kosolapov@gmail.com>
Co-authored-by: Elizaveta Lomteva <elizaveta.lomteva@akvelon.com>
Co-authored-by: Elizaveta Lomteva <57974525+Lizzfox@users.noreply.github.com>

* add deidentify transform with integration test

* remove extra line

* indicate error by empty return

* improve validateCounter function considering operation counters

* add unit tests and small improvements

* add documentation to transform

* add extra counter validate check

* increase polling interval

* improve poll function name

* fix staticcheck errors

* adjust test error log message

* refactor integration tests to run in single pipeline resolving dan comment and timeout issues

* adjust filter to accomodate refactor

* add helper function to simplify getting nested member variable

* move non-standard package to the bottom

* use backoff retry instead of hardcoded time for polling operation

* call s.Scope to aid debugging

* use Impulse since transform is Source only

* poll operation before loop since it may be completed without having to wait

* refactor test

* fix not using error staticcheck

[BEAM-22229] Override external SDK container URLs for Dataflow by default in Java SDK

* remove locks around ExecutionStateSampler

* make all benchmarks use 10 threads

* normalize benchmarks

* more state

…g over the pure SDF source

… FirestoreIO

…ilder for SparkReceiverIO

Moves timestamp skew override to correct place

…de API

* [Playground] [Infrastrusture] add one more action to install a cloud datastore emulator

* [Playgorund] [Backend] add new methods in a proto file for sharing any code

* [Playground] [Backend] code methods to save snippets and read them

* [Playground] [Infrastrusture] add variables

* [Playground] [Backend] fix tests

* [Playground] [Infrastrusture] change default value for datastore emulator host

* [Playground] [Backend] change default value in README file

* configure database setup only for router backend

* [Playground] [Backend] change saving and reading snippets

* [Playground] [Backend] fixes and more tests

* [Playground] [Backend] fix dockerfile for router server

* [Playground] [Backend] add mappers and transactions

* [Playground] [Backend] add comment for mapper

* [Playground] [Infrastructure] add variables and their description

* [Playground] [Infra] add tfvars file

* [Playground] [Infra] add extra step to check changes

* Update terraform.tfvars

* Update variables.tf

* [Playground] [Backend] update transactions for snippets

* [Playground] [Backend] updated router dockerfile and readme file

* [Playground] [Backend] removed extra veriable

* [Playground] [Infra] removed extra variable from route dockerfile

* [Playground] [Infra] changed backend workflow for production

* [Playground] [Infra] removed extra files after testing

* [Playground] [Infra] removed extra newline

* [Playground] [Backend] updated backend worflow to test on sandbox

* [Playground] [Backend] updated set up cloud sdk

* added gcloud components check

* fixed backend workflow

* [Playground] [Infra] removed extra env variables

* [Playground] [Backend] add logs for gradle task

* test for datastore emulator

* added echo for scripts to understand problem

* removed inneeded shell script

* [Playground] [Backend] removed extra steps for backend workflow

* [Playground] [Backend] set up prod configuration

* [Playground] [Backend] remove extra symbols

* [Playground] [Infra] updated step to set up cloud sdk

* [Playground] [Infra] added viper lib for application props

* [Playground] [Infra] added docker compose for local deployment

* [Playground] [Backend] edited docker compose after testing

* [Playground] [Infra] edited docker compose

* [Playground] [Infrastructure] updated documentation

* [Playgroumd] [Infrastructure] renamed db type to remote

* [Playgorund] [Infrastructure] remove unused variable

* [Playground] [Backend] removed extra methods and files

* [Playgorund] [Backend] fixed tests

* [Playgorund] [Backend] added tests

* [Playground] [Backend] updated environment for sharing any code

* [Playground] [Infrastructure] updated gradle tasks and dockerfile

* [Playgorund] [Backend] improves after review

* [Playground] [Infrastucture] removed extra shell script

* [Playground] [Backend] updated docker compose for local deployment

* [Playground] [Infrastructure] updated docker compose file for local deployment

* added newlines for git scanning

* [Playground] [Backend] changed origin property to string

* [Playground] [Backend] updated the migration description

* [Playground] [Backend] set gcp version

* edited tabs

Co-authored-by: MakarkinSAkvelon <67736809+MakarkinSAkvelon@users.noreply.github.com>

…Kafka source by default for Python x-lang

apache#22301

…ned pipeline options.

* Turn pr bot on for remaining common labels

* Update start time to several hours from now

* Reviewing the RunInference ReadMe file for clarity.

* Reviewing the RunInference ReadMe.

* Changed dataset and model sections  to steps; clarified that prerequisites are required for these examples

* Added note about batching elements of different sizes

* Edited note about batching elements of different sizes

* Removed note about batching elements. Added links to the ML content that's being added.

* Update sdks/python/apache_beam/examples/inference/README.md

Co-authored-by: Andy Ye <andyye333@gmail.com>

* Update sdks/python/apache_beam/examples/inference/README.md

Co-authored-by: Andy Ye <andyye333@gmail.com>

* Update sdks/python/apache_beam/examples/inference/README.md

Co-authored-by: Andy Ye <andyye333@gmail.com>

* Update sdks/python/apache_beam/examples/inference/README.md

Co-authored-by: Andy Ye <andyye333@gmail.com>

* Update sdks/python/apache_beam/examples/inference/README.md

Co-authored-by: Andy Ye <andyye333@gmail.com>

* Update sdks/python/apache_beam/examples/inference/README.md

Co-authored-by: Andy Ye <andyye333@gmail.com>

* Update sdks/python/apache_beam/examples/inference/README.md

Co-authored-by: Andy Ye <andyye333@gmail.com>

* Because the output file is created by the pipeline, changing the phrasing of that step.

Co-authored-by: Andy Ye <andyye333@gmail.com>

… in /sdks/typescript

[Website] add playground section

Co-authored-by: Anand Inguva <34158215+AnandInguva@users.noreply.github.com>
Co-authored-by: Andy Ye <andyye333@gmail.com>
Co-authored-by: Anand Inguva <anandinguva98@gmail.com>
Co-authored-by: Anand Inguva <anandinguva@google.com>

* rewrote Java multi-language pipeline quickstart

* reference higher-level DataframeTransform

* fix one last awkward phrase

* incorporated feedback

…s, modified "get difference

[Playground]: enable multi file flag for multi file examples

* Increase streaming server timeout to give tests a chance to complete before service teardown. Locally seems to help with Spark 2 tests

* Try an insanely long timeout to see if the Spark Context dies or gets killed.

Co-authored-by: Byron Ellis <byronellis@google.com>

…entation

* Unvendor bytebuddy

This is only for testing.

* Fix :sdks:java:core:validateShadedJarDoesntLeakNonProjectClasses

* Fix another import

* Remove a reference to vendored_bytebuddy_1_11_0

* Remove from sdks/java/core/build.gradle

* Add an explicit bytebuddy dep to jmh benchmarks

* Declare byte_buddy within the shadow configuration

This fixes apache#22317

This is required for streaming update, and some other runners make
expectations about this as well.  It's also good to get this in sooner
rather than later as it would be a painfully backwards incompatible
change to otherwise working pipelines.

Also improve direct CombineFn testing and array encoding.

…pache#22320)

* [apache#22319] Regenerate proto2_coder_test_messages_pb2.py manually

* Update instructions to regenerate proto file

* Fix pylint issue

…he#22325)

Co-authored-by: tvalentyn <tvalentyn@users.noreply.github.com>

* cleaned up types in standard_coders.ts

* remove note about npm ci; to be handled in automation

…ovider (resolves apache#22181) (apache#22182)

* JMH module for sdks:java:core with benchmarks for GetterBasedSchemaProvider (resolves apache#22181)

* spotless

* Remove jamm agent

* Reduce setup costs and measurement overhead

* Make benchmark code easier to profile by avoiding lambdas

* Replace generated Sink with explicit readField method

* fix checks

* Update sdks/java/core/jmh/src/main/java/org/apache/beam/sdk/schemas/RowBundle.java

Co-authored-by: Lukasz Cwik <lcwik@google.com>

* Update sdks/java/core/jmh/src/main/java/org/apache/beam/sdk/schemas/package-info.java

Co-authored-by: Lukasz Cwik <lcwik@google.com>

* Update javadocs

* Minimize setup overhead

Co-authored-by: Lukasz Cwik <lcwik@google.com>

…e#22332)

Bumps [cloud.google.com/go/pubsub](https://github.com/googleapis/google-cloud-go) from 1.23.1 to 1.24.0.
- [Release notes](https://github.com/googleapis/google-cloud-go/releases)
- [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md)
- [Commits](googleapis/google-cloud-go@pubsub/v1.23.1...pubsub/v1.24.0)

---
updated-dependencies:
- dependency-name: cloud.google.com/go/pubsub
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>