Skip to content

Commit

Permalink
Remove notes now that Dataflow v2 supports BQ autosharding (#31561)
Browse files Browse the repository at this point in the history
  • Loading branch information
scwhittle authored Jun 11, 2024
1 parent 6a24b07 commit 462c833
Showing 1 changed file with 0 additions and 4 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -789,9 +789,6 @@ BigQuery Storage Write API for Python SDK currently has some limitations on supp

{{< paragraph class="language-py" >}}
**Note:** If you want to run WriteToBigQuery with Storage Write API from the source code, you need to run `./gradlew :sdks:java:io:google-cloud-platform:expansion-service:build` to build the expansion-service jar. If you are running from a released Beam SDK, the jar is already included.

**Note:** Auto sharding is not currently supported for Python's Storage Write API exactly-once mode on DataflowRunner.

{{< /paragraph >}}

#### Exactly-once semantics
Expand Down Expand Up @@ -883,7 +880,6 @@ explicitly enable this using [`withAutoSharding`](https://beam.apache.org/releas
`STORAGE_WRITE_API` defaults to dynamic sharding when
`numStorageWriteApiStreams` is set to 0 or is unspecified.

***Note:*** Auto sharding with `STORAGE_WRITE_API` is supported by Dataflow, but **not** on Runner v2.
{{< /paragraph >}}

When using `STORAGE_WRITE_API`, the `PCollection` returned by
Expand Down

0 comments on commit 462c833

Please sign in to comment.