Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

BigQuery Storage Write API SchemaTransform wrapper for Python SDK #24783

Closed
wants to merge 22 commits into from
Closed

BigQuery Storage Write API SchemaTransform wrapper for Python SDK #24783

wants to merge 22 commits into from

Commits on Dec 21, 2022

  1. discover one matching schematransform

    @ahmedabu98
    ahmedabu98 committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    5c1cb55 View commit details
    Browse the repository at this point in the history

  2. storage api wrapper

    @ahmedabu98
    ahmedabu98 committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    0b793da View commit details
    Browse the repository at this point in the history

Commits on Dec 26, 2022

  1. default expansion service needs to be called outside of a class

    @ahmedabu98
    ahmedabu98 committed Dec 26, 2022
    Configuration menu
    Copy the full SHA
    59af787 View commit details
    Browse the repository at this point in the history

  2. add end-to-end test

    @ahmedabu98
    ahmedabu98 committed Dec 26, 2022
    Configuration menu
    Copy the full SHA
    dbc4900 View commit details
    Browse the repository at this point in the history

Commits on Dec 28, 2022

  1. add parametere defaults

    @ahmedabu98
    ahmedabu98 committed Dec 28, 2022
    Configuration menu
    Copy the full SHA
    87e6e40 View commit details
    Browse the repository at this point in the history

Commits on Jan 9, 2023

  1. Merge branch 'master' of github.com:ahmedabu98/beam into storage_writ… 

    …e_wrapper_python

marge timestamp microsecond precision PR
    @ahmedabu98
    ahmedabu98 committed Jan 9, 2023
    Configuration menu
    Copy the full SHA
    af1062d View commit details
    Browse the repository at this point in the history

Commits on Jan 13, 2023

  1. remove microsecond reset; spotless

    @ahmedabu98
    ahmedabu98 committed Jan 13, 2023
    Configuration menu
    Copy the full SHA
    735b7f4 View commit details
    Browse the repository at this point in the history

Commits on Jan 19, 2023

  1. handle datetime micros when converting TableRow -> Row

    @ahmedabu98
    ahmedabu98 committed Jan 19, 2023
    Configuration menu
    Copy the full SHA
    7ea500c View commit details
    Browse the repository at this point in the history

  2. tests for accessing failed rows in SchemaTransform

    @ahmedabu98
    ahmedabu98 committed Jan 19, 2023
    Configuration menu
    Copy the full SHA
    f8e351b View commit details
    Browse the repository at this point in the history

Commits on Jan 20, 2023

  1. doc updates

    @ahmedabu98
    ahmedabu98 committed Jan 20, 2023
    Configuration menu
    Copy the full SHA
    bc17b47 View commit details
    Browse the repository at this point in the history

Commits on Feb 2, 2023

  1. ignore dispositions case; throw early error for unavailable streaming… 

    … cases
    @ahmedabu98
    ahmedabu98 committed Feb 2, 2023
    Configuration menu
    Copy the full SHA
    68ce245 View commit details
    Browse the repository at this point in the history

  2. discover one config tests

    @ahmedabu98
    ahmedabu98 committed Feb 2, 2023
    Configuration menu
    Copy the full SHA
    d0f8ab7 View commit details
    Browse the repository at this point in the history

  3. message fix

    @ahmedabu98
    ahmedabu98 committed Feb 2, 2023
    Configuration menu
    Copy the full SHA
    71d13c1 View commit details
    Browse the repository at this point in the history

  4. doc fixes

    @ahmedabu98
    ahmedabu98 committed Feb 2, 2023
    Configuration menu
    Copy the full SHA
    bcfc381 View commit details
    Browse the repository at this point in the history

Commits on Feb 3, 2023

  1. use EXPANSION_PORT

    @ahmedabu98
    ahmedabu98 committed Feb 3, 2023
    Configuration menu
    Copy the full SHA
    5154639 View commit details
    Browse the repository at this point in the history

Commits on Feb 6, 2023

  1. use python expansion service decorator

    @ahmedabu98
    ahmedabu98 committed Feb 6, 2023
    Configuration menu
    Copy the full SHA
    e871919 View commit details
    Browse the repository at this point in the history

  2. merge with head

    @ahmedabu98
    ahmedabu98 committed Feb 6, 2023
    Configuration menu
    Copy the full SHA
    0b2dd77 View commit details
    Browse the repository at this point in the history

Commits on Feb 7, 2023

  1. add both decorators (deleted test-suite stuff to make postcommits tem… 

    …porarily faster)
    @ahmedabu98
    ahmedabu98 committed Feb 7, 2023
    Configuration menu
    Copy the full SHA
    3e46e85 View commit details
    Browse the repository at this point in the history

  2. merge

    @ahmedabu98
    ahmedabu98 committed Feb 7, 2023
    Configuration menu
    Copy the full SHA
    f0ab9b5 View commit details
    Browse the repository at this point in the history

  3. spotless

    @ahmedabu98
    ahmedabu98 committed Feb 7, 2023
    Configuration menu
    Copy the full SHA
    47ffae7 View commit details
    Browse the repository at this point in the history

  4. style

    @ahmedabu98
    ahmedabu98 committed Feb 7, 2023
    Configuration menu
    Copy the full SHA
    8f3c260 View commit details
    Browse the repository at this point in the history

  5. fixes

    @ahmedabu98
    ahmedabu98 committed Feb 7, 2023
    Configuration menu
    Copy the full SHA
    dd07d3c View commit details
    Browse the repository at this point in the history