Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add support for appending data to external tables - CSV #6526

Merged
merged 44 commits into from
Jun 6, 2023
Merged

Add support for appending data to external tables - CSV #6526

merged 44 commits into from
Jun 6, 2023

Commits on Apr 14, 2023

  1. MemoryExec insert into refactor

    @metesynnada
    metesynnada committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    f40b186 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into enhance/insert_into_as_exec

    @metesynnada
    metesynnada committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    1e45a2c View commit details
    Browse the repository at this point in the history

  3. Merge leftovers

    @metesynnada
    metesynnada committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    7bb7757 View commit details
    Browse the repository at this point in the history

  4. Set target partition

    @metesynnada
    metesynnada committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    741abdb View commit details
    Browse the repository at this point in the history

Commits on Apr 18, 2023

  1. Comment and formatting improvements

    @ozankabak
    ozankabak committed Apr 18, 2023
    Configuration menu
    Copy the full SHA
    242eca0 View commit details
    Browse the repository at this point in the history

  2. Comments on state.

    @metesynnada
    metesynnada committed Apr 18, 2023
    Configuration menu
    Copy the full SHA
    558a468 View commit details
    Browse the repository at this point in the history

Commits on Apr 21, 2023

  1. Merge branch 'main' into enhance/insert_into_as_exec

    @metesynnada
    metesynnada committed Apr 21, 2023
    Configuration menu
    Copy the full SHA
    223b1e4 View commit details
    Browse the repository at this point in the history

  2. ListingTable INSERT INTO support

    @metesynnada
    metesynnada committed Apr 21, 2023
    Configuration menu
    Copy the full SHA
    e0d4dff View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into feature/listing_table_insert_into_support

    @metesynnada
    metesynnada committed Apr 21, 2023
    Configuration menu
    Copy the full SHA
    4d0fe4d View commit details
    Browse the repository at this point in the history

  4. Removing unnecessary code

    @metesynnada
    metesynnada committed Apr 21, 2023
    Configuration menu
    Copy the full SHA
    4e84bbc View commit details
    Browse the repository at this point in the history

  5. Some comments are leftover.

    @metesynnada
    metesynnada committed Apr 21, 2023
    Configuration menu
    Copy the full SHA
    6d117c1 View commit details
    Browse the repository at this point in the history

  6. Compression import error

    @metesynnada
    metesynnada committed Apr 21, 2023
    Configuration menu
    Copy the full SHA
    cd4ab10 View commit details
    Browse the repository at this point in the history

  7. Minor resolutions on cargo docs

    @metesynnada
    metesynnada committed Apr 21, 2023
    Configuration menu
    Copy the full SHA
    41e4bb7 View commit details
    Browse the repository at this point in the history

Commits on May 3, 2023

  1. Merge branch 'main' into feature/listing_table_insert_into_support

    @metesynnada
    metesynnada committed May 3, 2023
    Configuration menu
    Copy the full SHA
    4b11606 View commit details
    Browse the repository at this point in the history

  2. Corrections after merge

    @metesynnada
    metesynnada committed May 3, 2023
    Configuration menu
    Copy the full SHA
    03d5d97 View commit details
    Browse the repository at this point in the history

Commits on May 5, 2023

  1. Make FileWriterExt available

    @metesynnada
    metesynnada committed May 5, 2023
    Configuration menu
    Copy the full SHA
    53d9ca7 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/main' into feature/listing_tab… 

    …le_insert_into_support
    @metesynnada
    metesynnada committed May 5, 2023
    Configuration menu
    Copy the full SHA
    31de586 View commit details
    Browse the repository at this point in the history

  3. Single file support

    @metesynnada
    metesynnada committed May 5, 2023
    Configuration menu
    Copy the full SHA
    997c19a View commit details
    Browse the repository at this point in the history

Commits on May 11, 2023

  1. Resolve linter errors

    @mustafasrepo
    mustafasrepo committed May 11, 2023
    Configuration menu
    Copy the full SHA
    962a03d View commit details
    Browse the repository at this point in the history

Commits on May 12, 2023

  1. Minor changes, simplifications

    @mustafasrepo
    mustafasrepo committed May 12, 2023
    Configuration menu
    Copy the full SHA
    3e0b14f View commit details
    Browse the repository at this point in the history

Commits on May 16, 2023

  1. Merge branch 'main' into feature/listing_table_insert_into_support 

    # Please enter a commit message to explain why this merge is necessary,
# especially if it merges an updated upstream into a topic branch.
#
# Lines starting with '#' will be ignored, and an empty message aborts
# the commit.
    @mustafasrepo
    mustafasrepo committed May 16, 2023
    Configuration menu
    Copy the full SHA
    d8c7d38 View commit details
    Browse the repository at this point in the history

  2. Fix failing tests because of api change

    @mustafasrepo
    mustafasrepo committed May 16, 2023
    Configuration menu
    Copy the full SHA
    d6fc57d View commit details
    Browse the repository at this point in the history

Commits on May 26, 2023

  1. Simplifications

    @ozankabak
    ozankabak committed May 26, 2023
    Configuration menu
    Copy the full SHA
    dd0d47a View commit details
    Browse the repository at this point in the history

  2. Replace block nesting with drop

    @ozankabak
    ozankabak committed May 26, 2023
    Configuration menu
    Copy the full SHA
    bbc535f View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into feature/listing_table_insert_into_support 

    # Conflicts:
#	datafusion/core/src/datasource/file_format/file_type.rs
#	datafusion/core/src/physical_plan/file_format/mod.rs
    @mustafasrepo
    mustafasrepo committed May 26, 2023
    Configuration menu
    Copy the full SHA
    ea6fc47 View commit details
    Browse the repository at this point in the history

  4. remove unnecessary code

    @mustafasrepo
    mustafasrepo committed May 26, 2023
    Configuration menu
    Copy the full SHA
    e717343 View commit details
    Browse the repository at this point in the history

Commits on Jun 1, 2023

  1. Convert to new approach

    @mustafasrepo
    mustafasrepo committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    5a443e9 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into feature/listing_table_insert_into_support2 

    # Conflicts:
#	datafusion/core/src/datasource/listing/table.rs
#	datafusion/core/src/physical_plan/file_format/csv.rs
    @mustafasrepo
    mustafasrepo committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    83f9ded View commit details
    Browse the repository at this point in the history

  3. simplify display

    @mustafasrepo
    mustafasrepo committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    192d5c0 View commit details
    Browse the repository at this point in the history

  4. Update debug display

    @mustafasrepo
    mustafasrepo committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    1a60f49 View commit details
    Browse the repository at this point in the history

  5. use handle err macro

    @mustafasrepo
    mustafasrepo committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    1cd54d0 View commit details
    Browse the repository at this point in the history

  6. Make handle err close all writer in case of error.

    @mustafasrepo
    mustafasrepo committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    de82bda View commit details
    Browse the repository at this point in the history

  7. Merge branch 'main' into feature/listing_table_insert_into_support2 

    # Conflicts:
#	datafusion/core/src/physical_plan/file_format/file_stream.rs
    @mustafasrepo
    mustafasrepo committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    f14ebae View commit details
    Browse the repository at this point in the history

Commits on Jun 2, 2023

  1. Final review, stylistic changes

    @ozankabak
    ozankabak committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    0318ffd View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into feature/listing_table_insert_into_support2 

    # Please enter a commit message to explain why this merge is necessary,
# especially if it merges an updated upstream into a topic branch.
#
# Lines starting with '#' will be ignored, and an empty message aborts
# the commit.
    @mustafasrepo
    mustafasrepo committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    9db8d93 View commit details
    Browse the repository at this point in the history

Commits on Jun 5, 2023

  1. Improve comments

    @ozankabak
    ozankabak committed Jun 5, 2023
    Configuration menu
    Copy the full SHA
    8e591a1 View commit details
    Browse the repository at this point in the history

  2. Move insert into test to the explain.slt

    @mustafasrepo
    mustafasrepo committed Jun 5, 2023
    Configuration menu
    Copy the full SHA
    22b9833 View commit details
    Browse the repository at this point in the history

  3. convert macro to function

    @mustafasrepo
    mustafasrepo committed Jun 5, 2023
    Configuration menu
    Copy the full SHA
    f36ada4 View commit details
    Browse the repository at this point in the history

  4. return error for abort in append mode.

    @mustafasrepo
    mustafasrepo committed Jun 5, 2023
    Configuration menu
    Copy the full SHA
    19fa6d9 View commit details
    Browse the repository at this point in the history

  5. Simplify condition of has header

    @mustafasrepo
    mustafasrepo committed Jun 5, 2023
    Configuration menu
    Copy the full SHA
    31d99cb View commit details
    Browse the repository at this point in the history

  6. Update comments

    @mustafasrepo
    mustafasrepo committed Jun 5, 2023
    Configuration menu
    Copy the full SHA
    8b3eb9c View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2023

  1. Remove file writer factory

    @mustafasrepo
    mustafasrepo committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    39c80e6 View commit details
    Browse the repository at this point in the history

  2. use AbortableWrite struct instead of trait

    @mustafasrepo
    mustafasrepo committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    5ce2303 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into feature/listing_table_insert_into_support2 

    # Conflicts:
#	datafusion/core/src/physical_plan/file_format/mod.rs
    @mustafasrepo
    mustafasrepo committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    72f8e36 View commit details
    Browse the repository at this point in the history