Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

uploadContentHandler Handle doesn't use load.FieldDelimiter for CSV loading #329

Open
juguerre opened this issue Jun 29, 2024 · 0 comments
Labels
bug Something isn't working

Comments

@juguerre
Copy link

What happened?

When bigquery python library is used for load job definition like:

job_config = bigquery.LoadJobConfig(
        source_format=bigquery.SourceFormat.CSV, schema=table.schema,
        field_delimiter=";", max_bad_records=0, skip_leading_rows=0, allow_jagged_rows=True
    )

load_job = bigquery_client.load_table_from_uri( ...

field_delimiter parameter is loaded but is never used in the emulator server. So the server is always expecting comma as field delimiter ignoring this configuration parameter.
In this situation is not possible to load CSV with delimiters different than ',' (comma).

What did you expect to happen?

Supporting single string characters for FieldDelimiter parameter is expected.

How can we reproduce it (as minimally and precisely as possible)?

Try to use bigquery_client.load_table_from_uri with a CSV file delimiter different that ','.

Anything else we need to know?

I have a little code change that fixes the issue and I can do a PR if needed/wanted.

@juguerre juguerre added the bug Something isn't working label Jun 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant