Code

master merge for 1.4.0 release#2063

Code

Merged

rudolfix merged 53 commits intomasterdlt-hub/dlt:masterfrom develdlt-hub/dlt:develCopy head branch name to clipboardNov 14, 2024

+7,129-2,253

Commits

Commits on Oct 22, 2024

• Move exclude_keys() to dlt.common.utils (#1966)

  burnash

  authored
  9fdd1ee

  Copy full SHA for 9fdd1ee

• Added info to troubleshooting (#1773)

  Show description for 058c09f
  

  dat-a-man

  and

  AstrakhantsevaAA

  authored
  058c09f

  Copy full SHA for 058c09f

Commits on Oct 24, 2024

• minor fix to athena.md documentation (#1983)

  dat-a-man

  authored
  de7cd1f

  Copy full SHA for de7cd1f

• Docs: Fix header to exclude (#1976)

  VioletM

  authored
  11bfae5

  Copy full SHA for 11bfae5

• Docs: updated databricks destination documentation (#1984)

  dat-a-man

  authored
  774ad5c

  Copy full SHA for 774ad5c

• Docs: fix capitalization of some terms, fix typos (#1988)

  burnash

  authored
  00f631d

  Copy full SHA for 00f631d

Commits on Oct 28, 2024

• Explicitly check that _bg_load_job is not None otherwise fallback to parents exception() method. (#1992)

  xneg

  authored
  de43399

  Copy full SHA for de43399

• fix typo (#1995)

  mariarice15

  authored
  11a3ab8

  Copy full SHA for 11a3ab8

• Fix Zendesk example: make test resilient to data changes (#1999)

  Show description for 1933c3d
  burnash

  authored
  1933c3d

  Copy full SHA for 1933c3d

Commits on Oct 29, 2024

• Remove incorrect example (#1932)

  VioletM

  authored
  74cb8a4

  Copy full SHA for 74cb8a4

• feat: add incremental lag for datetime, int, and float cursors (#1957)

  Show description for 3fc9fe4
  

  donotpush

  and

  rudolfix

  authored
  3fc9fe4

  Copy full SHA for 3fc9fe4

• bumps to pre-release 1.3.1a0

  rudolfix

  committed
  4091eb6

  Copy full SHA for 4091eb6

Commits on Oct 30, 2024

• Fix missing GitHub API access token on CI (#2002)

  burnash

  authored
  12a6d4a

  Copy full SHA for 12a6d4a

• loads secrets from colab userdata and steamlit + bugfixes (#1994)

  Show description for 7807f0e
  rudolfix

  authored
  7807f0e

  Copy full SHA for 7807f0e

Commits on Oct 31, 2024

• added session token to duckdb s3 secret (#2007)

  jorritsandbrink

  authored
  75ae23f

  Copy full SHA for 75ae23f

Commits on Nov 1, 2024

• Add user agent for Databricks (#1987)

  VioletM

  authored
  41299ae

  Copy full SHA for 41299ae

• Fix an incorrect missing dependency error (#2001)

  burnash

  authored
  21c6363

  Copy full SHA for 21c6363

• Excludes examles from mypy and flake8 checks (#1969)

  burnash

  authored
  d7bf4a8

  Copy full SHA for d7bf4a8

• fix s3 credentials environment variable names (#2010)

  seunggs

  authored
  350fcb0

  Copy full SHA for 350fcb0

• remove ga add tm (#2008)

  Show description for 4312332
  

  alexanderfifefd

  and

  Alexander Fife

  authored
  4312332

  Copy full SHA for 4312332

Commits on Nov 3, 2024

• 1990 - dataset columns select and limit (#2000)

  Show description for 8c8e413
  

  sh-rp

  and

  rudolfix

  authored
  8c8e413

  Copy full SHA for 8c8e413

Commits on Nov 4, 2024

• Fix pagination issue in JSONResponseCursorPaginator with empty string cursor value (#2016)

  Show description for c11e447
  kang8

  authored
  c11e447

  Copy full SHA for c11e447

• fix: if name of distribution is None (#2024)

  senickel

  authored
  2c82939

  Copy full SHA for 2c82939

• allows to pass default values when writing specs (#2018)

  Show description for e264755
  rudolfix

  authored
  e264755

  Copy full SHA for e264755

• enable delta partitioning on arrow normalizer load id (#2022)

  Show description for 775c41f
  jorritsandbrink

  authored
  775c41f

  Copy full SHA for 775c41f

• Super fast snippet linting & type checking (#2019)

  Show description for b732eb2
  sh-rp

  authored
  b732eb2

  Copy full SHA for b732eb2

Commits on Nov 5, 2024

• Fix the deprecation warning in .common.configuration.container (#2025)

  Show description for e6bd8ea
  burnash

  authored
  e6bd8ea

  Copy full SHA for e6bd8ea

Commits on Nov 6, 2024

• LanceDB - Remove Orphaned Chunks (#1620)

  Show description for c0e4795
  

  Pipboyguy

  and

  rudolfix

  authored
  c0e4795

  Copy full SHA for c0e4795

• Added partial loading example (#1993)

  Show description for 17847f1
  dat-a-man

  authored
  17847f1

  Copy full SHA for 17847f1

• nake title shorter (#2032)

  AstrakhantsevaAA

  authored
  0c6fd65

  Copy full SHA for 0c6fd65

Commits on Nov 7, 2024

• Added deploy with modal. (#1805)

  Show description for f5a64be
  

  3 peopleauthored
  f5a64be

  Copy full SHA for f5a64be

• Updated google cloud function documentation (#2034)

  dat-a-man

  authored
  9c14458

  Copy full SHA for 9c14458

• fix resource level max_table_nesting and normalizer performance tuning (#2026)

  Show description for 62f46db
  sh-rp

  authored
  62f46db

  Copy full SHA for 62f46db

• move default pipelines of cores sources into source folders (#1888)

  Show description for 25550bb
  sh-rp

  authored
  25550bb

  Copy full SHA for 25550bb

• add warning for large delta memory footprint on filesystem docs page (#2036)

  Show description for 95ca6e6
  sh-rp

  authored
  95ca6e6

  Copy full SHA for 95ca6e6

Commits on Nov 8, 2024

• Deploy with Modal: fix indenting (#2040)

  Show description for 5bdf8a3
  AstrakhantsevaAA

  authored
  5bdf8a3

  Copy full SHA for 5bdf8a3

Commits on Nov 9, 2024

• Fix the indent in the modal snippet in the docs (#2043)

  burnash

  authored
  e086bbc

  Copy full SHA for e086bbc

Commits on Nov 10, 2024

• simplify advanced section (#2037)

  kning

  authored
  461a5e1

  Copy full SHA for 461a5e1

Commits on Nov 11, 2024

• Added docs on how to deploy a pipeline using Google Cloud run (#2038)

  Show description for 9df5ecd
  

  dat-a-man

  and

  AstrakhantsevaAA

  authored
  9df5ecd

  Copy full SHA for 9df5ecd

• duckdb filesystem custom secrets (#2017)

  Show description for 208cbce
  sh-rp

  authored
  208cbce

  Copy full SHA for 208cbce

Commits on Nov 12, 2024

• allows for empty dataset clickhouse (#2045)

  Show description for 1e7b70b
  rudolfix

  authored
  1e7b70b

  Copy full SHA for 1e7b70b

• add GCP default credential handling for delta table format (#2048)

  Show description for 21432c7
  jorritsandbrink

  authored
  21432c7

  Copy full SHA for 21432c7

• disable sftp + delta test (#2052)

  Show description for 0192a73
  sh-rp

  authored
  0192a73

  Copy full SHA for 0192a73

• change sanity check duration (#2053)

  sh-rp

  authored
  3ef1d9b

  Copy full SHA for 3ef1d9b

Commits on Nov 13, 2024

• fix bigquery autodetect (#2035)

  Show description for 1346b3b
  sh-rp

  authored
  1346b3b

  Copy full SHA for 1346b3b

• logs warning if deduplication state is large (#1877)

  Show description for 592c797
  

  willi-mueller

  and

  burnash

  authored
  592c797

  Copy full SHA for 592c797

• attempt to disable google discovery cache logging for tests (#2054)

  sh-rp

  authored
  675b309

  Copy full SHA for 675b309

• Add core sources extras to requirements in dlt init (#2028)

  burnash

  authored
  0ea9de7

  Copy full SHA for 0ea9de7

• Formats Delta table section (#2057)

  burnash

  authored
  1387767

  Copy full SHA for 1387767

• Docs: add 'Table formats' category (#2060)

  burnash

  authored
  23b5fd2

  Copy full SHA for 23b5fd2

Commits on Nov 14, 2024

• Fix merge write disposition for pyarrow and ClickHouse (#2042)

  Show description for 93ee867
  burnash

  authored
  93ee867

  Copy full SHA for 93ee867

• re-enable delta tests for read access and other small fixes (#2051)

  Show description for 3dcf2ef
  

  sh-rp

  and

  rudolfix

  authored
  3dcf2ef

  Copy full SHA for 3dcf2ef

• fixes clickhouse adapter test

  rudolfix

  committed
  73b79ee

  Copy full SHA for 73b79ee