Code

Migrate to KfpV2 #477

Code

Merged

RobbeSneyders merged 34 commits intomainml6team/fondant:mainfrom feature/kfp-v2ml6team/fondant:feature/kfp-v2Copy head branch name to clipboardOct 11, 2023

+2,440-1,256

Commits

Commits on Oct 2, 2023

• Feature/vertex compiler (#411)

  GeorgesLorre

  committed
  17451c5

  Copy full SHA for 17451c5

• Add vertex runner (#429)

  Show description for 52102a5
  GeorgesLorre

  committed
  52102a5

  Copy full SHA for 52102a5

• Add hardware configs (#433)

  Show description for a0ea8e4
  

  PhilippeMoussalli

  authored and

  GeorgesLorre

  committed
  a0ea8e4

  Copy full SHA for a0ea8e4

• Fix v2 defaults (#436)

  Show description for 65e4553
  

  PhilippeMoussalli

  authored and

  GeorgesLorre

  committed
  65e4553

  Copy full SHA for 65e4553

• Make ComponentSpec the base for arg building

  GeorgesLorre

  committed
  03b1c3b

  Copy full SHA for 03b1c3b

• Make ComponentSpec the base for arg building

  GeorgesLorre

  committed
  6faf90c

  Copy full SHA for 6faf90c

• Feature/no artifacts (#444)

  GeorgesLorre

  committed
  99016d7

  Copy full SHA for 99016d7

• Add more default/optional argument logic

  GeorgesLorre

  committed
  12b74ae

  Copy full SHA for 12b74ae

• Add cluser_type to default args

  GeorgesLorre

  committed
  32a8c04

  Copy full SHA for 32a8c04

• Fix ruff error

  GeorgesLorre

  committed
  e49867b

  Copy full SHA for e49867b

Commits on Oct 9, 2023

• Fix isOptional and defaultValue conversion

  RobbeSneyders

  committed
  cf179f1

  Copy full SHA for cf179f1

• Update runner to use KfP v2 API

  RobbeSneyders

  committed
  55fc4fe

  Copy full SHA for 55fc4fe

• Change input_partition_rows to accept -1 as default

  RobbeSneyders

  committed
  fa14ea0

  Copy full SHA for fa14ea0

• Update load_from_hf_hub defaults

  RobbeSneyders

  committed
  cd82bae

  Copy full SHA for cd82bae

• Update download_images defaults

  RobbeSneyders

  committed
  987054b

  Copy full SHA for 987054b

Commits on Oct 10, 2023

• Merge branch 'main' into feature/kfp-v2

  RobbeSneyders

  committed
  44a7d4d

  Copy full SHA for 44a7d4d

• Merge branch 'main' into feature/kfp-v2

  PhilippeMoussalli

  committed
  74f7099

  Copy full SHA for 74f7099

• re-enable cache

  PhilippeMoussalli

  committed
  347eec4

  Copy full SHA for 347eec4

• Fix tests

  RobbeSneyders

  committed
  c89998c

  Copy full SHA for c89998c

• Update datacomp pipeline

  RobbeSneyders

  committed
  1815d02

  Copy full SHA for 1815d02

• Merge remote-tracking branch 'origin/feature/kfp-v2' into feature/kfp-v2

  RobbeSneyders

  committed
  081422e

  Copy full SHA for 081422e

• Remove python version upper bound

  RobbeSneyders

  committed
  931df56

  Copy full SHA for 931df56

• Re-add test suite for Python 3.11

  RobbeSneyders

  committed
  4342aa8

  Copy full SHA for 4342aa8

• Add Python 3.12 upper bound

  RobbeSneyders

  committed
  a789c03

  Copy full SHA for a789c03

• Add gcp dependencies to vertex extra

  RobbeSneyders

  committed
  2108894

  Copy full SHA for 2108894

• Address PR comments

  RobbeSneyders

  committed
  b778f5e

  Copy full SHA for b778f5e

• Add Python 3.12 trove classifier to pyproject.toml

  RobbeSneyders

  committed
  c7e3a9f

  Copy full SHA for c7e3a9f

• Lower python upper bound to 3.11 again to prevent slow dependency resolving

  RobbeSneyders

  committed
  c6601eb

  Copy full SHA for c6601eb

• Remove 3.11 test suite

  RobbeSneyders

  committed
  d32dffc

  Copy full SHA for d32dffc

• Address PR comments

  RobbeSneyders

  committed
  fef720e

  Copy full SHA for fef720e

• Changes based on self-review

  RobbeSneyders

  committed
  3cb3a27

  Copy full SHA for 3cb3a27

• Update component defaults for kfpv2

  RobbeSneyders

  committed
  35dad13

  Copy full SHA for 35dad13

• Fix tests for kfp 2.3.0

  RobbeSneyders

  committed
  c7ab7d5

  Copy full SHA for c7ab7d5

Commits on Oct 11, 2023

• disable kfpv2 default caching

  PhilippeMoussalli

  committed
  0c6d403

  Copy full SHA for 0c6d403