Code

pull latest#2

Code

Merged

shamikakumar merged 178 commits intoshamikakumar:mastershamikakumar/lakeFS:masterfrom treeverse:mastertreeverse/lakeFS:masterCopy head branch name to clipboardOct 26, 2020

+8,410-2,532

Commits

Commits on Sep 22, 2020

• Initial DDL: get and return tasks

  arielshaqed

  committed
  9b9c825

• Add simple Go wrapper and test DDL

  Show description for 66f4322
  arielshaqed

  committed
  66f4322

• Return body from own_tasks; test notifications and dependencies

  arielshaqed

  committed
  e0a4ec5

• Test body return in ownTasks

  arielshaqed

  committed
  49c7b05

• Add fan-in benchmark

  Show description for 047ff0d
  arielshaqed

  committed
  047ff0d

• Replace task_dependencies with just a task count

  Show description for 11d24a2
  arielshaqed

  committed
  11d24a2

• Change all constants affecting test DB and benchmark size into flags

  arielshaqed

  committed
  3bf4198

• [bug] Correctly read postgres-url flag and close some object in test

  arielshaqed

  committed
  103eece

• Add DeleteTasks

  Show description for cbc16c7
  arielshaqed

  committed
  cbc16c7

• Use deleteTasks to clean up every test

  Show description for b9c84e5
  arielshaqed

  committed
  b9c84e5

Commits on Sep 23, 2020

• Rename ddl/ddl* -> parade/ddl*

  Show description for e8d76e8
  arielshaqed

  committed
  e8d76e8

Commits on Sep 24, 2020

• Speed up DeleteTasks: load task IDs to delete with COPY FROM

  arielshaqed

  committed
  a43b711

• fix lint errors

  arielshaqed

  committed
  751f1c7

• Add missing dependencies to benchmark

  Show description for ed9cf6a
  arielshaqed

  committed
  ed9cf6a

Commits on Sep 29, 2020

• Requirements doc for task (queue) management API

  Show description for a6d2d6e
  arielshaqed

  committed
  a6d2d6e

• [CR]: more readable docs

  Show description for 156c271
  arielshaqed

  committed
  156c271

• [CR] Remove concurrent dedupe story

  Show description for 7715acc
  arielshaqed

  committed
  7715acc

Commits on Oct 4, 2020

• [CR] More "Id"->"ID"; fix "delete only one dep" test

  arielshaqed

  committed
  6076288

• Use pgx/stdlib to access pgx Conns directly from the DB

  arielshaqed

  committed
  589b4f0

• [CR] Fix TestNotification to work, then fix WaitForTask

  Show description for 346057a
  arielshaqed

  committed
  346057a

• change to db_read_branch - making max commit fixing more undestandable

  tzahij

  committed
  b1751a8

• new branching model page

  Show description for c8af210
  YaelRiv

  committed
  c8af210

• review changes

  nopcoder

  committed
  9cd7062

• Update db_branch_reader.go

  nopcoder

  authored
  5c28e3a

• format code

  nopcoder

  committed
  3057d74

• Update docs/branching/new_branching_models.md

  Show description for 4cef1ac
  

  YaelRiv

  and

  nopcoder

  authored
  4cef1ac

• Update docs/branching/new_branching_models.md

  Show description for 5920b4e
  

  YaelRiv

  and

  nopcoder

  authored
  5920b4e

• Update docs/branching/new_branching_models.md

  Show description for e5fafa3
  

  YaelRiv

  and

  nopcoder

  authored
  e5fafa3

• Update docs/branching/new_branching_models.md

  Show description for 23a2a96
  

  YaelRiv

  and

  nopcoder

  authored
  23a2a96

• Update docs/branching/new_branching_models.md

  Show description for c77d259
  

  YaelRiv

  and

  nopcoder

  authored
  c77d259

• Update docs/branching/new_branching_models.md

  Show description for b45610f
  

  YaelRiv

  and

  nopcoder

  authored
  b45610f

• Update docs/branching/new_branching_models.md

  Show description for 52b1ed3
  

  YaelRiv

  and

  nopcoder

  authored
  52b1ed3

• Update docs/branching/new_branching_models.md

  Show description for 94a6a0b
  

  YaelRiv

  and

  nopcoder

  authored
  94a6a0b

• Update docs/branching/new_branching_models.md

  Show description for 1043269
  

  YaelRiv

  and

  nopcoder

  authored
  1043269

Commits on Oct 5, 2020

• Merge pull request #762 from treeverse/docs/new-branching-model

  Show description for fe608de
  YaelRiv

  authored
  fe608de

• branch iterator without initialBuf

  nopcoder

  committed
  76ab3bf

• Merge pull request #761 from treeverse/feature/db_read_entry

  Show description for a71ee9b
  tzahij

  authored
  a71ee9b

• Update new_branching_models.md

  YaelRiv

  authored
  f24b62f

• Update new_branching_models.md

  YaelRiv

  authored
  d726d49

• Merge pull request #609 from treeverse/docs/task-manager-api

  Show description for c8150dd
  arielshaqed

  authored
  c8150dd

• Update README.md set badges align to center (#766)

  nopcoder

  authored
  51b25db

• catalog repo delete - add entries (#731)

  nopcoder

  authored
  fae9815

Commits on Oct 6, 2020

• Fix race condition in listening for notifications

  Show description for f015b26
  arielshaqed

  committed
  f015b26

• Test starting parade task waiter before and after task done

  arielshaqed

  committed
  1edca50

• Fix checks

  arielshaqed

  committed
  6f6d8d9

• Extend tasks ownership

  Show description for 895b955
  arielshaqed

  committed
  895b955

• Add test that cannot extend ownership of task that's been taken

  arielshaqed

  committed
  58ab826

• Improve message on ErrInvalidToken

  arielshaqed

  committed
  d5989e9

• [CR] Remove trailing "deadline was extended" from comment

  Show description for a782911
  arielshaqed

  committed
  a782911

• Rename ddl_test -> parade_test for parade interface refactor

  arielshaqed

  committed
  c2b49d3

• Addition of config endpoint to api that currently retrieves only blockstore type and using it in the client (#751)

  Show description for 2020328
  

  eylonronen

  and

  arielshaqed

  authored
  2020328

• Make a Parade interface

  Show description for 3a6f13b
  arielshaqed

  committed
  3a6f13b

• Fix checks

  Show description for 63421c6
  arielshaqed

  committed
  63421c6

• Add wrapper to prefix all Parade IDs with a string

  Show description for 435f5e7
  arielshaqed

  committed
  435f5e7

• Update faq.md (#754)

  Vibhuti1402agg

  authored
  32ee580

• Wrap all up/down DB migration scripts in a transaction (#772)

  Show description for be24c89
  arielshaqed

  authored
  be24c89

• [CR] Make SQL idempotent and clean it up

  arielshaqed

  committed
  f4c4cfd

• 724 bi collection improvments (#770)

  Show description for ab0332a
  johnnyaug

  authored
  ab0332a

• 588 benchmark ECS container that scrapes the benchmark env for its prometheus metrics.

  itaiad200

  authored
  0f28d4d

• [CR] SQL cleanups

  arielshaqed

  committed
  342b6a3

• Merge pull request #641 from treeverse/feature/parade-delete

  Show description for 0a0e7d9
  arielshaqed

  authored
  0a0e7d9

• Merge pull request #668 from treeverse/feature/parade-extend

  Show description for 4d3d5e2
  arielshaqed

  authored
  4d3d5e2

• Merge pull request #765 from treeverse/feature/parade-interface

  Show description for 783fcf2
  arielshaqed

  authored
  783fcf2

• [parade] Rename columns for signalling after task to reflect this (#778)

  Show description for 5ef678f
  arielshaqed

  authored
  5ef678f

Commits on Oct 7, 2020

• Implemented #653

  shamikakumar

  committed
  0030f9a

• changed tags to self-closing

  shamikakumar

  committed
  3e7cac1

• Merge pull request #767 from shamikakumar/fix/delete-modal-#653

  Show description for c70ae53
  guy-har

  authored
  c70ae53

• Use build number as CloudWatch logs group (#777)

  itaiad200

  authored
  886ca34

• Skip benchmark DB snapshot upon delete (#782)

  itaiad200

  authored
  252397f

Commits on Oct 8, 2020

• [#528] fix misleading error when trying requesting for brnaches on non-existing repo

  sarathsp06

  committed
  32af7f7

• docs: add contributors file (#690)

  daniloff200

  authored
  2d1e882

• Override the default prometheus histogram buckets (#775)

  itaiad200

  authored
  10a211c

• document merge after import (#788)

  johnnyaug

  authored
  5430abc

• Skip Nessie testing when secrets are unavailable (#789)

  itaiad200

  authored
  f820167

• replace repo => repository in logs

  sarathsp06

  committed
  907833a

Commits on Oct 9, 2020

• Merge pull request #784 from sarathsp06/master

  Show description for 8f8824d
  guy-har

  authored
  8f8824d

Commits on Oct 11, 2020

• add copy to adapter

  guy-har

  committed
  87c82b6

• Update block/gs/adapter.go

  Show description for 89cbd38
  

  guy-har

  and

  arielshaqed

  authored
  89cbd38

• use os.Open

  Show description for dd2b78a
  guy-har

  committed
  dd2b78a

• return error

  guy-har

  committed
  a938576

• Merge pull request #797 from treeverse/feature/adapter-copy

  Show description for 4b38e9d
  guy-har

  authored
  4b38e9d

• Update contributing.md

  YaelRiv

  authored
  0b3ddd9

• Update README.md

  YaelRiv

  authored
  36a1aa6

• Update README.md

  YaelRiv

  authored
  e0452b0

• Update README.md

  YaelRiv

  authored
  3599e16

• Update README.md

  YaelRiv

  authored
  06132ba

Commits on Oct 12, 2020

• 557 import tool usability (#800)

  Show description for b78e5c6
  johnnyaug

  authored
  b78e5c6

• fixed sql-error-441

  ari-hacks

  committed
  72c044b

Commits on Oct 13, 2020

• Allow Nessie reruns by reusing images

  indhupriya

  authored
  ee09a87

• add export action

  Show description for bb27f46
  guy-har

  committed
  bb27f46

• Add merge operation to benchmark tests (#802)

  itaiad200

  authored
  58ab9d1

• Improvement/import tool progress indication (#804)

  Show description for dbba26a
  johnnyaug

  authored
  dbba26a

• add touch handle

  Show description for 3cb0660
  guy-har

  committed
  3cb0660

• add logs to export handler

  guy-har

  committed
  9188e6f

Commits on Oct 14, 2020

• Fix task status docs (#812)

  Show description for 1cea346
  arielshaqed

  authored
  1cea346

• Add explicit TaskStatusCodeValue handling on DB

  Show description for 495fa86
  arielshaqed

  committed
  495fa86

• Handle num_signals column on database insert

  Show description for 8308282
  arielshaqed

  committed
  8308282

• Extract function scanIDs in tests

  arielshaqed

  committed
  039ea6a

• Handle deleting aborted and completed tasks

  Show description for 7f23042
  arielshaqed

  committed
  7f23042

• Add all of Entry to Difference

  Show description for d284cea
  arielshaqed

  committed
  d284cea

• Add task generator for export operation

  arielshaqed

  committed
  e406b8e

• Create success tasks for nested directories

  arielshaqed

  committed
  fc2b960

• Post-merge broken autogenerated js/swagger.yml

  Show description for ed47a62
  arielshaqed

  committed
  ed47a62

• Silence checks warning: don't try to pass difference by reference

  Show description for 40643a7
  arielshaqed

  committed
  40643a7

• Post-merge: update Difference Entry field

  Show description for aaddf19
  arielshaqed

  committed
  aaddf19

• [CR] Fix CopyAction typo; use single const declaration

  arielshaqed

  committed
  c9c93b2

• [CR] Generate "success" file at top-level if required by predicate

  Show description for 5de8c62
  arielshaqed

  committed
  5de8c62

• [CR] Rename constructor "make" -> "new"

  Show description for b54114c
  arielshaqed

  committed
  b54114c

• [CR] Traverse success dirs using LIFO collection (slice) not queue

  Show description for 842d5cd
  arielshaqed

  committed
  842d5cd

• [CR] Clean up: func comment, merge switch cases, reduce initial task slice

  arielshaqed

  committed
  0b076f5

• [CR] improve and refine error reporting in tests

  arielshaqed

  committed
  d7eb030

• Merge pull request #803 from treeverse/feature/534-diff-to-tasks

  Show description for 6763612
  arielshaqed

  authored
  6763612

• #652 select the default branch as source (#805)

  Show description for 05cd0b0
  fumblehool

  authored
  05cd0b0

• bugfix lakectl fs list showed first page (#815)

  nopcoder

  authored
  7d1246e

• loadtest db entry create (#814)

  nopcoder

  authored
  547f5f2

• [export] refactor generate tasks from diffs (#813)

  Show description for 6b46312
  arielshaqed

  authored
  6b46312

• Update action/action_manager.go

  Show description for 53b99e3
  

  guy-har

  and

  arielshaqed

  authored
  53b99e3

• Update action/action_manager_test.go

  Show description for 1f38d24
  

  guy-har

  and

  arielshaqed

  authored
  1f38d24

• adding partial index for uncommitted entries (#816)

  tzahij

  authored
  a38f158

Commits on Oct 15, 2020

• move action_manager to parade

  Show description for 7d7d611
  guy-har

  committed
  7d7d611

• Merge branch 'master' into feature/action-export

  guy-har

  committed
  9a4a24d

• Feature/db read entry - read entry/s using simple union sql, instead of the complex views/sqEntriesLineage (#783)

  tzahij

  authored
  89b8b7d

• remove extra space from error message (#820)

  nopcoder

  authored
  1270083

• lakefs new repositories with import branch as parent branch by default (#810)

  nopcoder

  authored
  4a51df8

• align export handler with task_generator

  guy-har

  committed
  42dbc8d

• replace current branching model with a per-use-case set of models (#824)

  ozkatz

  authored
  1f3cd72

• add option to set a fixed installation ID

  guy-har

  committed
  e26816a

Commits on Oct 16, 2020

• removing redundent complex calculation from merge_from_parent

  tzahij

  committed
  cfe32bf

Commits on Oct 17, 2020

• Update cataloger_merge.go

  nopcoder

  authored
  d9720e3

• Merge pull request #827 from treeverse/bugfix/merge-from-parent

  Show description for 4c83a31
  tzahij

  authored
  4c83a31

• filter null values in ctid from diff results table

  tzahij

  committed
  fb9fd60

• this time making the fix in merge from father (as advertised) and not merge from child :-(

  tzahij

  committed
  afd0348

• Merge pull request #830 from treeverse/bugfix/merge_from_parent_filter_null_ctid

  Show description for 445f447
  tzahij

  authored
  445f447

Commits on Oct 18, 2020

• bug fix conflict result compare type (#829)

  nopcoder

  authored
  bd52e00

• action_manager clean up

  guy-har

  committed
  59ce972

• Update parade/action_manager.go

  Show description for 9889d43
  

  guy-har

  and

  arielshaqed

  authored
  9889d43

• change handler to actor

  Show description for 1ab4684
  guy-har

  committed
  1ab4684

• Merge pull request #826 from treeverse/feature/fixed-installation-id

  Show description for d56db9e
  guy-har

  authored
  d56db9e

Commits on Oct 19, 2020

• change environment variable for installation id

  Show description for 8d333ed
  guy-har

  committed
  8d333ed

• Merge pull request #840 from treeverse/fix/env-installation-id

  Show description for baadd89
  guy-har

  authored
  baadd89

• Implement cataloger current diff using scanners (#790)

  nopcoder

  authored
  0f923de

• Added interactive Katacoda tutorial to lakeFS docs (#823)

  ozkatz

  authored
  d6b1249

• fix imports

  guy-har

  committed
  1cc4ec1

• fix linter errors

  guy-har

  committed
  53b0028

• Update README.md

  YaelRiv

  authored
  b5dbba1

• Update README.md

  YaelRiv

  authored
  d312bce

• fix race condition

  guy-har

  committed
  0abbda0

• Add DDL and cataloger functions configuring branch continuous export

  arielshaqed

  committed
  a34dcf4

• Configure branch continuous export: Swagger defs and API handlers

  arielshaqed

  committed
  4032a01

• [checks] Format in accordance with golangci

  Show description for 56b0acf
  arielshaqed

  committed
  56b0acf

• Use regexp array directly in LastKeysInPrefixRegexp

  Show description for 39e6c1a
  arielshaqed

  committed
  39e6c1a

• Test (and fix...) GetExportConfigurations

  Show description for b8ca672
  arielshaqed

  committed
  b8ca672

Commits on Oct 20, 2020

• Validate dependencies licenses (#836)

  Show description for 0b2f3ba
  daniel-shuy

  authored
  0b2f3ba

• Callhome to collect heartbeats (#841)

  itaiad200

  authored
  2a2a8d5

• move catalog errors to errors.go (#847)

  nopcoder

  authored
  3021a8a

• diff between two references on the same branch (#842)

  nopcoder

  authored
  99e1bd1

• Add new ReadConfigAction auth action for reading config (#837)

  Show description for 8527b2a
  daniel-shuy

  authored
  8527b2a

Commits on Oct 21, 2020

• Merge pull request #807 from treeverse/feature/action-export

  Show description for 36a5a8d
  guy-har

  authored
  36a5a8d

• child diff simplify check - compare delete and content first (#845)

  nopcoder

  authored
  6c6351b

• diff with additional fields support (#851)

  Show description for b7f7cbc
  nopcoder

  authored
  b7f7cbc

• Import documentation update, remove the UI and API description (#856)

  nopcoder

  authored
  c170e80

• [CR] cleanups

  arielshaqed

  committed
  4245f11

• fix(docs): small grammar fixes & not correct words

  daniloff200

  committed
  a152f05

• Merge pull request #854 from daniloff200/couple-grammar-fixes

  Show description for 5d4cb99
  arielshaqed

  authored
  5d4cb99

Commits on Oct 22, 2020

• Merge pull request #844 from treeverse/feature/534-management-api

  Show description for 7a8ca25
  arielshaqed

  authored
  7a8ca25

• Add post-{commit,merge}

  Show description for 1963648
  arielshaqed

  committed
  1963648

• [CR] Catalog test patches

  Show description for 4538ae7
  

  arielshaqed

  and

  nopcoder

  committed
  4538ae7

• [CR] Use testCreateEntry in more tests

  arielshaqed

  committed
  67aa5a2

• [CR] Rename GetHooks, add separate merge hooks tests

  Show description for 1d173cb
  arielshaqed

  committed
  1d173cb

• [CR] suggestions: better commit test

  Show description for 646e9e0
  

  arielshaqed

  and

  nopcoder

  authored
  646e9e0

• Simplify hook success/failure tests with an external hooks object

  arielshaqed

  committed
  5000139

• Merge pull request #857 from treeverse/feature/534-hooks

  Show description for cf0d129
  arielshaqed

  authored
  cf0d129

• fix/sql error 4441-2

  ari-hacks

  committed
  ebe2ba2

• fixing lint error

  ari-hacks

  committed
  2fc30b9

• Fixing terraform version bug (#860)

  itaiad200

  authored
  0bba0ca

Commits on Oct 23, 2020

• Update index.md

  YaelRiv

  authored
  c41ff2c

Commits on Oct 25, 2020

• Merge pull request #806 from ari-hacks/fix/sql-error-441

  Show description for cf0454f
  arielshaqed

  authored
  cf0454f

• Diffs are now on references not branches (#863)

  Show description for 1626f37
  arielshaqed

  authored
  1626f37