Releases: treeverse/lakeFS
v0.16.2
Changelog
34185da Diff performance improvement by trim lineage (#921)
148b8e8 Revert "Share lakefs config values between nessie and lakefs containers"
e23adc4 S3 reference and example parameters to work with MinIO
46c7a57 Share lakefs config values between nessie and lakefs containers
a83dc02 add integration test for export
v0.16.1
Changelog
78b6d8f Fix fail export in case export is currently in progress #914
c6674e6 Document export and unhide from CLI #915
825006f WebUI get config called only on create repository #917
19a4357 lakefs init and setup handler share code #919
1d79c2d Fix export to s3 not working due to wrong paths #920
c3fd501 Update ddl/000009_export_current.down.sql
v0.16.0
Note
This release requires running database migration.
The lakeFS service will not run if the migration version isn't compatible with the binary.
Before running the new version you will require to run migrate, with the new version:
$ lakefs migrate up- The older version of lakeFS will not work with the new migration version
Changelog
7a78820 Diff working in a separate goroutine from the merge
365cc9f Fix wrong UI error when repo name contains underscore (on repo creation) 833 (#879) (thanks @Sufiyan1997)
dd4a6fb When uploading a file, the path in the repo should be visible #835 (#866) (thanks @shamikakumar)
24f18e4 Configure AWS clients to retry S3 ops when possible
0416813 "mkdir -p" destination directories for local adapter Put, Copy
8e579d0 Add export state logic and tests
328b134 Align repo id to repo name (#874)
9dddbac Change export tasks generation to be iterative
da896de Create extension pgcrypto in "public" schema
5b4d41d DB scanner options by value with an option to update AdditionalWhere
9ebd4d7 Enable GetCommit to work when branch name, returns the last commit on branch
cccb491 Explicitly use PUBLIC schema
f7c0dbc Fail a task if it retries too many times
9f593f3 Fix repo id to name in the UI (#881)
063ce17 Fixed and responded to all review comments
9dd26be Hide "export" command
725e181 Refactor database to use sql + scany instead of sqlx
c82c549 Remove SQLX usage from parade
bf99b95 Restore a name for dreaded magic number of 5 retries
40f916b SQL - replaced "values" and string concat with array and unnest
a7affc3 Use pgx instead of sql
1eeb2a4 [CR] DROP TABLE... IF EXISTS
72c25aa [CR] Remove probably-unused fields from monitoring
7201f13 [CR] Rename Get -> GetPrimitive, GetStruct -> Get
3ff1f62 [CR] Use standard db:"-" tag, copy all input to convertRawCommit
cf229a5 [CR] cleanups: "go mod tidy", deferred Close wrapped in unneeded func
ccf7ccf [bug] file tasks depend on nothing
4ec6f1d [export] Add current export status to DB
1a369aa [lint] missing error return caught!
5394c77 [lint] use proper Go-style comment for TaskDataColumnNames
1fd05a6 [parade] Move DDL under ddl/
08c9a5c [parade] count failures in direct predecessors, pass them on tasks
e4dbf3b [rebase] Fix dbPool closure in new superuser command
d35ed36 add endpoint for export
88f41e9 add export state - run start and end with a callback between without the need to open a transaction outside of the cataloger fix - missing if error db.ERRNotFound instead of ErrEntryNotFound
d440053 add filtering by relevant commits to branch scanned
332f7c4 add tests for lastKeysInPrefixRegexp
e4fb6ee after merging with changes that happened in the code, and debugging it
04c9489 change ExportConfig action remove sizes from varchar in parade
ae06cf6 change authorization for export commands change error with debug in case parade migration didn't run yet
6df779c change merge isolation level in the merge transaction from serializable to ReadCommitted
c8dd42d change operationID from executeContinuousEcport to RunExport return export ID in API
98a9132 change permissions for executing continuous export
f8cb19b change task_generator tests to work with export ID generator
1916c12 check context just in query execute
78f0f21 count records, table sizes and log errors
77120b3 default output filename for lakefs diagnostics
df06d15 dev compose file - use local dockerfile for our docker-compose
9c0cff6 extended max commits in brench, added limit to sql
de39e35 fix diff same branch run on left side lineage (#875)
fff50f2 fix div thanks to Shamika Kumar (#867) (thanks @shamikakumar)
f85b6e8 fix same branch diff should compare by a checksum (#878)
47bb5af fixed bug in sorting commits, and in deciding when to use "between" instead of
7574553 generate a status file on done
a41923f increase read buffer for branch
a49707e lakefs diagnostics command (#889)
021b307 limit number of commitIDs on branch scanner select
96e6a03 merge from parent - remove accesor branches that did not change from the parent branch
00d3eb2 migrate goto with force support (#872)
be26f36 modify installation documentation to require 1.25.4+ docker-compose version
8355201 modify sql script for commits index name
8a38e7d moving merge activity to doMerge routine
f5c43ae no need to return export status and message in case of error
e54749b preformed gofmt of diff scanner
665ea06 release checklist (#870)
26e2160 remove select * from big tables and use statistics
342ea0f remove size constraint from task id
f53b27c remove trimmedLineage from DBScannerOtions, and move them to lineage scanner
386e103 remove unused GCS parameters
892f092 require export-path flag on export set config command
cce32b6 scanner skip to next path
6cf71d5 show lakefs log on Nessie error (#876)
f8f59fd test code to call collector and verify expected files are collected
c9de871 turn diff into a scanner, and make merge apply the diff changes incrementally
923be9f upgrade react-scripts to v4.0.0 (#886)
v0.15.0
Changelog
8527b2a Add new ReadConfigAction auth action for reading config (#837) (thanks @daniel-shuy )
2a2a8d5 Callhome to collect heartbeats (#841)
4032a01 Configure branch continuous export: Swagger defs and API handlers
1626f37 Diffs are now on references not branches (#863)
89b8b7d Feature/db read entry - read entry/s using simple union sql, instead of the complex views/sqEntriesLineage (#783)
0bba0ca Fixing terraform version bug (#860)
0f923de Implement cataloger current diff using scanners (#790)
0b2f3ba Validate dependencies licenses (#836)
e26816a add option to set a fixed installation ID
bd52e00 bug fix conflict result compare type (#829)
8d333ed change environment variable for installation id to be with underscore instead of dash
1ab4684 change handler to actor document actor
6c6351b child diff simplify check - compare delete and content first (#845)
99e1bd1 diff between two references on the same branch (#842)
b7f7cbc diff with additional fields support (#851)
4a51df8 lakefs new repositories with import branch as parent branch by default (#810)
00c7c08 lakefs superuser command for adding more admin users (#864)
7d7d611 move action_manager to parade document action_manager add data to logs
3021a8a move catalog errors to errors.go (#847)
1270083 remove extra space from error message (#820)
1f3cd72 replace current branching model with a per-use-case set of models (#824)
v0.14.0
Changelog
a38f158 Partial index for uncommitted entries to skip full scan on select changes (#816)
7d1246e Fix lakectl fs list showed first page (#815)
05cd0b0 Repository default branch as create branch default source branch #652 (thanks @iamRishabh07)
b78e5c6 557 lakefs import improve usability (#800)
ab0332a 724 BI collection improvements (#770)
58ab9d1 Merge operation added to benchmark tests (#802)
2020328 Addition of config endpoint to api that currently retrieves only blockstore type and using it in the client (#751)
ee09a87 Allow Nessie reruns by reusing images
0030f9a Replace alert in UI with nice modal in case of delete #653 (thanks @shamikakumar)
dbba26a Improvement/import tool progress indication (#804)
10a211c Override the default Prometheus histogram buckets (#775)
ed47a62 Post-merge broken autogenerated js/swagger.yml
a6d2d6e Requirements doc for task (queue) management API
40643a7 Silence checks warning: don't try to pass difference by reference
f820167 Skip Nessie testing when secrets are unavailable (#789)
252397f Skip benchmark DB snapshot upon delete (#782)
886ca34 Use build number as CloudWatch logs group (#777)
b9c84e5 Use deleteTasks to clean up every test
589b4f0 Use pgx/stdlib to access pgx Conns directly from the DB
be24c89 Wrap all up/down DB migration scripts in a transaction (#772)
32af7f7 Fix misleading error when trying requesting for branches on non-existing repo #528 (thanks @sarathsp06)
87c82b6 Block store adapter copy support
547f5f2 lakefs-loadtest db entry create (#814)
907833a replace repo => repository in logs
v0.13.0
v0.12.0
v0.11.1
v0.11.0
Changelog
81a4672 Import API using lakefs cli (#621)
9794f4c Add manual trigger option to Nessie
efdafc7 Benchmark ListEffectivePolicies (#638)
876317a Database interface align with Tx (#642)
b3a608e Fix empty dump from nessie's runs (#633)
4bace3e Fix merge after delete (#622)
4933197 Merge pull request #660 from treeverse/feature/manual-actions
46216dd Remove "Forums (coming soon)" from Community page (#646)
157cb71 Removing coming soon from community.md (#651)
604beba Try again without an explicit branch specification
af4b76d Basic welcome banner to lakeFS run (#635)
b2568aa Bugfix in import branch creation (#664)
c96a006 Change compose execution in quickstart and README (#640)
e0410fd Nessie control stats and ignore all dev versions when post stats (#626)
2b7fcf2 Remove unused and fail before access nil values (#624)
eb57df4 Updated node-forge to fix CVE-2020-7720 (#637)