Commit f563dbc
Merge OSS main branch + adoptions (#51)
* Policy Store: PolicyMappingRecord with Persistence Impl (apache#1104)
* Spark: Setup repository code structure and build (apache#1190)
* Added freshness aware table loading using metadata file location for ETag (apache#1037)
* Pulled in iceberg 1.8.0 spec changes for freshness aware table loading and added feature to Polaris
* Changed etag support to use entityId:version tuple
* fixed getresponse call
* Changed etagged response to record and gave default implementation to ETaggableEntity
* Made iceberg rest spec docs clearer
* Added HTTP Compliant ETag and IfNoneMatch representations and separated persistence from etag logic
* Changed ETag to be a record and improved semantics of IfNoneMatch
* Fixed semantics of if none match
* Removed ETag representation, consolidated in IfNoneMatch
* fixed if none match parsing
* Added table entity retrieval method to table operations
* removed accidental commit of pycache folders
* Fixed formatting
* Changed to use metadata location hash
* Ran formatting
* use sha256
* Moved out ETag functions to utility class and removed ETaggedLoadTableResponse
* Addressed comments
* Fixed IcebergTableLikeEntity package rename
* main: Update dependency io.opentelemetry.semconv:opentelemetry-semconv to v1.31.0 (apache#1288)
* Update LICENSE and NOTICE in the distributions (admin and server) (apache#1258)
* Gradle/Quarkus: make imageBuild task depend on jandex (apache#1290)
* Core: Clarify the atomicity of BasePersistence methods (apache#1274)
* Implement GenericTableCatalogAdapter (apache#1264)
* rebase
* more fixes
* autolint
* working on tests
* stable test
* autolint
* polish
* changes per review
* some changes per review
* grants
* autolint
* changes per review
* changes per review
* typofix
* Improve code-containment and efficiency of etag-aware loading (apache#1296)
* Improve code-containment and efficiency of etag-aware loading
-Make the hash generation resilient against null metadataLocation
-Use getResolvedPath instead of getPassthroughResolvedPath to avoid redundant persistence round-trip
-Only try to calculate the etag for comparison against ifNoneMatch if the ifNoneMatch is actually provided
* Add strict null-checking at callsites to generateETag, disallow passing null to generator
* Add TODO to refactor shared logic for etag generation
* Core: Add Endpoints and resource paths for Generic Table (apache#1286)
* main: Update dependency com.nimbusds:nimbus-jose-jwt to v10.1 (apache#1299)
* [JDBC] Part1 : ADD SQL script for Polaris setup (apache#1276)
* main: Update registry.access.redhat.com/ubi9/openjdk-21-runtime Docker tag to v1.22-1.1743605859 (apache#1300)
* done (apache#1297)
* Add Polaris Community Meeting for April 3, 2025 (apache#1304)
* Use config-file to define errorprone rule (apache#1233)
Also enabled a couple more simple rules, and adding suppressions/fixes for/to the code.
The two rules `EqualsGetClass` and `UnusedMethod`, which I think are useful, are not enabled yet, because that would mean actual code changes, which I do not want to do in this PR.
The rule `PatternMatchingInstanceof`, introduced in apache#393, is disabled in this PR. It does not work before errorrpone 2.37.0 (via apache#1213) - requires additional changes to enable the rule (see apache#1215).
* Add Yun as a contributor (apache#1310)
* Refactor CatalogHandler to comply with ErrorProne rules (apache#1312)
Fix the CI error after apache#1233
* Implement PolicyCatalog Stage 1: CRUD + ListPolicies (apache#1294)
* main: Update dependency io.opentelemetry:opentelemetry-bom to v1.49.0 (apache#1316)
* main: Update docker.io/jaegertracing/all-in-one Docker tag to v1.68.0 (apache#1317)
* main: Update dependency boto3 to v1.37.28 (apache#1328)
* main: Update dependency software.amazon.awssdk:bom to v2.31.16 (apache#1329)
* Make `BasePolaritsMetaStoreManagerTest` and `(Base)ResolverTest` reusable (apache#1308)
Moves the test cases into the `Base*` classes and make sure the classes can be reused by other persistence implementations.
* main: Update dependency io.opentelemetry.semconv:opentelemetry-semconv to v1.32.0 (apache#1293)
* main: Update mockito monorepo to v5.17.0 (apache#1311)
* PySpark Update AWS Region (apache#1302)
Co-authored-by: Travis Bowen <travis.bowen@snowflake.com>
* main: Update dependency com.nimbusds:nimbus-jose-jwt to v10.2 (apache#1334)
* main: Update dependency com.diffplug.spotless:spotless-plugin-gradle to v7.0.3 (apache#1335)
* Maven publication: Produce correct `<scm><tag>` in `pom.xml` (apache#1330)
`project.scm.tag` in a Maven pom is intended to refer to the SCM (Git) tag. We currently publish `main`, which is incorrect.
This change omits the SCM tag for snapshot builds, but emits the Git tag for releases.
* Remove `@StaticInitSafe` annotation (apache#1331)
There was an issue around mapped configurations having the `@StaticInitSafe` annotation that led to _two_ instances (a "static" one and a "somewhet application-scoped" one) - this was fixed in Quarkus 3.21. One bug in smallrye-config is fixed for Quarkus > 3.21.0, another issue however remains.
Since `@StaticInitSafe` annotated configs seem to cause some weird issues, it seems legit to remote that annotation altogether. This approach was [taken in Nessie](projectnessie/nessie#10606) as well. Investigations (via practical experiments) have proven that there's no measurable impact (runtime + heap) when doing this - and that's also been confirmed by Quarkus + Smallrye-config maintainers.
Hence this change remotes that annotation from the code base.
* Build/Release: Add a "generate digest" task and use for source tarball and Quarkus distributables (apache#1271)
* Ensure that digest and signature are generated for both Polaris-Server and admin tar/zip distribution
* Move "generate digest" functionality to a Gradle task
* main: Update dependency com.google.errorprone:error_prone_core to v2.37.0 (apache#1213)
* main: Update Quarkus Platform and Group to v3.21.1 (apache#1291)
* main: Update dependency io.netty:netty-codec-http2 to v4.2.0.Final (apache#1301)
* Adoptions after merge
---------
Co-authored-by: Honah (Jonas) J. <honahx@apache.org>
Co-authored-by: gh-yzou <167037035+gh-yzou@users.noreply.github.com>
Co-authored-by: Mansehaj Singh <msehajs@gmail.com>
Co-authored-by: Mend Renovate <bot@renovateapp.com>
Co-authored-by: JB Onofré <jbonofre@apache.org>
Co-authored-by: Alexandre Dutra <adutra@users.noreply.github.com>
Co-authored-by: Yufei Gu <yufei@apache.org>
Co-authored-by: Eric Maynard <eric.maynard+oss@snowflake.com>
Co-authored-by: Dennis Huo <7410123+dennishuo@users.noreply.github.com>
Co-authored-by: Prashant Singh <35593236+singhpk234@users.noreply.github.com>
Co-authored-by: Travis Bowen <122238243+travis-bowen@users.noreply.github.com>
Co-authored-by: Travis Bowen <travis.bowen@snowflake.com>1 parent d116c7e commit f563dbc
File tree
58 files changed
+1544
-153
lines changed- api/polaris-catalog-service
- src/main/java/org/apache/polaris/service/types
- build-logic/src/main/kotlin
- publishing
- client/python
- codestyle
- extension/persistence/eclipselink
- src/main/java/org/apache/polaris/extension/persistence/impl/eclipselink
- getting-started/telemetry
- gradle
- nosql
- async/api/src/main/java/org/apache/polaris/async
- nodes/api/src/main/java/org/apache/polaris/nodes/api
- persistence
- api/src/main/java/org/apache/polaris/persistence/api
- backend
- cache/src/main/java/org/apache/polaris/persistence/cache
- cdi/quarkus/src/main/java/org/apache/polaris/persistence/quarkus/backend
- db
- inmemory/src/main/java/org/apache/polaris/persistence/inmemory
- mongodb/src/main/java/org/apache/polaris/persistence/mongodb
- polaris-core
- src/main/java/org/apache/polaris/core
- catalog
- config
- policy/exceptions
- storage/aws
- quarkus
- admin
- src/main/java/org/apache/polaris/admintool/config
- server
- service/src
- main/java/org/apache/polaris/service/quarkus
- auth
- catalog/io
- config
- context
- logging
- metrics
- persistence
- ratelimiter
- storage
- task
- test/java/org/apache/polaris/service/quarkus
- catalog
- ratelimiter
- regtests/t_pyspark/src
- service/common
- src
- main/java/org/apache/polaris/service
- auth
- catalog
- common
- policy
- config
- exception
- ratelimiter
- task
- testFixtures/java/org/apache/polaris/service/catalog
Some content is hidden
Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.
58 files changed
+1544
-153
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
72 | 72 | | |
73 | 73 | | |
74 | 74 | | |
| 75 | + | |
75 | 76 | | |
76 | 77 | | |
77 | 78 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
36 | 36 | | |
37 | 37 | | |
38 | 38 | | |
39 | | - | |
40 | 39 | | |
41 | 40 | | |
42 | 41 | | |
| |||
59 | 58 | | |
60 | 59 | | |
61 | 60 | | |
| 61 | + | |
62 | 62 | | |
63 | 63 | | |
64 | 64 | | |
| |||
103 | 103 | | |
104 | 104 | | |
105 | 105 | | |
| 106 | + | |
| 107 | + | |
| 108 | + | |
106 | 109 | | |
107 | 110 | | |
108 | 111 | | |
| |||
Lines changed: 140 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
| 41 | + | |
| 42 | + | |
| 43 | + | |
| 44 | + | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
| 51 | + | |
| 52 | + | |
| 53 | + | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
| 58 | + | |
| 59 | + | |
| 60 | + | |
| 61 | + | |
| 62 | + | |
| 63 | + | |
| 64 | + | |
| 65 | + | |
| 66 | + | |
| 67 | + | |
| 68 | + | |
| 69 | + | |
| 70 | + | |
| 71 | + | |
| 72 | + | |
| 73 | + | |
| 74 | + | |
| 75 | + | |
| 76 | + | |
| 77 | + | |
| 78 | + | |
| 79 | + | |
| 80 | + | |
| 81 | + | |
| 82 | + | |
| 83 | + | |
| 84 | + | |
| 85 | + | |
| 86 | + | |
| 87 | + | |
| 88 | + | |
| 89 | + | |
| 90 | + | |
| 91 | + | |
| 92 | + | |
| 93 | + | |
| 94 | + | |
| 95 | + | |
| 96 | + | |
| 97 | + | |
| 98 | + | |
| 99 | + | |
| 100 | + | |
| 101 | + | |
| 102 | + | |
| 103 | + | |
| 104 | + | |
| 105 | + | |
| 106 | + | |
| 107 | + | |
| 108 | + | |
| 109 | + | |
| 110 | + | |
| 111 | + | |
| 112 | + | |
| 113 | + | |
| 114 | + | |
| 115 | + | |
| 116 | + | |
| 117 | + | |
| 118 | + | |
| 119 | + | |
| 120 | + | |
| 121 | + | |
| 122 | + | |
| 123 | + | |
| 124 | + | |
| 125 | + | |
| 126 | + | |
| 127 | + | |
| 128 | + | |
| 129 | + | |
| 130 | + | |
| 131 | + | |
| 132 | + | |
| 133 | + | |
| 134 | + | |
| 135 | + | |
| 136 | + | |
| 137 | + | |
| 138 | + | |
| 139 | + | |
| 140 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
17 | 17 | | |
18 | 18 | | |
19 | 19 | | |
| 20 | + | |
| 21 | + | |
20 | 22 | | |
21 | 23 | | |
22 | 24 | | |
| |||
41 | 43 | | |
42 | 44 | | |
43 | 45 | | |
44 | | - | |
45 | | - | |
46 | | - | |
47 | | - | |
48 | | - | |
49 | | - | |
50 | | - | |
51 | | - | |
52 | | - | |
53 | | - | |
| 46 | + | |
| 47 | + | |
| 48 | + | |
54 | 49 | | |
55 | 50 | | |
| 51 | + | |
| 52 | + | |
| 53 | + | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
| 58 | + | |
| 59 | + | |
| 60 | + | |
| 61 | + | |
| 62 | + | |
56 | 63 | | |
57 | 64 | | |
58 | 65 | | |
| |||
Lines changed: 0 additions & 6 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
49 | 49 | | |
50 | 50 | | |
51 | 51 | | |
52 | | - | |
53 | | - | |
54 | | - | |
55 | | - | |
56 | | - | |
57 | | - | |
58 | 52 | | |
59 | 53 | | |
60 | 54 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
103 | 103 | | |
104 | 104 | | |
105 | 105 | | |
106 | | - | |
| 106 | + | |
| 107 | + | |
| 108 | + | |
| 109 | + | |
107 | 110 | | |
108 | 111 | | |
109 | 112 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
| 41 | + | |
| 42 | + | |
| 43 | + | |
| 44 | + | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
| 51 | + | |
| 52 | + | |
| 53 | + | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
| 58 | + | |
| 59 | + | |
| 60 | + | |
| 61 | + | |
| 62 | + | |
| 63 | + | |
| 64 | + | |
| 65 | + | |
| 66 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
61 | 61 | | |
62 | 62 | | |
63 | 63 | | |
64 | | - | |
65 | | - | |
66 | | - | |
67 | | - | |
68 | | - | |
69 | | - | |
70 | | - | |
| 64 | + | |
| 65 | + | |
| 66 | + | |
| 67 | + | |
| 68 | + | |
| 69 | + | |
| 70 | + | |
| 71 | + | |
71 | 72 | | |
72 | | - | |
73 | 73 | | |
74 | 74 | | |
75 | 75 | | |
76 | 76 | | |
77 | | - | |
78 | | - | |
79 | | - | |
80 | | - | |
81 | | - | |
82 | | - | |
| 77 | + | |
| 78 | + | |
| 79 | + | |
| 80 | + | |
| 81 | + | |
| 82 | + | |
| 83 | + | |
| 84 | + | |
83 | 85 | | |
84 | | - | |
85 | 86 | | |
86 | 87 | | |
87 | 88 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
23 | 23 | | |
24 | 24 | | |
25 | 25 | | |
26 | | - | |
27 | 26 | | |
28 | 27 | | |
29 | | - | |
30 | 28 | | |
31 | 29 | | |
32 | 30 | | |
| |||
58 | 56 | | |
59 | 57 | | |
60 | 58 | | |
61 | | - | |
62 | | - | |
63 | | - | |
64 | | - | |
65 | | - | |
66 | | - | |
67 | | - | |
68 | | - | |
69 | | - | |
70 | | - | |
71 | | - | |
72 | | - | |
73 | | - | |
74 | | - | |
75 | | - | |
76 | | - | |
77 | | - | |
78 | | - | |
79 | | - | |
80 | 59 | | |
81 | 60 | | |
82 | 61 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
36 | 36 | | |
37 | 37 | | |
38 | 38 | | |
39 | | - | |
| 39 | + | |
40 | 40 | | |
41 | 41 | | |
42 | 42 | | |
| |||
0 commit comments