Dremio merge 2025 06 12 11 19 (#85)

* main: Update dependency io.projectreactor.netty:reactor-netty-http to v1.2.7 (apache#1845)

* docs: fix broken 'Polaris Overview' link in README.md (apache#1846)

docs: fix broken 'Polaris Overview' link in README.md

Co-authored-by: Joy Haldar <Joy.Haldar@target.com>

* Update spark client license (apache#1839)

* Update LICENCE (apache#1851)

* Add Yun Zou as the new committer

Co-authored-by: Yufei Gu <yufei.apache.org>

* main: Update docker.io/jaegertracing/all-in-one Docker tag to v1.70.0 (apache#1853)

* main: Update dependency io.opentelemetry.semconv:opentelemetry-semconv to v1.34.0 (apache#1850)

* main: Update dependency boto3 to v1.38.34 (apache#1852)

* main: Update dependency org.postgresql:postgresql to v42.7.7 (apache#1859)

* [SPEC] Add base-location keyword for GenericTable API (apache#1543)

* Update LICENSE for binary distributions (apache#1855)

* Add integration tests to Python Client (apache#1856)

* Update JDBC Getting-started example's README.md to use localhost for curl commands (apache#1872)

* Remove PolarisConfiguration.loadConfig (v2) (apache#1858)

* Enhance EclipseLink quickstart (apache#1870)

1. Update the name catalog name used to `quickstart_catalog` from `polaris` to make it consistent
2. Update the name of `eclipselink-trino-1` to `polaris-trino-1`
3. make the polaris server url consistent with using `localhost` to avoid failures

* Remove generated Python client from git tracking (apache#1810)

After apache#1675, we now generate the Python client on-demand when it's needed by tests or the CLI. With this, we can safely remove the Python client from being tracked in the repo and add its files to .gitignore

* Fix telemetry quickstart example for 1.0 release (apache#1873)

* main: Update gradle/actions digest to ac638b0 (apache#1877)

* main: Update dependency boto3 to v1.38.35 (apache#1874)

* Removing star import and adding errorprone rule (apache#1831)

Fixes apache#1100

* NoSQL: merge related changes

* Last merged commit 0faf948

---------

Co-authored-by: Mend Renovate <bot@renovateapp.com>
Co-authored-by: Joy Haldar <joyno.23@gmail.com>
Co-authored-by: Joy Haldar <Joy.Haldar@target.com>
Co-authored-by: gh-yzou <167037035+gh-yzou@users.noreply.github.com>
Co-authored-by: Yufei Gu <yufei@apache.org>
Co-authored-by: Yun Zou <yunzou.colostate@gmail.com>
Co-authored-by: Honah (Jonas) J. <honahx@apache.org>
Co-authored-by: Eric Maynard <eric.maynard+oss@snowflake.com>
Co-authored-by: William Hyun <william@apache.org>
Co-authored-by: gfakbar20 <gfakbar20@gmail.com>

Author: 10 people

.github/CODEOWNERS

@@ -17,4 +17,4 @@
 # under the License.
 #
 
-* @adutra @annafil @anoopj @ashvina @dennishuo @dimas-b @eric-maynard @jackye1995 @jbonofre @vvcephei @collado-mike @snazy @RussellSpitzer @takidau @MonkeyCanCode @flyrain @ebyhr @ajantha-bhat @HonahX @singhpk234 @pingtimeout
+* @adutra @annafil @anoopj @ashvina @dennishuo @dimas-b @eric-maynard @jackye1995 @jbonofre @vvcephei @collado-mike @snazy @RussellSpitzer @takidau @MonkeyCanCode @flyrain @ebyhr @ajantha-bhat @HonahX @singhpk234 @pingtimeout @gh-yzou

.github/workflows/gradle.yml

@@ -50,7 +50,7 @@ jobs:
       # Configure Gradle for optimal use in GiHub Actions, including caching of downloaded dependencies.
       # See: https://github.com/gradle/actions/blob/main/setup-gradle/README.md
       - name: Setup Gradle
-        uses: gradle/actions/setup-gradle@8379f6a1328ee0e06e2bb424dadb7b159856a326 # v4
+        uses: gradle/actions/setup-gradle@ac638b010cf58a27ee6c972d7336334ccaf61c96 # v4
         with:
           # The setup-gradle action fails, if the wrapper is not using the right version or is not present.
           # Our `gradlew` validates the integrity of the `gradle-wrapper.jar`, so it's safe to disable this.

.github/workflows/nightly.yml

@@ -53,7 +53,7 @@ jobs:
           java-version: '21'
           distribution: 'temurin'
       - name: Setup Gradle
-        uses: gradle/actions/setup-gradle@8379f6a1328ee0e06e2bb424dadb7b159856a326 # v4
+        uses: gradle/actions/setup-gradle@ac638b010cf58a27ee6c972d7336334ccaf61c96 # v4
         with:
           validate-wrappers: false
       - name: Publish SNAPSHOTs to Apache Nexus Repository

.github/workflows/python-client.yml

@@ -67,13 +67,25 @@ jobs:
         working-directory: client/python
         run: poetry install --all-extras
 
-      - name: Lint with flake8
+      - name: Lint
         working-directory: client/python
         run: |
-          poetry run flake8 --select=E9,F63,F7,F82 --max-line-length=127 --statistics
+          make lint
 
-      - name: Test with pytest
+      - name: Generated Client Tests
         working-directory: client/python
         run: |
           export SCRIPT_DIR="non-existing-mock-directory"
-          poetry run pytest
+          poetry run pytest test/
+
+      - name: Image build
+        run: |
+          ./gradlew \
+              :polaris-quarkus-server:assemble \
+              :polaris-quarkus-server:quarkusAppPartsBuild --rerun \
+              -Dquarkus.container-image.build=true
+
+      - name: Integration Tests
+        working-directory: client/python
+        run: |
+          make test-integration

.gitignore

@@ -28,6 +28,8 @@ client/python/poetry.lock
 /poetry.lock
 /polaris-venv/
 /pyproject.toml
+/client/python/
+!/client/python/pyproject.toml
 
 # Polaris CLI profile
 .polaris.json

LICENSE

@@ -220,8 +220,6 @@ This product includes code from Apache Iceberg.
 * integration-tests/src/main/java/org/apache/polaris/service/it/test/PolarisRestCatalogIntegrationTest.java
 * service/common/src/main/java/org/apache/polaris/service/catalog/iceberg/IcebergCatalog.java
 * service/common/src/main/java/org/apache/polaris/service/catalog/iceberg/CatalogHandlerUtils.java
-* plugins/spark/v3.5/spark/src/main/java/org/apache/polaris/spark/PolarisSparkCatalog.java
-* plugins/spark/v3.5/spark/src/test/java/org/apache/polaris/spark/PolarisInMemoryCatalog.java
 * plugins/spark/v3.5/spark/src/main/java/org/apache/polaris/spark/PolarisRESTCatalog.java
 * plugins/spark/v3.5/spark/src/main/java/org/apache/polaris/spark/SparkCatalog.java
 

README.md

@@ -37,7 +37,7 @@ for contribution guidelines.
 [dev-list-subscribe]: mailto:dev-subscribe@polaris.apache.org
 
 ## Polaris Overview
-Click [here](https://polaris.apache.org/in-dev/unreleased/overview/) for a quick overview of Polaris.
+Click [here](https://polaris.apache.org/in-dev/unreleased/) for a quick overview of Polaris.
 
 ## Quickstart
 Click [here](https://polaris.apache.org/in-dev/unreleased/getting-started/install-dependencies/) for the quickstart experience, which will help you set up a Polaris instance locally or on any supported cloud provider.

api/polaris-catalog-service/build.gradle.kts

@@ -122,3 +122,5 @@ sourceSets {
 tasks.named("javadoc") { dependsOn("jandex") }
 
 tasks.named("processResources") { dependsOn("openApiGenerate") }
+
+tasks.named("openApiGenerate") { outputs.cacheIf { false } }

client/python/.openapi-generator-ignore

@@ -45,5 +45,8 @@ pyproject.toml
 requirements.txt
 test-requirements.txt
 setup.py
+.gitlab-ci.yml
+.travis.yml
+.github/workflows/python.yml
 
 

client/python/polaris/management/api/__init__.py renamed to client/python/.pre-commit-config.yaml

@@ -1,4 +1,3 @@
-#
 # Licensed to the Apache Software Foundation (ASF) under one
 # or more contributor license agreements.  See the NOTICE file
 # distributed with this work for additional information
@@ -15,10 +14,23 @@
 # KIND, either express or implied.  See the License for the
 # specific language governing permissions and limitations
 # under the License.
-#
-
-# flake8: noqa
-
-# import apis into api package
-from polaris.management.api.polaris_default_api import PolarisDefaultApi
 
+repos:
+  - repo: https://github.com/pre-commit/pre-commit-hooks
+    rev: v5.0.0
+    hooks:
+      - id: trailing-whitespace
+      - id: end-of-file-fixer
+      - id: debug-statements
+  - repo: https://github.com/astral-sh/ruff-pre-commit
+    rev: v0.11.13
+    hooks:
+      - id: ruff
+        args: [ --fix, --exit-non-zero-on-fix ]
+      - id: ruff-format
+  - repo: https://github.com/pre-commit/mirrors-mypy
+    rev: v1.16.0
+    hooks:
+      - id: mypy
+        args:
+          [--disallow-untyped-defs, --ignore-missing-imports, --install-types, --non-interactive]