Skip to content

Conversation

@gh-yzou
Copy link
Contributor

@gh-yzou gh-yzou commented Jun 2, 2025

getConfiguration should be called per RealmContext instead of per PolarisCallContext. In this PR #1758 we introduced new API to that passes RealmContext, instead. of PolarisCallContext.
This PR refactors all calls except the loadTasks to use the new API with RealmContext, instead of calling with PolarisCallContext.

Follow up PR to update the usage in loadTasks and completely remove the getConfiguration function that uses PolarisCallContext

@gh-yzou
Copy link
Contributor Author

gh-yzou commented Jun 2, 2025

@dimas-b @adutra i will need one more PR to be able to competely remove the usage of PolarisCallContext

Comment on lines -81 to +85
.flatMap(c -> Optional.ofNullable(c.getPolarisCallContext()))
.map(
pc ->
pc.getConfigurationStore()
.getConfiguration(pc, "ALLOW_WILDCARD_LOCATION", false))
ctx ->
ctx.getPolarisCallContext()
.getConfigurationStore()
.getConfiguration(ctx.getRealmContext(), "ALLOW_WILDCARD_LOCATION", false))
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we need this change?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think so, because we need to "undo" the translation from CallContext to PolarisCallContext so that we can recover the RealmContext.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

My bad, didn't notice there was a pc :-)

@github-project-automation github-project-automation bot moved this from PRs In Progress to Ready to merge in Basic Kanban Board Jun 2, 2025
@flyrain flyrain enabled auto-merge (squash) June 2, 2025 23:43
@flyrain flyrain merged commit 5fe9fd9 into apache:main Jun 2, 2025
9 checks passed
@github-project-automation github-project-automation bot moved this from Ready to merge to Done in Basic Kanban Board Jun 2, 2025
*/
default <T> @Nonnull T getConfiguration(
PolarisCallContext ctx,
RealmContext realmContext,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: why not keep the old param name?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i think realmContext is a better parameter name that indicates clearly what the parameter is. "ctx" is very confusing by during the read of code like whether it is for CallContext or PolarisCallContext.

Assertions.assertEquals("entity-new3", store.getConfiguration(ctx, entity, cfg.apply(3)));
Assertions.assertEquals("entity-legacy4", store.getConfiguration(ctx, entity, cfg.apply(4)));
Assertions.assertEquals(
"test-default1", store.getConfiguration(testRealmContext, entity, cfg.apply(1)));
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

testRealmContext is not relevant here and does not affect the test's behaviour. I'd prefer to keep null.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

sg! I will update this in my part 2 PR.

@dimas-b
Copy link
Contributor

dimas-b commented Jun 2, 2025

This PR is related to #1775

@dimas-b
Copy link
Contributor

dimas-b commented Jun 2, 2025

@flyrain : I would have appreciated a bit more review time given my involvement in #1758

@flyrain
Copy link
Contributor

flyrain commented Jun 2, 2025

Sorry for the auto-merging, hopefully the part 2 can address your comments. cc @gh-yzou.

snazy added a commit to snazy/polaris that referenced this pull request Jun 13, 2025
* Fix regression test docker setup for purge (apache#1768)

* Use canonical catalog property names in tests (apache#1766)

* In `PolarisPolicyServiceIntegrationTest`
* In `PolarisRestCatalogIntegrationTest`

Following up to apache#1557

* Unblock test `createViewWithCustomMetadataLocation` (apache#1320)

* Add test for invalid custom metadata location

* Add missing properties during table/view creation

* main: Update docker.io/prom/prometheus Docker tag to v3.4.1 (apache#1767)

* Testing: silence a bunch of harmless test warnings (apache#1773)

* `OpenJDK 64-Bit Server VM warning: Sharing is only supported for boot loader classes because bootstrap classpath has been appended`
* Hibernate Validator cannot instrument static methods (`Hibernate Validator does not support constraints on static methods yet. ...`)
* ForkJoinPool test lifecycle warning
* Couple of split-package warnings

* Add unit test for legacy config lookup (apache#1774)

Following up on apache#1766

* Handle RequestScoped instance injection gracefully for DefaultConfigurationStore (apache#1758)

Although we do a check of !realmContextInstance.isUnsatisfied() it only checks if there is matching bean, however, it doesn't check if the context is active or not. Similarly isResolvable also don't check if the scope is active. Therefore if getConfiguration is called when there is no active scope, it will get Exception like ContextNotActiveException.
This actually fails the TaskExecutor because it runs in a separate thread.

In order to fix the problem, we introduces a new getConfiguration function to handle the background tasks, and also use isResolvable instead of isUnsatisfied to handle ambiguities.

* Restructure the directory and package name for persistence modules (apache#1724)

* Re-add missing parameters to create_table python API (apache#1778)

It looks like this method lost the `prefix` and `namespace` parameters in apache#1347. They're re-introduced to the spec here, and then I've run:
```
redocly bundle spec/polaris-catalog-service.yaml -o spec/generated/bundled-polaris-catalog-service.yaml
./gradlew regeneratePythonClient
```

Then, some manual reverts:
```
alias gitrevert='git checkout upstream/main --'
gitrevert client/python/.github/workflows/python.yml
gitrevert client/python/.gitlab-ci.yml
gitrevert client/python/pyproject.toml
```

I still hope to automate this process as part of CI soon; see apache#1675

* Replace getConfiguration usage with PolarisCallContext to use RealmContext (PART 1) (apache#1780)

* JDBC: Fix getting started config (apache#1781)

Fix typo in the JDBC config for getting started, the config should be max_duration_in_ms instead of max_delay_in_ms

* main: Pin dependencies (apache#1701)

* main: Update dependency pytest to v8 (apache#1710)

* main: Update dependency boto3 to v1.38.28 (apache#1777)

* Run renovatebot only on the main branch (apache#1786)

* INFO: last merged commit a827d26

---------

Co-authored-by: gh-yzou <167037035+gh-yzou@users.noreply.github.com>
Co-authored-by: Dmitri Bourlatchkov <dmitri.bourlatchkov@gmail.com>
Co-authored-by: Liam Bao <liam.zw.bao@gmail.com>
Co-authored-by: Mend Renovate <bot@renovateapp.com>
Co-authored-by: Yufei Gu <yufei@apache.org>
Co-authored-by: Eric Maynard <eric.maynard+oss@snowflake.com>
Co-authored-by: Prashant Singh <35593236+singhpk234@users.noreply.github.com>
Co-authored-by: JB Onofré <jbonofre@apache.org>
travis-bowen pushed a commit to travis-bowen/polaris that referenced this pull request Jun 20, 2025
* Replace getConfiguration usage with PolarisCallContext to use RealmContext (PART 1) (apache#1780)

* cherry pick

---------

Co-authored-by: gh-yzou <167037035+gh-yzou@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants