[Bug] KyuubiSQLException: Error while cleaning up the engine resources #4267
Labels
Comments
|
could you please search the whole log of the Kyuubi Server using the session uuid to find what happened on this session? |
|
Interesting that this session id occurs only twice, for the first time here - and second here - According to logs, the error is received by user X while the session id belongs to user Y. |
|
There is a spark engine log of one of the failing sessions |
|
@pan3793 I've noticed that session 904407b1-8cf3-476f-a730-929eecc53a90 is closed twice and then |
The first time close caused by session idle timeout, since you have the following configuration Then later, when the client requested to close the session, it had been closed. |
3 tasks
pan3793
pushed a commit
that referenced
this issue
Feb 21, 2023
### _Why are the changes needed?_ If SessionManager tries to close a session, that was previously closed - it throws an error `org.apache.kyuubi.KyuubiSQLException: Invalid SessionHandle` which causes spark session exit with non-zero code. ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [X] [Run test](https://kyuubi.readthedocs.io/en/master/develop_tools/testing.html#running-tests) locally before make a pull request Closes #4386 from hanna-liashchuk/catch-invalid-sessionhandle. Closes #4267 bf364ba [Hanna Liashchuk] Show warning if SessionHandle is invalid Authored-by: Hanna Liashchuk <g.liashchuk@temabit.com> Signed-off-by: Cheng Pan <chengpan@apache.org> (cherry picked from commit 89cc8c1) Signed-off-by: Cheng Pan <chengpan@apache.org>
pan3793
pushed a commit
that referenced
this issue
Feb 21, 2023
### _Why are the changes needed?_ If SessionManager tries to close a session, that was previously closed - it throws an error `org.apache.kyuubi.KyuubiSQLException: Invalid SessionHandle` which causes spark session exit with non-zero code. ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [X] [Run test](https://kyuubi.readthedocs.io/en/master/develop_tools/testing.html#running-tests) locally before make a pull request Closes #4386 from hanna-liashchuk/catch-invalid-sessionhandle. Closes #4267 bf364ba [Hanna Liashchuk] Show warning if SessionHandle is invalid Authored-by: Hanna Liashchuk <g.liashchuk@temabit.com> Signed-off-by: Cheng Pan <chengpan@apache.org> (cherry picked from commit 89cc8c1) Signed-off-by: Cheng Pan <chengpan@apache.org>
SusurHe
pushed a commit
to SusurHe/incubator-kyuubi
that referenced
this issue
Feb 21, 2023
* 'master' of github.com:apache/kyuubi: (1557 commits) [KYUUBI apache#3951][FOLLOWUP] Audit the rest request params [KYUUBI apache#4377] Grant execute permission to release scripts [KYUUBI apache#4374] Release uploading should include kyuubi-spark-connector-hive [KYUUBI apache#4267] Show warning if SessionHandle is invalid [KYUUBI apache#4385] [DOCS] Refine release process [KYUUBI apache#4352] Support System.gc() with periodic GC interval [KYUUBI apache#4152][FOLLOWUP] LDAP configurations should be server-only [KYUUBI apache#4373] Using SVN_STAGING_REPO instead of SVN_STAGING_REPO in the release script to fix echo message [KYUUBI apache#4372] Support to return null value for OperationsResource rowset [KYUUBI apache#4371] Fix typo in `kyuubi_ecosystem.drawio` [KYUUBI apache#4216] Support to transfer client version for kyuubi hive jdbc and rest client sdk [KYUUBI apache#4345] Add the doc of kyuubi trino server [KYUUBI apache#3081][DOCS] Add Hudi connector doc in Trino [KYUUBI apache#4357] Bump Jersey from 2.38 to 2.39 [KYUUBI apache#4338][FOLLOWUP] Fix K8s integration tests [KYUUBI apache#4326] [ARROW] Fix Spark session timezone format in arrow-based result format [KYUUBI apache#4360][FOLLOWUP] Get valid unlimited users from existing limiters instead of conf [KYUUBI apache#4362] Add `_configurations` in kerberos.rst [KYUUBI apache#4338] Bump Spark from 3.3.1 to 3.3.2 [KYUUBI apache#4119][FOLLOWUP] Add app start time for batch api docs ...
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Code of Conduct
Search before asking
Describe the bug
We are running dbt models connected to Kyuubi server. Some models are failing with
KyuubiSQLException: Error while cleaning up the engine resourcesThis issue is not reproducible every time, hits different models and we cannot say what would be the root cause.
Affects Version(s)
1.5.2-incubating
Kyuubi Server Log Output
Kyuubi Engine Log Output
Kyuubi Server Configurations
Kyuubi Engine Configurations
Additional context
No response
Are you willing to submit PR?
The text was updated successfully, but these errors were encountered: