Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

kryo encountered unregistered class ID: 15 #14

Open
yishuaili opened this issue Jun 11, 2015 · 0 comments
Open

kryo encountered unregistered class ID: 15 #14

yishuaili opened this issue Jun 11, 2015 · 0 comments

Comments

@yishuaili
Copy link

I'm sorry if I shouldn't leave a question here, but I really cannot figure this out. I'm trying to test some very simple hive script, but this error kept coming up:

Exception in thread "main" org.apache.hive.com.esotericsoftware.kryo.KryoException: Encountered unregistered class ID: 15
Serialization trace:
mapWork (org.apache.hadoop.hive.ql.plan.MapredWork)
at org.apache.hive.com.esotericsoftware.kryo.util.DefaultClassResolver.readClass(DefaultClassResolver.java:119)
at org.apache.hive.com.esotericsoftware.kryo.Kryo.readClass(Kryo.java:656)
at org.apache.hive.com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:99)
at org.apache.hive.com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:507)
at org.apache.hive.com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:672)
at org.apache.hadoop.hive.ql.exec.Utilities.deserializeObjectByKryo(Utilities.java:1080)
at org.apache.hadoop.hive.ql.exec.Utilities.deserializePlan(Utilities.java:971)
at org.apache.hadoop.hive.ql.exec.Utilities.deserializePlan(Utilities.java:985)
at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.main(ExecDriver.java:748)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
Execution failed with exit status: 1
15/06/11 16:52:55 ERROR exec.Task: Execution failed with exit status: 1
Obtaining error information
15/06/11 16:52:55 ERROR exec.Task: Obtaining error information

This only happens when the hive script involves 'load' operation. So it is good to create table, but when comes to load data this just pop up. Here is the log:

2015-06-11 16:06:53,992 WARN [main]: common.LogUtils (LogUtils.java:logConfigLocation(145)) - hive-site.xml not found on CLASSPATH
2015-06-11 16:06:53,997 INFO [main]: mr.ExecDriver (SessionState.java:printInfo(948)) - Execution log at: /tmp/root/root_20150611160606_dc94272f-ef0c-4f16-a381-86d215e15b0f.log
2015-06-11 16:06:54,111 WARN [main]: conf.Configuration (Configuration.java:loadProperty(2172)) - file:/tmp/root/hive_2015-06-11_16-06-45_635_8515305690721422166-1/-local-10003/jobconf.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-06-11 16:06:54,114 WARN [main]: conf.Configuration (Configuration.java:loadProperty(2172)) - file:/tmp/root/hive_2015-06-11_16-06-45_635_8515305690721422166-1/-local-10003/jobconf.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-06-11 16:06:54,173 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) -
2015-06-11 16:06:54,173 INFO [main]: exec.Utilities (Utilities.java:deserializePlan(964)) - Deserializing MapredWork via kryo

Which I don't see much help either. I'm sorry again if this is not the right place to ask help, but any idea of solving this is so welcomed. If you need any info about my setting or script please just let me know. Thanks in advance!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant