Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

3.7 mysql 实时任务到 es有bug ,任务编译不了 #194

Closed
tyler-whz opened this issue Mar 22, 2023 · 5 comments
Closed

3.7 mysql 实时任务到 es有bug ,任务编译不了 #194

tyler-whz opened this issue Mar 22, 2023 · 5 comments
Labels
3.7.1 bug Something isn't working
Milestone

Comments

@tyler-whz
Copy link

截屏2023-03-22 09 42 44

@baisui1981
Copy link
Member

收到 @伍宏泽

@baisui1981 baisui1981 added bug Something isn't working 3.7.1 labels Mar 22, 2023
@tyler-whz
Copy link
Author

截屏2023-03-22 15 49 05

3.7 mysql实时监听到starrocks部署也有问题。手动创建 /opt/data/tis/libs/plugins目录就好了 部署上应该没提 @baisui1981

@baisui1981
Copy link
Member

baisui1981 commented Mar 23, 2023

截屏2023-03-22 15 49 05

3.7 mysql实时监听到starrocks部署也有问题。手动创建 /opt/data/tis/libs/plugins目录就好了 部署上应该没提 @baisui1981

已经修改了,TISFlinkClassLoaderFactory

private void makeDataDirUseable() {
        try {

            FileUtils.forceMkdir(PluginAndCfgsSnapshot.getPluginRootDir());
        } catch (IOException e) {
            throw new RuntimeException(e);
        }
    }

@baisui1981
Copy link
Member

前面几个异常都修复了,奇怪的是又报错下面这个类找不到的异常 org.apache.avro.generic.GenericData$Array

Caused by: java.lang.ClassNotFoundException: org.apache.avro.generic.GenericData$Array
accepted plugins:tis-ds-mysql-plugin,tis-sink-elasticsearch7-plugin,tis-k8s-plugin,tis-flink-dependency,tis-datax-elasticsearch-plugin,tis-ds-mysql-v5-plugin,flink/mysql_es,tis-realtime-flink,tis-datax-common-rdbms-plugin,tis-flink-cdc-mysql-plugin,tis-datax-common-plugin
,scan plugins:tis-datax-common-plugin,tis-datax-common-rdbms-plugin,tis-ds-mysql-plugin,tis-ds-mysql-v8-plugin,tis-flink-dependency,tis-k8s-plugin,tis-realtime-flink,tis-chunjun-base-plugin,tis-datax-doris-starrocks-plugin,tis-flink-chunjun-doris-plugin,tis-ds-mysql-v5-plugin,tis-flink-chunjun-mysql-plugin,tis-datax-elasticsearch-plugin,tis-sink-elasticsearch7-plugin,tis-datax-kafka-plugin,tis-flink-chunjun-kafka-plugin,tis-flink-cdc-mysql-plugin,flink/mysql_es
faild plugins desc:FailedPlugins is Empty
	at com.qlangtech.tis.extension.UberClassLoader.findClass(UberClassLoader.java:137)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
	at com.qlangtech.plugins.incr.flink.TISChildFirstClassLoader.loadClassWithoutExceptionHandling(TISChildFirstClassLoader.java:52)
	at org.apache.flink.util.FlinkUserCodeClassLoader.loadClass(FlinkUserCodeClassLoader.java:48)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
	at java.lang.Class.forName0(Native Method)
	at java.lang.Class.forName(Class.java:348)

baisui1981 added a commit to qlangtech/plugins that referenced this issue Mar 24, 2023
@baisui1981
Copy link
Member

fixed

@baisui1981 baisui1981 added this to the v3.7.1 milestone Apr 13, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
3.7.1 bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants