-
Notifications
You must be signed in to change notification settings - Fork 1.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
http-x插件问题(已经解决,代码合并到了master分支了) #1497
Comments
Because the sample sent to the group has dataSubject, but the http-x plugin on the master branch cannot configure dataSubject in the with parameter, So I added dataSubject to HttpOptions and HttpDynamicTableFactory
…------------------ 原始邮件 ------------------
发件人: "DTStack/chunjun" ***@***.***>;
发送时间: 2023年2月9日(星期四) 下午3:06
***@***.***>;
***@***.******@***.***>;
主题: Re: [DTStack/chunjun] http-x插件问题 (Issue #1497)
If you are the latest code of the master branch, there seems to be some problems in sql mode. Some parameters are missing in sql mode, such as 'dataSubject' = '${data}', which need to be completed in HttpDynamicTableFactory.class.
After completion, the debug is as follows:
If you have time, you can start to try to complete the code, if you don’t have time, I will mention pr to fix it。
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you authored the thread.Message ID: ***@***.***>
|
The parameter types are inconsistent, the parameter is passed as a Map, and the method receives a String, you can try to modify and submit the pr |
thank you!
…------------------ 原始邮件 ------------------
发件人: "DTStack/chunjun" ***@***.***>;
发送时间: 2023年2月9日(星期四) 下午3:18
***@***.***>;
***@***.******@***.***>;
主题: Re: [DTStack/chunjun] http-x插件问题 (Issue #1497)
因为发到群里的sample有dataSubject,但是master分支上的http-x插件无法在with参数中配置dataSubject,所以我在HttpOptions和HttpDynamicTableFactory中添加了dataSubject
……
------------------ 原始邮件 ------------------ 发件人: "DTStack/chunjun" @.>; 发送时间: 2023年2月9日(星期四) 下午3:06 @.>; @.@.>; 主题: Re: [DTStack/chunjun] http-x插件问题 (Issue #1497) If you are the latest code of the master branch, there seems to be some problems in sql mode. Some parameters are missing in sql mode, such as 'dataSubject' = '${data}', which need to be completed in HttpDynamicTableFactory.class. After completion, the debug is as follows: If you have time, you can start to try to complete the code, if you don’t have time, I will mention pr to fix it。 — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>
The parameter types are inconsistent, the parameter is passed as a Map, and the method receives a String, you can try to modify and submit the pr
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you authored the thread.Message ID: ***@***.***>
|
这个问题现在已经基本解决了,解决方式如下:
然后在HttpDynamicTableFactory类加上上面的配置信息
最后也是最关键的就是修改HttpRowConverter类的toInternal方法和类的泛型
完整的代码如下
|
can you create a pull request? chunjun doc(开发者指南@如何提交一个优秀的PR) |
…ttp-x plug-in cannot be used in sql mode
…lug-in cannot be used in sql mode (#1500) Co-authored-by: 443321070@qq.com <taotao0226.?>
Merged pr. Closed as #1500 |
Search before asking
I had searched in the issues and found no similar question.
I had googled my question but i didn't get any help.
I had read the documentation: ChunJun doc but it didn't help me.
Description
根据chunjun文档里的http插件示例,使用sql模式运行,出错了,调试了半天暂时没有找到原因,下面是sql脚本和http接口的返回值信息
CREATE TABLE source
(
name VARCHAR,
age int,
sex varchar,
hobby varchar
)
WITH (
'connector' = 'http-x',
'url' = 'http://192.168.14.236:8090/test/test',
'intervalTime' = '3000',
'method' = 'get',
'decode' = 'json',
'dataSubject' = '${data}',
'fields' = 'name,age,sex,hobby',
'column' = '[
{
"name": "name",
"type": "string"
},
{
"name": "age",
"type": "int"
},
{
"name": "sex",
"type": "string"
},
{
"name": "hobby",
"type": "string"
}
]'
);
CREATE TABLE sink
(
name VARCHAR,
age int,
sex varchar,
hobby varchar
) WITH (
'connector' = 'stream-x'
);
INSERT INTO sink
SELECT *
FROM source u;
下面是http接口的返回值
{
"code":"0000",
"msg":"请求成功",
"data":[
{
"sex":"男",
"name":"臭桑",
"age":24,
"hobby":"打游戏"
}
],
"timestamp":"2023-02-09 13:28:39",
"total":0
}
最后是报错信息
其中 converter.toInternal(data) 这个方法接收的是string类型的参数,但是传递的是map
Code of Conduct
The text was updated successfully, but these errors were encountered: