-
Notifications
You must be signed in to change notification settings - Fork 1.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Bug] [FTP] The connections of SFTP didn't release when task failed. #1210
Labels
Comments
same bug with local test mode. {
"job": {
"content": [
{
"reader": {
"parameter": {
"password": "DT@Stack#123",
"column": [
{
"name": "id",
"type": "INT"
},
{
"name": "result_val",
"type": "VARCHAR"
}
],
"connection": [
{
"schema": "flinkx_test",
"jdbcUrl": [
"jdbc:mysql://172.16.100.186:3306/flinkx_test?useSSL=false"
],
"table": [
"ftp_source"
]
}
],
"splitPk": "id",
"username": "drpeco"
},
"name": "mysqlreader"
},
"writer": {
"parameter": {
"path": "/data/sftp/buffertest",
"password": "dt@sz.com",
"protocol": "SFTP",
"port": "22",
"host": "172.16.100.116",
"column": [
{
"name": "id",
"type": "INT"
},
{
"name": "result_val",
"type": "VARCHAR"
}
],
"writeMode": "append",
"fieldDelimiter": ",",
"ftpFileName": "xiaohe.txt",
"username": "root"
},
"name": "ftpwriter",
"table": {
"tableName": "sink"
}
}
}
],
"setting": {
"speed": {
"bytes": 0,
"channel": 2
}
}
}
} |
limengyao0809
added a commit
to limengyao0809/chunjun
that referenced
this issue
Sep 6, 2022
… are not released when task failed.
9 tasks
FlechazoW
pushed a commit
that referenced
this issue
Sep 6, 2022
…t released when task failed. (#1222)
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Search before asking
What happened
When the task fails due to issues like 'no such file' or 'file is empty', the sftp connection didn't release.
Task mode is yarn-session.
What you expected to happen
Connection is released.
How to reproduce
Anything else
NONE
Version
master
Are you willing to submit PR?
Code of Conduct
The text was updated successfully, but these errors were encountered: