Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

hdfs not support append when write insert failed data to hdfs #196

Closed
Nicole00 opened this issue Mar 21, 2024 · 0 comments · Fixed by #197
Closed

hdfs not support append when write insert failed data to hdfs #196

Nicole00 opened this issue Mar 21, 2024 · 0 comments · Fixed by #197
Labels
affects/none PR/issue: this bug affects none version. process/fixed Process of bug severity/none Severity of bug type/bug Type: something is unexpected

Comments

@Nicole00
Copy link
Contributor

Nicole00 commented Mar 21, 2024

only happen for local mode with multiple tags with the same tag name and with local error output path.

24/03/21 06:38:14 INFO ErrorHandler$: create reload path file:///tmp/errors//local-1711003064748/Comment.0
24/03/21 06:38:14 ERROR Executor: Exception in task 0.0 in stage 8.0 (TID 10)
java.io.IOException: Not supported
	at org.apache.hadoop.fs.ChecksumFileSystem.append(ChecksumFileSystem.java:357)
	at org.apache.hadoop.fs.FileSystem.append(FileSystem.java:1166)
	at com.vesoft.exchange.common.ErrorHandler$.save(ErrorHandler.scala:54)
	at com.vesoft.nebula.exchange.processor.VerticesProcessor.com$vesoft$nebula$exchange$processor$VerticesProcessor$$writeErrorStatement(VerticesProcessor.scala:363)
	at com.vesoft.nebula.exchange.processor.VerticesProcessor$$anonfun$com$vesoft$nebula$exchange$processor$VerticesProcessor$$processEachPartition$1.apply(VerticesProcessor.scala:98)
	at com.vesoft.nebula.exchange.processor.VerticesProcessor$$anonfun$com$vesoft$nebula$exchange$processor$VerticesProcessor$$processEachPartition$1.apply(VerticesProcessor.scala:86)
	at scala.collection.Iterator$class.foreach(Iterator.scala:891)
	at scala.collection.AbstractIterator.foreach(Iterator.scala:1334)
	at com.vesoft.nebula.exchange.processor.VerticesProcessor.com$vesoft$nebula$exchange$processor$VerticesProcessor$$processEachPartition(VerticesProcessor.scala:86)
	at com.vesoft.nebula.exchange.processor.VerticesProcessor$$anonfun$process$3.apply(VerticesProcessor.scala:211)
	at com.vesoft.nebula.exchange.processor.VerticesProcessor$$anonfun$process$3.apply(VerticesProcessor.scala:211)
@Nicole00 Nicole00 added the type/bug Type: something is unexpected label Mar 21, 2024
@github-actions github-actions bot added affects/none PR/issue: this bug affects none version. severity/none Severity of bug labels Mar 21, 2024
@github-actions github-actions bot added the process/fixed Process of bug label Apr 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
affects/none PR/issue: this bug affects none version. process/fixed Process of bug severity/none Severity of bug type/bug Type: something is unexpected
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant