Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ForecastIT » testOverflowToDisk failed to create temporary directory on windows #44609

Closed
alpar-t opened this issue Jul 19, 2019 · 8 comments · Fixed by #114807
Closed

ForecastIT » testOverflowToDisk failed to create temporary directory on windows #44609

alpar-t opened this issue Jul 19, 2019 · 8 comments · Fixed by #114807
Assignees
Labels
low-risk An open issue or test failure that is a low risk to future releases :ml Machine learning Team:ML Meta label for the ML team >test-failure Triaged test failures from CI v6.8.15 v7.2.2 v7.3.3 v9.0.0

Comments

@alpar-t
Copy link
Contributor

alpar-t commented Jul 19, 2019

https://scans.gradle.com/s/vl3yktrv4xey4/tests/zcquf3hc3eoda-p36ippgnsdeic?openStackTraces=WzBd

org.elasticsearch.ElasticsearchStatusException: Cannot run forecast: Forecast internal error, failed to create temporary folder C:\Users\jenkins\workspace\elastic+elasticsearch+master+multijob-windows-compatibility\os\windows-2012-r2\x-pack\plugin\ml\qa\native-multi-node-tests\build\testclusters\integTest-2\data\ml-local-data\tmp\job-forecast-it-test-overflow-to-disk\q5SsBWwBsH0xvxESbkgg error: The system cannot find the path specifiedClose stacktrace
at __randomizedtesting.SeedInfo.seed([DE1704EC3D6BE8E2:91C7BAB65415E152]:0)
at org.elasticsearch.xpack.core.ml.utils.ExceptionsHelper.badRequestException(ExceptionsHelper.java:67)
at org.elasticsearch.xpack.ml.action.TransportForecastJobAction.lambda$getForecastRequestStats$2(TransportForecastJobAction.java:111)
at org.elasticsearch.xpack.ml.job.persistence.JobResultsProvider.lambda$getForecastRequestStats$39(JobResultsProvider.java:1253)
at org.elasticsearch.xpack.ml.job.persistence.JobResultsProvider.lambda$searchSingleResult$33(JobResultsProvider.java:1093)
at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:62)
at org.elasticsearch.action.support.ContextPreservingActionListener.onResponse(ContextPreservingActionListener.java:43)
at org.elasticsearch.action.support.TransportAction$1.onResponse(TransportAction.java:68)
at org.elasticsearch.action.support.TransportAction$1.onResponse(TransportAction.java:64)
at org.elasticsearch.action.support.ContextPreservingActionListener.onResponse(ContextPreservingActionListener.java:43)
at org.elasticsearch.action.search.AbstractSearchAsyncAction.sendSearchResponse(AbstractSearchAsyncAction.java:300)
at org.elasticsearch.action.search.FetchSearchPhase$3.run(FetchSearchPhase.java:213)
at org.elasticsearch.action.search.AbstractSearchAsyncAction.executePhase(AbstractSearchAsyncAction.java:171)
at org.elasticsearch.action.search.AbstractSearchAsyncAction.executeNextPhase(AbstractSearchAsyncAction.java:165)
at org.elasticsearch.action.search.ExpandSearchPhase.run(ExpandSearchPhase.java:119)
at org.elasticsearch.action.search.AbstractSearchAsyncAction.executePhase(AbstractSearchAsyncAction.java:171)
at org.elasticsearch.action.search.AbstractSearchAsyncAction.executeNextPhase(AbstractSearchAsyncAction.java:165)
at org.elasticsearch.action.search.FetchSearchPhase.moveToNextPhase(FetchSearchPhase.java:206)
at org.elasticsearch.action.search.FetchSearchPhase.lambda$innerRun$2(FetchSearchPhase.java:104)
at org.elasticsearch.action.search.CountedCollector.countDown(CountedCollector.java:53)
at org.elasticsearch.action.search.CountedCollector.onResult(CountedCollector.java:64)
at org.elasticsearch.action.search.FetchSearchPhase$2.innerOnResponse(FetchSearchPhase.java:166)
at org.elasticsearch.action.search.FetchSearchPhase$2.innerOnResponse(FetchSearchPhase.java:163)
at org.elasticsearch.action.search.SearchActionListener.onResponse(SearchActionListener.java:45)
at org.elasticsearch.action.search.SearchActionListener.onResponse(SearchActionListener.java:29)
at org.elasticsearch.action.ActionListenerResponseHandler.handleResponse(ActionListenerResponseHandler.java:54)
at org.elasticsearch.action.search.SearchTransportService$ConnectionCountingHandler.handleResponse(SearchTransportService.java:431)
at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleResponse(TransportService.java:1137)
at org.elasticsearch.transport.InboundHandler$1.doRun(InboundHandler.java:224)
at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:193)
at org.elasticsearch.transport.InboundHandler.handleResponse(InboundHandler.java:216)
at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:141)
at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:105)
at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:661)
at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:62)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:323)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:297)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352)
at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:241)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352)
at io.netty.handler.ssl.SslHandler.unwrap(SslHandler.java:1478)
at io.netty.handler.ssl.SslHandler.decodeJdkCompatible(SslHandler.java:1227)
at io.netty.handler.ssl.SslHandler.decode(SslHandler.java:1274)
at io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:502)
at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:441)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:278)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1408)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:930)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:682)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:582)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:536)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:496)
at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:906)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at java.lang.Thread.run(Thread.java:834)
[2019-07-18T04:21:07,728][INFO ][o.e.x.m.i.ForecastIT     ] [testOverflowToDisk] before test
[2019-07-18T04:21:07,728][INFO ][o.e.x.m.i.ForecastIT     ] [testOverflowToDisk] [ForecastIT#testOverflowToDisk]: setting up test
[2019-07-18T04:21:08,394][INFO ][o.e.x.m.i.ForecastIT     ] [testOverflowToDisk] [ForecastIT#testOverflowToDisk]: all set up test
[2019-07-18T04:21:37,903][INFO ][o.e.x.m.i.ForecastIT     ] [testOverflowToDisk] [ForecastIT#testOverflowToDisk]: cleaning up after test
[2019-07-18T04:21:39,603][INFO ][o.e.x.m.i.ForecastIT     ] [testOverflowToDisk] [ForecastIT#testOverflowToDisk]: cleaned up after test
[2019-07-18T04:21:39,603][INFO ][o.e.x.m.i.ForecastIT     ] [testOverflowToDisk] after test
REPRODUCE WITH: gradlew :x-pack:plugin:ml:qa:native-multi-node-tests:integTestRunner --tests "org.elasticsearch.xpack.ml.integration.ForecastIT.testOverflowToDisk" -Dtests.seed=DE1704EC3D6BE8E2 -Dtests.security.manager=true -Dtests.locale=en-SL -Dtests.timezone=Etc/GMT+11 -Dcompiler.java=12 -Druntime.java=11
@alpar-t alpar-t added >test-failure Triaged test failures from CI :ml Machine learning v8.0.0 labels Jul 19, 2019
@elasticmachine
Copy link
Collaborator

Pinging @elastic/ml-core

alpar-t added a commit to alpar-t/elasticsearch that referenced this issue Jul 19, 2019
alpar-t added a commit to alpar-t/elasticsearch that referenced this issue Jul 19, 2019
alpar-t added a commit to alpar-t/elasticsearch that referenced this issue Jul 19, 2019
alpar-t added a commit to alpar-t/elasticsearch that referenced this issue Jul 19, 2019
alpar-t added a commit to alpar-t/elasticsearch that referenced this issue Jul 19, 2019
alpar-t added a commit that referenced this issue Jul 22, 2019
* Mute failing test

tracked in #44552

* mute EvilSecurityTests

tracking in #44558

* Fix line endings in ESJsonLayoutTests

* Mute failing ForecastIT  test on windows

Tracking in #44609

* mute AutoFollowIT.testConflictingPatterns

tracking in #44610

* mute BasicRenormalizationIT.testDefaultRenormalization

tracked in #44613

* Revert "mute AutoFollowIT.testConflictingPatterns"

This reverts commit 012de08.

* mute x-pack internal cluster test windows

tracking #44610

* Mute failure unconfigured node name

* fix mute testDefaultRenormalization

* Increase busyWait timeout windows is slow

* Mute JvmErgonomicsTests on windows

Tracking #44669

* mute SharedClusterSnapshotRestoreIT testParallelRestoreOperationsFromSingleSnapshot

Tracking #44671

* Mute NodeTests on Windows

Tracking #44256
alpar-t added a commit that referenced this issue Jul 22, 2019
* Mute failing test

tracked in #44552

* mute EvilSecurityTests

tracking in #44558

* Fix line endings in ESJsonLayoutTests

* Mute failing ForecastIT  test on windows

Tracking in #44609

* mute BasicRenormalizationIT.testDefaultRenormalization

tracked in #44613

* fix mute testDefaultRenormalization

* Increase busyWait timeout windows is slow

* Mute failure unconfigured node name

* mute x-pack internal cluster test windows

tracking #44610

* Mute JvmErgonomicsTests on windows

Tracking #44669

* mute SharedClusterSnapshotRestoreIT testParallelRestoreOperationsFromSingleSnapshot

Tracking #44671

* Mute NodeTests on Windows

Tracking #44256
alpar-t added a commit that referenced this issue Jul 22, 2019
* Mute failing test

tracked in #44552

* mute EvilSecurityTests

tracking in #44558

* Mute failing ForecastIT  test on windows

Tracking in #44609

* mute BasicRenormalizationIT.testDefaultRenormalization

tracked in #44613

* mute x-pack internal cluster test windows

tracking #44610

* Mute failure unconfigured node name

* fix mute testDefaultRenormalization

* Increase busyWait timeout windows is slow

* Mute JvmErgonomicsTests on windows

Tracking #44669

* mute SharedClusterSnapshotRestoreIT testParallelRestoreOperationsFromSingleSnapshot

Tracking #44671

* Mute NodeTests on Windows

Tracking #44256
alpar-t added a commit that referenced this issue Jul 22, 2019
* Mute failing test

tracked in #44552

* mute EvilSecurityTests

tracking in #44558

* Mute failing ForecastIT  test on windows

Tracking in #44609

* mute BasicRenormalizationIT.testDefaultRenormalization

tracked in #44613

* Disable testing conventions on Windows (#43532) (#44506)

Tests are disabled on Windows. Conventions also need to be disabled.

* mute x-pack internal cluster test windows

tracking #44610

* Mute failure unconfigured node name

* fix mute testDefaultRenormalization

* Increase busyWait timeout windows is slow

* Disable task for mute

* Mute JvmErgonomicsTests on windows

Tracking #44669

* mute SharedClusterSnapshotRestoreIT testParallelRestoreOperationsFromSingleSnapshot

Tracking #44671

* Mute NodeTests on Windows

Tracking #44256
alpar-t added a commit that referenced this issue Jul 22, 2019
* Mute failing test

tracked in #44552

* mute EvilSecurityTests

tracking in #44558

* Mute failing ForecastIT  test on windows

Tracking in #44609

* mute BasicRenormalizationIT.testDefaultRenormalization

tracked in #44613

* fix mute testDefaultRenormalization

* Increase busyWait timeout windows is slow
@jakelandis jakelandis added v6.8.3 and removed v6.8.2 labels Jul 24, 2019
@jakelandis jakelandis added v7.3.2 and removed v7.3.1 labels Aug 22, 2019
@pcsanwald pcsanwald added v6.8.4 and removed v6.8.3 labels Aug 29, 2019
@rjernst rjernst added the v8.8.0 label Feb 8, 2023
@gmarouli gmarouli added v8.9.0 and removed v8.8.0 labels Apr 26, 2023
@quux00 quux00 added v8.11.0 and removed v8.10.0 labels Aug 16, 2023
@mattc58 mattc58 added v8.12.0 and removed v8.11.0 labels Oct 4, 2023
@droberts195 droberts195 added the low-risk An open issue or test failure that is a low risk to future releases label Oct 9, 2023
@droberts195 droberts195 removed their assignment Jan 18, 2024
@valeriy42 valeriy42 reopened this Oct 15, 2024
@elasticsearchmachine elasticsearchmachine closed this as not planned Won't fix, can't repro, duplicate, stale Nov 6, 2024
@elasticsearchmachine
Copy link
Collaborator

This issue has been closed because it has been open for too long with no activity.

Any muted tests that were associated with this issue have been unmuted.

If the tests begin failing again, a new issue will be opened, and they may be muted again.

valeriy42 added a commit that referenced this issue Nov 25, 2024
Running the test on Jenkins caused flakiness in Windows. See #44609.

Since we moved to Buildkite I am unmuting this test, assuming that Buildkite is not creating such deep directory structures as Jenkins (see this comment).

We will mute this test again, if this assumption turns out to be wrong.

Closes #44609.
alexey-ivanov-es pushed a commit to alexey-ivanov-es/elasticsearch that referenced this issue Nov 28, 2024
…4807)

Running the test on Jenkins caused flakiness in Windows. See elastic#44609.

Since we moved to Buildkite I am unmuting this test, assuming that Buildkite is not creating such deep directory structures as Jenkins (see this comment).

We will mute this test again, if this assumption turns out to be wrong.

Closes elastic#44609.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
low-risk An open issue or test failure that is a low risk to future releases :ml Machine learning Team:ML Meta label for the ML team >test-failure Triaged test failures from CI v6.8.15 v7.2.2 v7.3.3 v9.0.0
Projects
None yet
Development

Successfully merging a pull request may close this issue.