This repository has been archived by the owner on Sep 20, 2023. It is now read-only.
Migration from TheHive 3.4.0 failed #216
Comments
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
{{ message }}
Guys,
I unsuccessfully tried to migrate the old instance of TheHive 3.4.0 to newer 4.0.3. I got for three times almost the same error here below reported:
[info] a.e.s.Slf4jLogger [|] Slf4jLogger started
[info] a.r.a.t.ArteryTcpTransport [|] Remoting started with transport [Artery tcp]; listening on address [akka://TheHiveMigration@127.0.0.1:44851] with UID [-910467743300795022]
[info] a.c.Cluster [|] Cluster Node [akka://TheHiveMigration@127.0.0.1:44851] - Starting up, Akka version [2.6.8] ...
[info] a.c.Cluster [|] Cluster Node [akka://TheHiveMigration@127.0.0.1:44851] - Registered cluster JMX MBean [akka:type=Cluster]
[info] a.c.Cluster [|] Cluster Node [akka://TheHiveMigration@127.0.0.1:44851] - Started up successfully
[info] a.c.Cluster [|] Cluster Node [akka://TheHiveMigration@127.0.0.1:44851] - No downing-provider-class configured, manual cluster downing required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#downing
[info] a.c.Cluster [|] Cluster Node [akka://TheHiveMigration@127.0.0.1:44851] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#joining
[info] Instantiate JanusDatabase using cql backend
[info] [Prepare database]
[info] [Prepare database]
[info] [Prepare database]
[info] [Prepare database]
[info] [Prepare database]
[info] [Prepare database]
[info] [Prepare database]
[info] [Prepare database]
[info] Already migrated:
4 profiles
3 organisations
18 users
3 impactStatuses
5 resolutionStatuses
18 observableTypes
1 customFields
5 caseTemplates
302 caseNumbers
68 alerts
[info] [Migrate case templates]
[info] [Migrate cases and alerts] Case/Task:1/5339(1959ms) Case:1/1153(4260ms)
[info] [Migrate cases and alerts] Case/Task:10/5339(263ms) Case:2/1153(22ms) Audit:50/378381(15ms) Case/Observable:89/53442(47ms)
[info] [Migrate cases and alerts] Case/Task:20/5339(9ms) Case:5/1153(14ms) Audit:188/378381(12ms) Case/Observable:328/53442(11ms)
[info] [Migrate cases and alerts] Case/Task:20/5339 Case:5/1153 Audit:441/378381(9ms) Case/Observable:543/53442(10ms)
[info] [Migrate cases and alerts] Case/Task:40/5339(6ms) Case:9/1153(7ms) Job:11/121085(10ms) Audit:669/378381(10ms) Case/Observable:635/53442(7ms)
[info] [Migrate cases and alerts] Case/Task:45/5339(5ms) Case:10/1153(8ms) Job:105/121085(5ms) Audit:989/378381(8ms) Case/Observable:682/53442(7ms)
[info] [Migrate cases and alerts] Case/Task:55/5339(7ms) Case:14/1153(7ms) Job:105/121085 Audit:1210/378381(7ms) Case/Observable:859/53442(10ms)
[info] [Migrate cases and alerts] Case/Task:65/5339(5ms) Case:16/1153(7ms) Job:249/121085(4ms) Audit:1413/378381(10ms) Case/Observable:901/53442(7ms)
[info] [Migrate cases and alerts] Case/Task:80/5339(7ms) Case:19/1153(8ms) Job:249/121085 Audit:1717/378381(11ms) Case/Observable:963/53442(7ms)
[info] [Migrate cases and alerts] Case/Task:100/5339(65ms) Case:23/1153(10ms) Job:319/121085(4ms) Audit:1890/378381(8ms) Case/Observable:1003/53442(7ms)
[info] [Migrate cases and alerts] Case/Task:105/5339(5ms) Case:24/1153(8ms) Job:319/121085 Audit:1992/378381(7ms) Case/Observable:1585/53442(6ms)
[info] [Migrate cases and alerts] Case/Task:105/5339 Case:24/1153 Job:319/121085 Audit:2442/378381(8ms) Case/Observable:1585/53442
[info] [Migrate cases and alerts] Case/Task:110/5339(4ms) Case:25/1153(5ms) Job:425/121085(4ms) Audit:2580/378381(7ms) Case/Observable:1896/53442(7ms)
[info] [Migrate cases and alerts] Case/Task:110/5339 Case:25/1153 Job:1207/121085(5ms) Audit:2580/378381 Case/Observable:1896/53442
[info] [Migrate cases and alerts] Case/Task:110/5339 Case:25/1153 Job:1679/121085(4ms) Audit:2580/378381 Case/Observable:1896/53442
[error] ElasticSearch request failure: POST:/the_hive_15/_search?scroll=36000000ms
StringEntity({"version":"true","query":{"bool":{"must":[{"term":{"relations":{"value":"action"}}},{"terms":{"objectId":["AXW3FzdKperogk2YS_96","AXW3FzdKperogk2YS_99","AXW3FzdKperogk2YS_98","AXW3FzdKperogk2YS_9-","AXW3FzdKperogk2YS_97","ca2e8fcf0c2f8c0a210c0426cc0bdee3","6dd46134cbc81226d93b274d5fb5c350","fc161cabfbec17baa7edc55d02752472","5099b2e1b6c71a97f35e66a6c8e1fe3f","37111eb2135313baf276ab6aa80f916d","59b7af8f185ea1726254cf314c2e6e4e","b569c775bd52ac7c3f587f112bfb1df9","f3d6a78fb86439215d754f0a3d648276","dd0c3572c12439844141c8f08763215b","ebef8a6f08fd7ea9d48fd5e4a34e8a33","8e194a8a9a5b178674d7428c4f8ca0fd","ff06578a52dcc371dd1b3b9ed2423c45","0f7cb6bb158be53dec82ed2557ca8bec","782fc12c05f0fdf1bce7d26d8267ad68","4940c1ba65b29edffcfd7758a38d887c","60b728b24d7e2932546fe5727e45202d","887b1a27da3a9d12bd11033688a36af8","f04ec75b558cc0823eae96df1e0acdbf","cec46ac96a200899895986f34b677a94","52175a56ac3a16cbfd9cfc438ca4d490","3d8b3a9de37a0a7bc9c3228469a7604b","3aa0255fc8ae7387495d67704175b228","f2c5ef526bd71d45a65e9a1040a35d28","9a650b743734917b212b5262c13b4576","1bc379a61ac55dc1c1917a8dabf605a2","f3608858407ce68deb5da664a388a7a9","5a58d5134875256ea8e03fe57dba87d3","3ba109e9ebf16629b9dbadbb5a34a732","e6bfb4a9978dbda73232ecde77bb8544","0fa0f14f28942b7f969b64cd3fb57f68","296ac1b6862c092775837128bf69468e","adb845db242e8a24ddec25987f85dfe2","dd4a2c7a4c2c106ac203a9c65841352c","818aa52c7c0a91bc8e4f78128aec7d8e","3e3e6ccfd84de4e31eb2761185d69fa6","7eb7d11bfa5078b9c37e2912ba111b92","ae9307780328764aa9291019bc51f8d4","50ef08162f049adf249644a57d77aeca","d5f0b5b32b6dd201a0016528a2281cff","1f81e6f05a24a54cf7ab3293fc379d93","4a28498a4ebbf0dad8bca6953a2032b5","f0b0b3fad8b5c21977a9fe721ae0a040","f7c503cae49b99a1fd8d3afd71c285f0","b123ccbf6253a95e9a63049bef51a024","68284d3c067a629da0cef55bf85c2df6","40da8a406f08c077d589b626c52a6b5a","e2e291b7cd945b1ab2ddadb1dc831a93","2062f5aed38bef85606ab611320ae116","32d7e4d0eb36b9e7c711586c424daeed","aed37cf533aeb17d50051909bdf59af0","269f1196caf0ecd32cf5e04d7110774c","90f7fee6b436e27bf39edc17cd025355","d7329f48944f9f698de1451d960c35de","725f00e2080e18470560bc1c37effee1","07aa312d3e87049e21ee18d271d7a123","810959966daa920777d0a9e88bb025ff","6cb9fd88fb1346b9df41678812754cb4","d48e2809769ec2a654e47ecb16e86427","01188387770e79a61103c6a112d5bfb5","6d976cbb3d4f744b30414b031986416c","51a5fb6ee234acc87852603d786ff956","55266662e4de09c1cd2aa2adb815decb","f29cc31e43e760ea129730a94d5a5db3","b07062d640f788112d7ccd35acbf052b","69bc8aa7c34a60d700aad740bf0a7eff","226a5ff69c725349f2787eb9d783f02c","7c3af815e8b9b0f3ea953155ff427c3b","55f029a143d2b817b716bba56af84e7c","ac84aa56e542c40b84fb9a410c44026f","c0882c385e5f7fa3abd1bc77aa7f4304","72deb114f59a324ab2c18c4a39d87a09","2fbf27da00ba06cd2211de09d719dd02","3419e2802d15d4305a8b361267a5b306","3541ea03700bf685a1f71e2696671ea4","b2ad6e592b0a349b8e4aad468835944b","0b558a546770a2eab6679406719ee8f3","56dae5b838c2c874e8bbade7dca8d4ab","0134a9eb48ba122bb201f43ca75043e1","89abcbc2e448ccc9f6676b79c9867277","65cab4470e7903925a3aaa119b240c3e","5739a27f0ac59daac5a334bba3e1954a","1cf93dfe082a621b51d49cf060c8e2c7","a18c6fda42398d755e73d5e...
=> ElasticError(search_phase_execution_exception,all shards failed,None,None,None,List(ElasticError(query_shard_exception,failed to create query: {
"bool" : {
"must" : [
{
"term" : {
"relations" : {
"value" : "action",
"boost" : 1.0
}
}
},
{
"terms" : {
"objectId" : [
"AXW3FzdKperogk2YS_96",
"AXW3FzdKperogk2YS_99",
"AXW3FzdKperogk2YS_98",
"AXW3FzdKperogk2YS_9-",
"AXW3FzdKperogk2YS_97",
"ca2e8fcf0c2f8c0a210c0426cc0bdee3",
"6dd46134cbc81226d93b274d5fb5c350",
"fc161cabfbec17baa7edc55d02752472",
"5099b2e1b6c71a97f35e66a6c8e1fe3f",
"37111eb2135313baf276ab6aa80f916d",
"59b7af8f185ea1726254cf314c2e6e4e",
"b569c775bd52ac7c3f587f112bfb1df9",
"f3d6a78fb86439215d754f0a3d648276",
"dd0c3572c12439844141c8f08763215b",
"ebef8a6f08fd7ea9d48fd5e4a34e8a33",
"8e194a8a9a5b178674d7428c4f8ca0fd",
"ff06578a52dcc371dd1b3b9ed2423c45",
"0f7cb6bb158be53dec82ed2557ca8bec",
"782fc12c05f0fdf1bce7d26d8267ad68",
"4940c1ba65b29edffcfd7758a38d887c",
"60b728b24d7e2932546fe5727e45202d",
"887b1a27da3a9d12bd11033688a36af8",
"f04ec75b558cc0823eae96df1e0acdbf",
"cec46ac96a200899895986f34b677a94",
"52175a56ac3a16cbfd9cfc438ca4d490",
"3d8b3a9de37a0a7bc9c3228469a7604b",
"3aa0255fc8ae7387495d67704175b228",
"f2c5ef526bd71d45a65e9a1040a35d28",
"9a650b743734917b212b5262c13b4576",
"1bc379a61ac55dc1c1917a8dabf605a2",
"f3608858407ce68deb5da664a388a7a9",
"5a58d5134875256ea8e03fe57dba87d3",
"3ba109e9ebf16629b9dbadbb5a34a732",
"e6bfb4a9978dbda73232ecde77bb8544",
"0fa0f14f28942b7f969b64cd3fb57f68",
"296ac1b6862c092775837128bf69468e",
"adb845db242e8a24ddec25987f85dfe2",
"dd4a2c7a4c2c106ac203a9c65841352c",
"818aa52c7c0a91bc8e4f78128aec7d8e",
"3e3e6ccfd84de4e31eb2761185d69fa6",
"7eb7d11bfa5078b9c37e2912ba111b92",
"ae9307780328764aa9291019bc51f8d4",
"50ef08162f049adf249644a57d77aeca",
"d5f0b5b32b6dd201a0016528a2281cff",
"1f81e6f05a24a54cf7ab3293fc379d93",
"4a28498a4ebbf0dad8bca6953a2032b5",
"f0b0b3fad8b5c21977a9fe721ae0a040",
"f7c503cae49b99a1fd8d3afd71c285f0",
"b123ccbf6253a95e9a63049bef51a024",
"68284d3c067a629da0cef55bf85c2df6",
"40da8a406f08c077d589b626c52a6b5a",
"e2e291b7cd945b1ab2ddadb1dc831a93",
"2062f5aed38bef85606ab611320ae116",.....
warn] Search error
org.thp.scalligraph.SearchError: all shards failed
at org.thp.thehive.migration.th3.DBConfiguration.$anonfun$execute$2(DBConfiguration.scala:146)
at scala.concurrent.Future.$anonfun$flatMap$1(Future.scala:307)
at scala.concurrent.impl.Promise.$anonfun$transformWith$1(Promise.scala:41)
at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:64)
at org.thp.scalligraph.ContextPropagatingDisptacher$$anon$1.$anonfun$execute$2(ContextPropagatingDisptacher.scala:56)
at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
at org.thp.scalligraph.DiagnosticContext$.$anonfun$withDiagnosticContext$2(ContextPropagatingDisptacher.scala:91)
at org.thp.scalligraph.DiagnosticContext$.saveDiagnosticContext(ContextPropagatingDisptacher.scala:106)
at org.thp.scalligraph.DiagnosticContext$.withDiagnosticContext(ContextPropagatingDisptacher.scala:89)
at org.thp.scalligraph.DiagnosticContext$$anon$2.withContext(ContextPropagatingDisptacher.scala:74)
[error] Migration failed
org.thp.scalligraph.SearchError: all shards failed
at org.thp.thehive.migration.th3.DBConfiguration.$anonfun$execute$2(DBConfiguration.scala:146)
at scala.concurrent.Future.$anonfun$flatMap$1(Future.scala:307)
at scala.concurrent.impl.Promise.$anonfun$transformWith$1(Promise.scala:41)
at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:64)
at org.thp.scalligraph.ContextPropagatingDisptacher$$anon$1.$anonfun$execute$2(ContextPropagatingDisptacher.scala:56)
at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
at org.thp.scalligraph.DiagnosticContext$.$anonfun$withDiagnosticContext$2(ContextPropagatingDisptacher.scala:91)
at org.thp.scalligraph.DiagnosticContext$.saveDiagnosticContext(ContextPropagatingDisptacher.scala:106)
at org.thp.scalligraph.DiagnosticContext$.withDiagnosticContext(ContextPropagatingDisptacher.scala:89)
at org.thp.scalligraph.DiagnosticContext$$anon$2.withContext(ContextPropagatingDisptacher.scala:74)
This error occurred several times but in different moments. Last attempts before this one the migration succeeded to move 300 case. This one just 23.
At the moment we don't have a clear idea of the root cause.
The text was updated successfully, but these errors were encountered: