[martini] Completed 200 OK in 1.958109ms 2018-11-29 03:57:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/e01954a3/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 645.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.448715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 847.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.792608ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.347715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.952408ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.304014ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.349314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 749.803µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.875408ms [martini] Started GET /api/lb-check for 10.1.1.81:58628 [martini] Completed 200 OK in 707.903µs [martini] Started GET /api/raft-health for 10.1.1.81:58660 [martini] Completed 200 OK in 750.903µs 2018-11-29 03:57:23 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.192418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 978.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21601ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.412115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 909.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.819408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.001113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 959.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.780924ms [martini] Started GET /api/raft-follower-health-report/9892a933/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 760.503µs 2018-11-29 03:57:29 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 03:57:29 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.644516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 892.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.152709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.237714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 814.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29311ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.080014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 911.103µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.844408ms [martini] Started GET /api/lb-check for 10.1.1.81:58762 [martini] Completed 200 OK in 753.303µs [martini] Started GET /api/raft-health for 10.1.1.81:58788 [martini] Completed 200 OK in 760.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.733116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.072904ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.111109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.207013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 979.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.000908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.126213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 829.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.041108ms [martini] Started GET /api/raft-follower-health-report/8396a3b3/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 792.403µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.496215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.884512ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.910908ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.284813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 816.403µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.099109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.683315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 950.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.857308ms [martini] Started GET /api/lb-check for 10.1.1.81:58908 [martini] Completed 200 OK in 801.603µs [martini] Started GET /api/raft-health for 10.1.1.81:58922 [martini] Completed 200 OK in 725.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.479415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 940.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.025708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.355514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.743811ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.746408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.048613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 875.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.084309ms [martini] Started GET /api/raft-follower-health-report/1bc6603c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 855.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.146422ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 977.305µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26091ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.298918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.228205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21371ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.363714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 997.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.237531ms [martini] Started GET /api/lb-check for 10.1.1.81:59052 [martini] Completed 200 OK in 1.118404ms [martini] Started GET /api/raft-health for 10.1.1.81:59072 [martini] Completed 200 OK in 756.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.938117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 890.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.955308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.009217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 952.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.386311ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.252414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 882.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.857708ms [martini] Started GET /api/raft-follower-health-report/ac6519b8/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 820.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.718315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.112005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.103709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.235113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.177305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.180309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.202914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 798.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.801207ms [martini] Started GET /api/lb-check for 10.1.1.81:59204 [martini] Completed 200 OK in 822.204µs [martini] Started GET /api/raft-health for 10.1.1.81:59246 [martini] Completed 200 OK in 895.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.787516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 980.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.071543ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.318614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 959.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.180709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.024913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 909.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.886508ms [martini] Started GET /api/raft-follower-health-report/242b7ed7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 719.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.363414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 926.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.882008ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.128813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.085405ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.465914ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.246813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 836.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.909908ms [martini] Started GET /api/lb-check for 10.1.1.81:59360 [martini] Completed 200 OK in 922.104µs [martini] Started GET /api/raft-health for 10.1.1.81:59374 [martini] Completed 200 OK in 776.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.626015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 880.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26631ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.455614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.028405ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.088509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.415515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.109905ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.971808ms 2018-11-29 03:58:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/693e813a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.209705ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.743716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 966.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.002108ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.132014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.063604ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.043008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.574516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 783.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.947508ms [martini] Started GET /api/lb-check for 10.1.1.81:59494 [martini] Completed 200 OK in 1.620006ms [martini] Started GET /api/raft-health for 10.1.1.81:59512 [martini] Completed 200 OK in 756.203µs 2018-11-29 03:58:23 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.386215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 909.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20631ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.326415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 782.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.000309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.444715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 955.705µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.827308ms [martini] Started GET /api/raft-follower-health-report/6c52d0b3/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.206905ms 2018-11-29 03:58:29 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 03:58:29 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.78182ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.884808ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.907813ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.011213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 850.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.916608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.234514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 864.903µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.067714ms [martini] Started GET /api/lb-check for 10.1.1.81:59632 [martini] Completed 200 OK in 678.703µs [martini] Started GET /api/raft-health for 10.1.1.81:59646 [martini] Completed 200 OK in 793.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.425215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 847.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.937308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.880616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 986.005µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.034508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.844129ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 952.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.842708ms [martini] Started GET /api/raft-follower-health-report/107a6173/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 824.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.890817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.061905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.260309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.258614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 874.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.909508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.201614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 942.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.714907ms [martini] Started GET /api/lb-check for 10.1.1.81:59768 [martini] Completed 200 OK in 2.951912ms [martini] Started GET /api/raft-health for 10.1.1.81:59796 [martini] Completed 200 OK in 664.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.875317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.277806ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31611ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.001413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 983.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31491ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.449915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 790.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.050509ms [martini] Started GET /api/raft-follower-health-report/3c54c6a0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 895.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.514915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.050205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.268809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.593315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 798.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.012508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.471415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 871.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.902708ms [martini] Started GET /api/lb-check for 10.1.1.81:59912 [martini] Completed 200 OK in 835.803µs [martini] Started GET /api/raft-health for 10.1.1.81:59932 [martini] Completed 200 OK in 707.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.65772ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.417506ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.209839ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.664915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 939.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.089209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.979612ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.528307ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.699707ms [martini] Started GET /api/raft-follower-health-report/811657a4/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 723.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.463115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 807.303µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.891508ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.606015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 935.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.283219ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.17323ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 796.503µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.953008ms [martini] Started GET /api/lb-check for 10.1.1.81:60054 [martini] Completed 200 OK in 668.603µs [martini] Started GET /api/raft-health for 10.1.1.81:60078 [martini] Completed 200 OK in 1.119105ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.997017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.038504ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.957009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.579016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 971.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.014708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.825217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 993.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.107109ms [martini] Started GET /api/raft-follower-health-report/a7578ce7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 903.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.758416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 871.803µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.035109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.413114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 969.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.676911ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.893612ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 957.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.871608ms [martini] Started GET /api/lb-check for 10.1.1.81:60196 [martini] Completed 200 OK in 998.904µs [martini] Started GET /api/raft-health for 10.1.1.81:60208 [martini] Completed 200 OK in 795.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.244018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.432806ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.67972ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.276514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 949.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.051509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.772516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.071904ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.750811ms 2018-11-29 03:59:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/e2501089/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 816.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.890629ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 775.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.232413ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.334314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 899.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.777807ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.154713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 955.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.903108ms [martini] Started GET /api/lb-check for 10.1.1.81:60328 [martini] Completed 200 OK in 701.003µs [martini] Started GET /api/raft-health for 10.1.1.81:60360 [martini] Completed 200 OK in 856.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.185418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.013204ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.145309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.321818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 860.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31351ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.221118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.246109ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.44891ms [martini] Started GET /api/raft-follower-health-report/7ca9250e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 932.304µs 2018-11-29 03:59:29 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.802917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 928.803µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.17721ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.368114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 992.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.968209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.988013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 977.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.832108ms [martini] Started GET /api/lb-check for 10.1.1.81:60478 [martini] Completed 200 OK in 821.603µs [martini] Started GET /api/raft-health for 10.1.1.81:60490 [martini] Completed 200 OK in 705.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.334614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.030405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.164709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.379515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 949.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.076008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.945612ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 819.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.892208ms 2018-11-29 03:59:35 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 03:59:35 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/d1acb554/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 690.203µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.134426ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 885.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.983308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.992912ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 983.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.904608ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.208414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 800.503µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.104509ms [martini] Started GET /api/lb-check for 10.1.1.81:60608 [martini] Completed 200 OK in 769.803µs [martini] Started GET /api/raft-health for 10.1.1.81:60622 [martini] Completed 200 OK in 894.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.278014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.064905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.47181ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.957117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 732.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.109909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.158113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 883.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.091109ms [martini] Started GET /api/raft-follower-health-report/d620f4a3/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 847.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.317814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 937.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.885008ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.369414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.295309ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.35271ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.081517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 773.903µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.826008ms [martini] Started GET /api/lb-check for 10.1.1.81:60736 [martini] Completed 200 OK in 756.204µs [martini] Started GET /api/raft-health for 10.1.1.81:60754 [martini] Completed 200 OK in 718.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.662715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.044904ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.856708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.467215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 827.703µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.109309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.397414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 969.905µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.125209ms [martini] Started GET /api/raft-follower-health-report/bffb74c4/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 743.403µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.114314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.003304ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.800308ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.811912ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 879.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.960409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.163913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 859.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.933309ms [martini] Started GET /api/lb-check for 10.1.1.81:60878 [martini] Completed 200 OK in 874.104µs [martini] Started GET /api/raft-health for 10.1.1.81:60906 [martini] Completed 200 OK in 49.556411ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.558132ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 842.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.920908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.465215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 899.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16891ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.332815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 920.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.37551ms [martini] Started GET /api/raft-follower-health-report/b0539c44/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 652.902µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.432415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 784.503µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.06103ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.164426ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 791.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20421ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.200913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 733.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.062209ms [martini] Started GET /api/lb-check for 10.1.1.81:32814 [martini] Completed 200 OK in 787.803µs [martini] Started GET /api/raft-health for 10.1.1.81:32828 [martini] Completed 200 OK in 820.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.299519ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 992.905µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.028109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.623515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.131905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.982208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.370314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 5.448823ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.987509ms 2018-11-29 04:00:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/7e7296fa/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 769.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.638615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 982.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.126709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.954912ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 850.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.009409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.967812ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 882.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.979709ms [martini] Started GET /api/lb-check for 10.1.1.81:32956 [martini] Completed 200 OK in 612.703µs [martini] Started GET /api/raft-health for 10.1.1.81:32974 [martini] Completed 200 OK in 746.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.983425ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 914.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.799408ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.198218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.219505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.997308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.339114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 904.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.056308ms [martini] Started GET /api/raft-follower-health-report/5a4a5f7f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 714.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.976017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 830.903µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22801ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.142518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 908.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.628007ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.084013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 835.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.987908ms [martini] Started GET /api/lb-check for 10.1.1.81:33094 [martini] Completed 200 OK in 733.403µs [martini] Started GET /api/raft-health for 10.1.1.81:33114 [martini] Completed 200 OK in 767.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.565115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.044004ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25701ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.291827ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.057605ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.791708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.338723ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 799.503µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.812708ms 2018-11-29 04:00:35 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:00:35 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/5063471e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 869.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.408515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 772.303µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.908808ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.312514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 850.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.829308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.895742ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.642207ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.650007ms [martini] Started GET /api/lb-check for 10.1.1.81:33226 [martini] Completed 200 OK in 758.004µs [martini] Started GET /api/raft-health for 10.1.1.81:33254 [martini] Completed 200 OK in 768.303µs 2018-11-29 04:00:41 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.685616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.014304ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.24251ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.492815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.006104ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.024609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.129213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 882.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.35361ms [martini] Started GET /api/raft-follower-health-report/87a0495e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 938.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.466715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 910.703µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.968009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.501215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.032604ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.956408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.452214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 896.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.790408ms [martini] Started GET /api/lb-check for 10.1.1.81:33368 [martini] Completed 200 OK in 676.702µs [martini] Started GET /api/raft-health for 10.1.1.81:33384 [martini] Completed 200 OK in 737.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.793316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 971.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.087209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.259413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 941.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.896008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.206214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 941.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.917908ms [martini] Started GET /api/raft-follower-health-report/8a533a93/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 753.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.524115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 938.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.124014ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.536815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 844.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.917908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.101513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 952.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.085909ms [martini] Started GET /api/lb-check for 10.1.1.81:33508 [martini] Completed 200 OK in 732.004µs [martini] Started GET /api/raft-health for 10.1.1.81:33520 [martini] Completed 200 OK in 661.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.497614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.014304ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.919308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.666016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 815.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.032109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.292114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 7.209031ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.943508ms [martini] Started GET /api/raft-follower-health-report/3baebf37/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 865.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.029317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.017704ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25701ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.773216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 982.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.145509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.695016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.055404ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.965008ms [martini] Started GET /api/lb-check for 10.1.1.81:33654 [martini] Completed 200 OK in 716.803µs [martini] Started GET /api/raft-health for 10.1.1.81:33680 [martini] Completed 200 OK in 5.210422ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.838233ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.388506ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.044918ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.735016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 915.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29921ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.280214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 940.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.707312ms 2018-11-29 04:01:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/f82fc4a0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 3.196313ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.733516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 937.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.052109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.150113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 807.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.960309ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.979313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.070804ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.870108ms [martini] Started GET /api/lb-check for 10.1.1.81:33786 [martini] Completed 200 OK in 625.703µs [martini] Started GET /api/raft-health for 10.1.1.81:33816 [martini] Completed 200 OK in 659.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.601615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.033905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.987017ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.677933ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 850.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.005309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.155414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 859.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.34271ms [martini] Started GET /api/raft-follower-health-report/f34df597/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 819.803µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.697016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.121505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.044609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.158614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 954.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.932008ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.069713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 7.601033ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.048609ms [martini] Started GET /api/lb-check for 10.1.1.81:33936 [martini] Completed 200 OK in 712.803µs [martini] Started GET /api/raft-health for 10.1.1.81:33950 [martini] Completed 200 OK in 780.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.589215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 850.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.17481ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.612115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.023705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.774308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.571616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 913.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.864508ms 2018-11-29 04:01:35 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/821666b4/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 875.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.382215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 798.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.962308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.470314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 903.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.879608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.154414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 802.903µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.728408ms [martini] Started GET /api/lb-check for 10.1.1.81:34068 [martini] Completed 200 OK in 1.132904ms [martini] Started GET /api/raft-health for 10.1.1.81:34082 [martini] Completed 200 OK in 814.803µs 2018-11-29 04:01:41 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:01:41 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.19063ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 865.403µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25831ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.271514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 895.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.958208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.655616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 953.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.798408ms [martini] Started GET /api/raft-follower-health-report/ff306c0a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 660.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.577315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 935.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.988808ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.568119ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.691911ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.869208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.067113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 919.503µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.203409ms [martini] Started GET /api/lb-check for 10.1.1.81:34196 [martini] Completed 200 OK in 838.804µs [martini] Started GET /api/raft-health for 10.1.1.81:34226 [martini] Completed 200 OK in 780.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.650916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 937.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.963808ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.181613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 991.605µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.997909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.633815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 882.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.180809ms [martini] Started GET /api/raft-follower-health-report/6de03f1e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 784.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.839516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.133805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.929109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.219014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 903.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.057609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.453415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 879.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.750408ms [martini] Started GET /api/lb-check for 10.1.1.81:34350 [martini] Completed 200 OK in 708.903µs [martini] Started GET /api/raft-health for 10.1.1.81:34364 [martini] Completed 200 OK in 1.518806ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.397714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.104205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.902108ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.437414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 865.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.022908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.995413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 779.103µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21621ms [martini] Started GET /api/raft-follower-health-report/00b39f6b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 685.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.441615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.236405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.342611ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.380615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 914.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.863408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.391414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 816.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.906908ms [martini] Started GET /api/lb-check for 10.1.1.81:34498 [martini] Completed 200 OK in 645.602µs [martini] Started GET /api/raft-health for 10.1.1.81:34510 [martini] Completed 200 OK in 642.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.406415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 964.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.902608ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.302414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.24971ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.651211ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.677716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 765.903µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.909108ms 2018-11-29 04:02:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/6543c9fd/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 749.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.320514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 799.103µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.993409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.026913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 944.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.918508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.969913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 906.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.178318ms [martini] Started GET /api/lb-check for 10.1.1.81:34630 [martini] Completed 200 OK in 850.404µs [martini] Started GET /api/raft-health for 10.1.1.81:34646 [martini] Completed 200 OK in 732.603µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.616716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.007304ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.158309ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.307414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 799.603µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.533011ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.442515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 818.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.071709ms [martini] Started GET /api/raft-follower-health-report/541eaf8a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 743.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.302214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 955.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.029109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.259014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 844.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.842708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.516119ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 837.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.144809ms [martini] Started GET /api/lb-check for 10.1.1.81:34766 [martini] Completed 200 OK in 763.803µs [martini] Started GET /api/raft-health for 10.1.1.81:34794 [martini] Completed 200 OK in 1.174805ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.609615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 995.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.722324ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.116414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 817.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.865708ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.113313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 966.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.093309ms [martini] Started GET /api/raft-follower-health-report/c5002407/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 827.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.493115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.013604ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.096309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.215114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 916.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.466815ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.056313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.161805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.975208ms [martini] Started GET /api/lb-check for 10.1.1.81:34914 [martini] Completed 200 OK in 617.503µs [martini] Started GET /api/raft-health for 10.1.1.81:34926 [martini] Completed 200 OK in 722.503µs 2018-11-29 04:02:41 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:02:41 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.465115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 916.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23811ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.341514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 836.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.919413ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.644316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 887.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.917208ms 2018-11-29 04:02:47 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/9c83b2bb/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 655.502µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.492715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 947.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.026909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.554015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 851.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.815607ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.140013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 871.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.948908ms [martini] Started GET /api/lb-check for 10.1.1.81:35042 [martini] Completed 200 OK in 703.403µs [martini] Started GET /api/raft-health for 10.1.1.81:35058 [martini] Completed 200 OK in 937.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.383015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.117905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.134009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.479814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 822.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.196809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.216614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 948.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.908208ms [martini] Started GET /api/raft-follower-health-report/5b33e0ee/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 869.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.175213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.627712ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.229314ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.026613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 729.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.50461ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.027513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 837.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.012709ms [martini] Started GET /api/lb-check for 10.1.1.81:35182 [martini] Completed 200 OK in 884.204µs [martini] Started GET /api/raft-health for 10.1.1.81:35194 [martini] Completed 200 OK in 1.140505ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.227714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.134804ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21611ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.047113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 879.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.921908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.672324ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 967.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.13381ms [martini] Started GET /api/raft-follower-health-report/30bbd870/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 759.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.214413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 974.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.145809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.75682ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.038105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25371ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.415215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.147405ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.40531ms [martini] Started GET /api/lb-check for 10.1.1.81:35322 [martini] Completed 200 OK in 761.203µs [martini] Started GET /api/raft-health for 10.1.1.81:35350 [martini] Completed 200 OK in 760.403µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.437515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 961.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.945808ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.132614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 765.703µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.976109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.816716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 848.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.804907ms 2018-11-29 04:03:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/a84237ed/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 6.834229ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.361015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 940.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.184609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.372014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 848.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.917808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.180614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 909.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.920808ms [martini] Started GET /api/lb-check for 10.1.1.81:35472 [martini] Completed 200 OK in 727.903µs [martini] Started GET /api/raft-health for 10.1.1.81:35488 [martini] Completed 200 OK in 630.103µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.740034ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 13.214857ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.749007ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.189414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.014105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.838408ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.964013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 785.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.751607ms [martini] Started GET /api/raft-follower-health-report/9a8538de/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 798.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.517115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.262606ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19981ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.508515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.093309ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.210509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.775811ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 855.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28421ms [martini] Started GET /api/lb-check for 10.1.1.81:35608 [martini] Completed 200 OK in 652.903µs [martini] Started GET /api/raft-health for 10.1.1.81:35622 [martini] Completed 200 OK in 720.203µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.007817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 948.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.956609ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.215214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 847.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.12601ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.299614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 839.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29101ms [martini] Started GET /api/raft-follower-health-report/2e6903e7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.254806ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.062718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 902.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.121809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.480541ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 893.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.901709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.986513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 866.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.830907ms [martini] Started GET /api/lb-check for 10.1.1.81:35740 [martini] Completed 200 OK in 891.104µs [martini] Started GET /api/raft-health for 10.1.1.81:35768 [martini] Completed 200 OK in 897.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.145518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.129805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.096409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.775216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 942.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.075309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.807117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 948.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.160009ms 2018-11-29 04:03:47 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:03:47 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/b143e3c3/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 830.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.028517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 930.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.671724ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.379914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 866.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.878408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.911813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 726.703µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.804308ms [martini] Started GET /api/lb-check for 10.1.1.81:35868 [martini] Completed 200 OK in 734.703µs [martini] Started GET /api/raft-health for 10.1.1.81:35898 [martini] Completed 200 OK in 827.704µs 2018-11-29 04:03:53 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.682916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.759707ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.111209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.399614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.486111ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.233809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.925013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 899.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.941908ms [martini] Started GET /api/raft-follower-health-report/acf4463d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.032405ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.412015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 925.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.40101ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.464415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 758.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.595911ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.386514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 842.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.132414ms [martini] Started GET /api/lb-check for 10.1.1.81:36022 [martini] Completed 200 OK in 932.204µs [martini] Started GET /api/raft-health for 10.1.1.81:36034 [martini] Completed 200 OK in 911.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.702416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 919.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.076608ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.288514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 896.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.34371ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.058613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 864.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29141ms [martini] Started GET /api/raft-follower-health-report/2da1541c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.380606ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.692916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 929.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.072009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.113013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 902.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.911908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.820716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 853.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.841507ms [martini] Started GET /api/lb-check for 10.1.1.81:36166 [martini] Completed 200 OK in 636.903µs [martini] Started GET /api/raft-health for 10.1.1.81:36178 [martini] Completed 200 OK in 801.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.659715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 967.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.283927ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.122417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 942.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.085509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.036013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.058604ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16271ms 2018-11-29 04:04:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/6bb984d1/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 797.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.307614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 958.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.073209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.395014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 921.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.487524ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.142113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 921.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.986709ms [martini] Started GET /api/lb-check for 10.1.1.81:36296 [martini] Completed 200 OK in 685.702µs [martini] Started GET /api/raft-health for 10.1.1.81:36328 [martini] Completed 200 OK in 813.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.682016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 981.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.993809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.174414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 989.505µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.882608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.018913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.045508ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.806008ms [martini] Started GET /api/raft-follower-health-report/d653a297/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 711.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.987817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.265305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.751512ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.355118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.276205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.028108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.444832ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.073005ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.969108ms [martini] Started GET /api/lb-check for 10.1.1.81:36448 [martini] Completed 200 OK in 841.104µs [martini] Started GET /api/raft-health for 10.1.1.81:36460 [martini] Completed 200 OK in 917.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.363614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 920.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.981309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.706916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 881.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.058309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.103514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.170805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.049209ms [martini] Started GET /api/raft-follower-health-report/07d03fac/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 755.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.274714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 931.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.354923ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.349615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 922.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.890909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.073313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 849.503µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.970309ms [martini] Started GET /api/lb-check for 10.1.1.81:36580 [martini] Completed 200 OK in 780.204µs [martini] Started GET /api/raft-health for 10.1.1.81:36592 [martini] Completed 200 OK in 618.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.873617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 933.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.041908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.391614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.040305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.134122ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.251818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 908.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.200209ms [martini] Started GET /api/raft-follower-health-report/6f72fba7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 707.503µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.114017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 955.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.072309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.343815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 929.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.982108ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.947913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 803.003µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.460615ms [martini] Started GET /api/lb-check for 10.1.1.81:36708 [martini] Completed 200 OK in 761.603µs [martini] Started GET /api/raft-health for 10.1.1.81:36724 [martini] Completed 200 OK in 786.703µs 2018-11-29 04:04:53 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:04:53 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.987617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.124705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.926208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.529716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 826.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.049609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.129913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 945.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.002809ms [martini] Started GET /api/raft-follower-health-report/87c0f84c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 733.904µs 2018-11-29 04:04:59 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.324515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 856.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.809007ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.495815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 865.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.111409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.176413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.060905ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.30751ms [martini] Started GET /api/lb-check for 10.1.1.81:36850 [martini] Completed 200 OK in 714.903µs [martini] Started GET /api/raft-health for 10.1.1.81:36878 [martini] Completed 200 OK in 1.166105ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.306232ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 949.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.532915ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.107813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 810.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.795807ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.960113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 878.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.919909ms [martini] Started GET /api/raft-follower-health-report/4df9c564/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 863.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.876517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 841.903µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.073309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.311614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 787.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.892108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.029017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.231805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.831608ms [martini] Started GET /api/lb-check for 10.1.1.81:37008 [martini] Completed 200 OK in 724.703µs [martini] Started GET /api/raft-health for 10.1.1.81:37020 [martini] Completed 200 OK in 733.603µs 2018/11/29 04:05:12 [INFO] raft: Starting snapshot up to 437366 2018/11/29 04:05:12 [INFO] snapshot: Creating new snapshot at /var/lib/orchestrator/snapshots/9352-437366-1543464312887.tmp 2018/11/29 04:05:12 [INFO] snapshot: reaping snapshot /var/lib/orchestrator/snapshots/9352-432265-1543438722140 2018/11/29 04:05:12 [INFO] raft: Compacting logs from 426809 to 427126 2018/11/29 04:05:12 [INFO] raft: Snapshot to 437366 complete [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.759016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.038805ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.613511ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.118017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.254005ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.899108ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.028713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.112505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.914117ms 2018-11-29 04:05:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/aa6f9f60/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 773.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.528119ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.082205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.616915ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.62802ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 951.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.834008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.368714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.030004ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.862408ms [martini] Started GET /api/lb-check for 10.1.1.81:37142 [martini] Completed 200 OK in 829.404µs [martini] Started GET /api/raft-health for 10.1.1.81:37158 [martini] Completed 200 OK in 721.403µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.670416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 980.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.820516ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.511015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 877.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.972909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.195613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.235705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.908809ms [martini] Started GET /api/raft-follower-health-report/646cb75e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 942.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.554116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.409711ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.322615ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.061017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.488206ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.819908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.110817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.152805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.962813ms [martini] Started GET /api/lb-check for 10.1.1.81:37276 [martini] Completed 200 OK in 843.803µs [martini] Started GET /api/raft-health for 10.1.1.81:37288 [martini] Completed 200 OK in 802.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.610415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.054805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.824008ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.874317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 885.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.007609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.433727ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.024905ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.178909ms [martini] Started GET /api/raft-follower-health-report/60442ff2/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 748.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.739216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 842.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.935308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.208514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 839.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.006509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.058113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 887.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.814708ms [martini] Started GET /api/lb-check for 10.1.1.81:37410 [martini] Completed 200 OK in 2.088709ms [martini] Started GET /api/raft-health for 10.1.1.81:37436 [martini] Completed 200 OK in 636.802µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.859117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.120605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.30761ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.587816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 945.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.027108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.186913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.049505ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.37361ms [martini] Started GET /api/raft-follower-health-report/6aed9a8a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 831.804µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.641716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 868.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16561ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.224713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 884.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.988209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.277214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 716.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.849708ms [martini] Started GET /api/lb-check for 10.1.1.81:37552 [martini] Completed 200 OK in 644.702µs [martini] Started GET /api/raft-health for 10.1.1.81:37568 [martini] Completed 200 OK in 695.303µs 2018-11-29 04:05:53 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.360714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.002204ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.909525ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.093613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 966.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.939408ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.165213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 883.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.736207ms [martini] Started GET /api/raft-follower-health-report/e73004e1/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.252806ms 2018-11-29 04:05:59 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:05:59 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.542316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 988.705µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.087308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.684416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.060204ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.240814ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.972918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.155205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.966309ms [martini] Started GET /api/lb-check for 10.1.1.81:37688 [martini] Completed 200 OK in 788.104µs [martini] Started GET /api/raft-health for 10.1.1.81:37702 [martini] Completed 200 OK in 739.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.668216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.076505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.040908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.236714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 966.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19811ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.121013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.069704ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.907508ms [martini] Started GET /api/raft-follower-health-report/cbe5f623/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.138505ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.491315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 908.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.076109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.485415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 940.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.955208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.178914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 764.803µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.119309ms [martini] Started GET /api/lb-check for 10.1.1.81:37836 [martini] Completed 200 OK in 3.003213ms [martini] Started GET /api/raft-health for 10.1.1.81:37848 [martini] Completed 200 OK in 780.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.968917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.132105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.892609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.255714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 926.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.837408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.113614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.155905ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.578511ms 2018-11-29 04:06:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/bd45a920/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 737.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.390414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.046204ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.433715ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.154414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.009004ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.14201ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.085913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 859.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.834408ms [martini] Started GET /api/lb-check for 10.1.1.81:37968 [martini] Completed 200 OK in 553.803µs [martini] Started GET /api/raft-health for 10.1.1.81:38000 [martini] Completed 200 OK in 735.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.411515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.065305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20501ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.290115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 790.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.234414ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.866117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 873.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.104509ms [martini] Started GET /api/raft-follower-health-report/8c790143/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 738.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.362415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.000104ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.869908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.420315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 993.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.149909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.480419ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 956.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.585611ms [martini] Started GET /api/lb-check for 10.1.1.81:38114 [martini] Completed 200 OK in 619.802µs [martini] Started GET /api/raft-health for 10.1.1.81:38126 [martini] Completed 200 OK in 782.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.613416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.004004ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.131209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.616215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 902.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.927609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.118613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 883.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.236709ms [martini] Started GET /api/raft-follower-health-report/da4baa16/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 762.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.102847ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 791.003µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.990808ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.182814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 910.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.820308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.194314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.011904ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.993408ms [martini] Started GET /api/lb-check for 10.1.1.81:38250 [martini] Completed 200 OK in 718.603µs [martini] Started GET /api/raft-health for 10.1.1.81:38262 [martini] Completed 200 OK in 852.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.293714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 685.803µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.960921ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.989426ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 813.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.980109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.294714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 851.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.894708ms [martini] Started GET /api/raft-follower-health-report/a9942e33/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 853.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.466715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 910.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.828608ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.347815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 898.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.946908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.376549ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 808.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.835808ms [martini] Started GET /api/lb-check for 10.1.1.81:38378 [martini] Completed 200 OK in 664.503µs [martini] Started GET /api/raft-health for 10.1.1.81:38410 [martini] Completed 200 OK in 739.904µs 2018-11-29 04:06:53 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.414815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.100804ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.601811ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.271314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 844.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.886308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.351515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 985.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.838208ms [martini] Started GET /api/raft-follower-health-report/5443c230/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 793.504µs 2018-11-29 04:06:59 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:06:59 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.504515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 996.105µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.009309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.601016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 981.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.857108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.061114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 955.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.974608ms [martini] Started GET /api/lb-check for 10.1.1.81:38512 [martini] Completed 200 OK in 827.903µs [martini] Started GET /api/raft-health for 10.1.1.81:38540 [martini] Completed 200 OK in 914.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.209431ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 834.403µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.129409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.554016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 868.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.928308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.849217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 785.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.794408ms [martini] Started GET /api/raft-follower-health-report/ec5382c9/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 952.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.758116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 968.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.015809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.427019ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 865.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.409911ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.405115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.135705ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.105409ms [martini] Started GET /api/lb-check for 10.1.1.81:38674 [martini] Completed 200 OK in 698.803µs [martini] Started GET /api/raft-health for 10.1.1.81:38686 [martini] Completed 200 OK in 835.404µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.196618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.292705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.40801ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.267714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 919.103µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.831108ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.408515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.024904ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.023709ms 2018-11-29 04:07:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/cd670a7e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 779.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.280114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.042205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.14561ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.327614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 890.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.995108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.180414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.070505ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.480311ms [martini] Started GET /api/lb-check for 10.1.1.81:38808 [martini] Completed 200 OK in 831.504µs [martini] Started GET /api/raft-health for 10.1.1.81:38824 [martini] Completed 200 OK in 3.029613ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.788816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 997.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.017608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.191218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 818.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.995608ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.066013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 833.403µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.949308ms [martini] Started GET /api/raft-follower-health-report/0ac399d9/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 716.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.004621ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31261ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25061ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.094213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 947.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.955309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.446015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.003505ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.759812ms [martini] Started GET /api/lb-check for 10.1.1.81:38942 [martini] Completed 200 OK in 648.203µs [martini] Started GET /api/raft-health for 10.1.1.81:38968 [martini] Completed 200 OK in 867.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.352014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 944.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21731ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.278414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 969.205µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.409915ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.123622ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 877.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.810308ms [martini] Started GET /api/raft-follower-health-report/bd03180a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 714.903µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.844017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 904.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.033509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.200214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 920.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.146809ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.105713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 959.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.118109ms [martini] Started GET /api/lb-check for 10.1.1.81:39090 [martini] Completed 200 OK in 1.955108ms [martini] Started GET /api/raft-health for 10.1.1.81:39102 [martini] Completed 200 OK in 663.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.690516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.199505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.150409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.797416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.712707ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.938108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.787516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 864.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.475411ms [martini] Started GET /api/raft-follower-health-report/57978ca8/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.993809ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.521815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 979.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.065309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.363515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 949.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.975409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.175614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 827.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.879408ms [martini] Started GET /api/lb-check for 10.1.1.81:39218 [martini] Completed 200 OK in 1.668107ms [martini] Started GET /api/raft-health for 10.1.1.81:39234 [martini] Completed 200 OK in 903.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.667715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.150005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.207814ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.066813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.028505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.782207ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.938712ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.133305ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.781108ms [martini] Started GET /api/raft-follower-health-report/95aeae9a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 616.203µs 2018-11-29 04:07:59 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.820616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 924.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.076309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.337714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 747.003µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.131409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.126522ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 719.103µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.406511ms [martini] Started GET /api/lb-check for 10.1.1.81:39356 [martini] Completed 200 OK in 891.703µs [martini] Started GET /api/raft-health for 10.1.1.81:39368 [martini] Completed 200 OK in 821.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.555515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 974.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.795833ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.548615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 986.505µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.34821ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.093313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.025009ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.899308ms 2018-11-29 04:08:05 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:08:05 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/3305dfb4/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 795.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.633715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 870.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26081ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.318014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 857.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.996808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.962813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 699.103µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27931ms [martini] Started GET /api/lb-check for 10.1.1.81:39500 [martini] Completed 200 OK in 1.010305ms [martini] Started GET /api/raft-health for 10.1.1.81:39528 [martini] Completed 200 OK in 973.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.533623ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.178709ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.42231ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.797216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 861.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.015108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.541015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 767.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.094609ms 2018-11-29 04:08:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/ca15d450/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 744.503µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.560415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 960.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.016109ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.747112ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.33171ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.389711ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.990813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 839.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.774907ms [martini] Started GET /api/lb-check for 10.1.1.81:39650 [martini] Completed 200 OK in 649.203µs [martini] Started GET /api/raft-health for 10.1.1.81:39668 [martini] Completed 200 OK in 804.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.715121ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.339706ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.462437ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.119113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 893.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.873012ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.038614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 987.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.646624ms [martini] Started GET /api/raft-follower-health-report/b0da4353/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 851.304µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.536816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27521ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29241ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.096914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 912.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.975408ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.556715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 908.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.940308ms [martini] Started GET /api/lb-check for 10.1.1.81:39784 [martini] Completed 200 OK in 672.203µs [martini] Started GET /api/raft-health for 10.1.1.81:39796 [martini] Completed 200 OK in 794.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.798616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.098305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.222714ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.260514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.078805ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26721ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.986513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.299706ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.854408ms [martini] Started GET /api/raft-follower-health-report/4c943367/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 967.304µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.644524ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.004608ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.916408ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.048713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 849.903µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.682508ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.347014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.003804ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.884808ms [martini] Started GET /api/lb-check for 10.1.1.81:39918 [martini] Completed 200 OK in 846.104µs [martini] Started GET /api/raft-health for 10.1.1.81:39932 [martini] Completed 200 OK in 831.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.600815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 885.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28681ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.118814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.209006ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.055839ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.695915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 899.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.909608ms [martini] Started GET /api/raft-follower-health-report/f42f42d5/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 835.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.380315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 882.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.873008ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.237414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.362506ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.053509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.54222ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 964.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.819912ms [martini] Started GET /api/lb-check for 10.1.1.81:40046 [martini] Completed 200 OK in 650.403µs [martini] Started GET /api/raft-health for 10.1.1.81:40078 [martini] Completed 200 OK in 881.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.029317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 982.105µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.077609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.274714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 854.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.094909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.941312ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 764.103µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.981208ms [martini] Started GET /api/raft-follower-health-report/faa4d3b6/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 815.004µs 2018-11-29 04:08:59 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.779316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 933.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.081909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.211914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 804.703µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.941409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.344214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 845.203µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.981308ms [martini] Started GET /api/lb-check for 10.1.1.81:40196 [martini] Completed 200 OK in 864.004µs [martini] Started GET /api/raft-health for 10.1.1.81:40210 [martini] Completed 200 OK in 947.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.552936ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 990.105µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.492015ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.134914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 769.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.152309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.270914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 889.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.025209ms 2018-11-29 04:09:05 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:09:05 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/f8a05ccf/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 807.203µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.544716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.066705ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.180109ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.096113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 937.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.897808ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.202623ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 874.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.060909ms [martini] Started GET /api/lb-check for 10.1.1.81:40340 [martini] Completed 200 OK in 660.003µs [martini] Started GET /api/raft-health for 10.1.1.81:40354 [martini] Completed 200 OK in 788.003µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.66422ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.057804ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.184109ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.374315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 968.605µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.052909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.219814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 845.003µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.914708ms 2018-11-29 04:09:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/a403bcd4/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 804.104µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.683516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 909.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.957108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.914912ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 946.905µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.256309ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.917612ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.021305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.842008ms [martini] Started GET /api/lb-check for 10.1.1.81:40478 [martini] Completed 200 OK in 1.412006ms [martini] Started GET /api/raft-health for 10.1.1.81:40506 [martini] Completed 200 OK in 814.703µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.552715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 953.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.918808ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.198614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 961.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.127609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.663116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 749.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.071309ms [martini] Started GET /api/raft-follower-health-report/905c91d0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 865.703µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.931317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.014204ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.747629ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.068417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 912.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.225409ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.114713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 942.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.24941ms [martini] Started GET /api/lb-check for 10.1.1.81:40626 [martini] Completed 200 OK in 640.003µs [martini] Started GET /api/raft-health for 10.1.1.81:40652 [martini] Completed 200 OK in 890.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.503615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.030304ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.076609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.278814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 773.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.235814ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.315819ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 849.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.088309ms [martini] Started GET /api/raft-follower-health-report/e7904458/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 707.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.378214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.137305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.900708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.036213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 848.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.054509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.931913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.150905ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.931509ms [martini] Started GET /api/lb-check for 10.1.1.81:40780 [martini] Completed 200 OK in 906.204µs [martini] Started GET /api/raft-health for 10.1.1.81:40796 [martini] Completed 200 OK in 772.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.998121ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.250305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.093009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.078714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.083305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.029909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.270114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 774.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.32761ms [martini] Started GET /api/raft-follower-health-report/ceed4113/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 2.100809ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.542416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 800.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.199709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.405715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 848.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.005209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.440114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 895.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.769308ms [martini] Started GET /api/lb-check for 10.1.1.81:40932 [martini] Completed 200 OK in 688.403µs [martini] Started GET /api/raft-health for 10.1.1.81:40950 [martini] Completed 200 OK in 774.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.672516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.151505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.171014ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.434614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 874.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.959709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.936012ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 854.703µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.768408ms [martini] Started GET /api/raft-follower-health-report/432efbce/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 690.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.789716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.405506ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.32821ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.369014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 752.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.091709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.843021ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 821.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.120309ms [martini] Started GET /api/lb-check for 10.1.1.81:41070 [martini] Completed 200 OK in 701.003µs [martini] Started GET /api/raft-health for 10.1.1.81:41098 [martini] Completed 200 OK in 862.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.842617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 960.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.124609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.369815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 958.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.989409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.948213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 878.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.088509ms 2018-11-29 04:10:05 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/11407f4d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.015505ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.545615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 959.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.975408ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.559816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 899.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.076009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.249214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 914.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.996109ms [martini] Started GET /api/lb-check for 10.1.1.81:41226 [martini] Completed 200 OK in 658.203µs [martini] Started GET /api/raft-health for 10.1.1.81:41244 [martini] Completed 200 OK in 831.203µs 2018-11-29 04:10:11 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:10:11 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.642133ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.658612ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20301ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.519615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 799.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.943508ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.920412ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 798.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.049313ms 2018-11-29 04:10:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/52977456/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 638.402µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.286815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 996.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.903708ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.229914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.874508ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.902713ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.270814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 858.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.944308ms [martini] Started GET /api/lb-check for 10.1.1.81:41366 [martini] Completed 200 OK in 577.503µs [martini] Started GET /api/raft-health for 10.1.1.81:41382 [martini] Completed 200 OK in 616.102µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.283514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 848.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.012109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.177914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.052604ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.977809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.201114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 875.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.283423ms [martini] Started GET /api/raft-follower-health-report/f2ee820d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 887.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.995217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.134905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.952009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.226914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 936.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.480011ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.169914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 898.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.931408ms [martini] Started GET /api/lb-check for 10.1.1.81:41498 [martini] Completed 200 OK in 546.902µs [martini] Started GET /api/raft-health for 10.1.1.81:41510 [martini] Completed 200 OK in 797.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.878116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.103504ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.179309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.638816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.013904ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.15761ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.451915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 834.503µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.894608ms [martini] Started GET /api/raft-follower-health-report/912a319d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 685.103µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.609515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 904.103µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.357836ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.097813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.532107ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.918008ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.124014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 761.703µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.835108ms [martini] Started GET /api/lb-check for 10.1.1.81:41636 [martini] Completed 200 OK in 822.903µs [martini] Started GET /api/raft-health for 10.1.1.81:41662 [martini] Completed 200 OK in 804.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.027717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 982.505µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.027409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.639615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.912917ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.397315ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.248714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 777.203µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.031409ms [martini] Started GET /api/raft-follower-health-report/f52cbf1e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 825.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.601615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.002405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.121809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.367414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.336718ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.883008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.035213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 797.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.638016ms [martini] Started GET /api/lb-check for 10.1.1.81:41786 [martini] Completed 200 OK in 723.403µs [martini] Started GET /api/raft-health for 10.1.1.81:41802 [martini] Completed 200 OK in 626.702µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.978917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.067904ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.017309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.165714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.015604ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.024309ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.308715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 942.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29271ms [martini] Started GET /api/raft-follower-health-report/abc24d40/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 751.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.257618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.142905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.911808ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.096313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 856.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.943109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.166318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 958.405µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.119809ms [martini] Started GET /api/lb-check for 10.1.1.81:41924 [martini] Completed 200 OK in 760.703µs [martini] Started GET /api/raft-health for 10.1.1.81:41936 [martini] Completed 200 OK in 1.103205ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.582215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.091605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 15.341666ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.228914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 846.003µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.029708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.215014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 895.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.151409ms 2018-11-29 04:11:05 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/1c7225f4/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 873.204µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.859016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.188205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.093109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.982813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 867.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.184713ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.74892ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 919.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.955908ms [martini] Started GET /api/lb-check for 10.1.1.81:42062 [martini] Completed 200 OK in 668.703µs [martini] Started GET /api/raft-health for 10.1.1.81:42076 [martini] Completed 200 OK in 841.803µs 2018-11-29 04:11:11 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.316218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.057305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.028009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.567015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.063005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.059109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.134913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 969.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.819413ms 2018-11-29 04:11:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 04:11:17 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/23667840/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 853.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.661316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 948.205µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.014209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.954513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 829.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.832108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.062214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 817.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.015208ms [martini] Started GET /api/lb-check for 10.1.1.81:42196 [martini] Completed 200 OK in 789.503µs [martini] Started GET /api/raft-health for 10.1.1.81:42228 [martini] Completed 200 OK in 797.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.573015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.231205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26671ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.223914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 877.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.754308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.084613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 874.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.964309ms [martini] Started GET /api/raft-follower-health-report/bd2443c0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 693.603µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.438819ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.805712ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.980908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.854517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.056305ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.019809ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.258214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 912.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.082609ms [martini] Started GET /api/lb-check for 10.1.1.81:42340 [martini] Completed 200 OK in 799.503µs [martini] Started GET /api/raft-health for 10.1.1.81:42352 [martini] Completed 200 OK in 720.603µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.525915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 936.205µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20231ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.344214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 807.703µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.549511ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.315344ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 955.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.945708ms [martini] Started GET /api/raft-follower-health-report/b7a66fd3/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 821.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.350115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 918.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25121ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.271014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 817.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.965208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.156513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 877.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.946608ms [martini] Started GET /api/lb-check for 10.1.1.81:42468 [martini] Completed 200 OK in 1.754608ms [martini] Started GET /api/raft-health for 10.1.1.81:42482 [martini] Completed 200 OK in 728.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.390424ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 991.205µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.974008ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.701316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 881.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.956809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.007617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.035905ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.929108ms [martini] Started GET /api/raft-follower-health-report/7ddbe625/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.699108ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.774816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.001804ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.971808ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.242414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 868.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.40771ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.099414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 840.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.842308ms [martini] Started GET /api/lb-check for 10.1.1.81:42598 [martini] Completed 200 OK in 763.404µs [martini] Started GET /api/raft-health for 10.1.1.81:42614 [martini] Completed 200 OK in 901.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.004717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.125705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.157918ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.044617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.014404ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.804408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.912412ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 760.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.134109ms [martini] Started GET /api/raft-follower-health-report/82f4d15e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 684.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.88603ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.084105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.542811ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.901117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 964.405µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.955508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.991521ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 957.005µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.908808ms [martini] Started GET /api/lb-check for 10.1.1.81:42728 [martini] Completed 200 OK in 897.304µs [martini] Started GET /api/raft-health for 10.1.1.81:42756 [martini] Completed 200 OK in 823.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.487115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 968.305µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.782912ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.162318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 890.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.822808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.504515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 964.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.959609ms [martini] Started GET /api/raft-follower-health-report/ea727a00/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 837.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.785016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.230905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.821013ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.442415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 985.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.34971ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.057813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 892.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.869009ms [martini] Started GET /api/lb-check for 10.1.1.81:42878 [martini] Completed 200 OK in 780.103µs [martini] Started GET /api/raft-health for 10.1.1.81:42890 [martini] Completed 200 OK in 851.004µs 2018-11-29 04:12:11 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.807934ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.123205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.832621ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.363514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 933.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.061609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.190814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 993.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.947808ms 2018-11-29 04:12:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 04:12:17 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:12:17 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/96fc326d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 850.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.872816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.076005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.34201ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.802726ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31251ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.850408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.858421ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 903.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.771608ms [martini] Started GET /api/lb-check for 10.1.1.81:43012 [martini] Completed 200 OK in 630.503µs [martini] Started GET /api/raft-health for 10.1.1.81:43030 [martini] Completed 200 OK in 798.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.024618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 978.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.679811ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.599116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 768.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.853213ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.680616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 766.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.14431ms [martini] Started GET /api/raft-follower-health-report/4a91cac7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 773.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.737516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.091404ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.565112ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.344923ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.430606ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.144409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.964917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.202705ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.771908ms [martini] Started GET /api/lb-check for 10.1.1.81:43144 [martini] Completed 200 OK in 687.803µs [martini] Started GET /api/raft-health for 10.1.1.81:43170 [martini] Completed 200 OK in 2.27851ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.250914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.317106ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.634011ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.447015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.100605ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.619311ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.376514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.136305ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.40381ms [martini] Started GET /api/raft-follower-health-report/3bbc5cfa/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.008405ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.522115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18451ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.062909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.464919ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.078105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.926809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.051013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.161205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.650012ms [martini] Started GET /api/lb-check for 10.1.1.81:43272 [martini] Completed 200 OK in 923.504µs [martini] Started GET /api/raft-health for 10.1.1.81:43298 [martini] Completed 200 OK in 723.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.793416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.115405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.820813ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.005017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.009108ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.208514ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.739516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 924.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.163809ms [martini] Started GET /api/raft-follower-health-report/f53392e5/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 883.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.898816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 997.905µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.24481ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.122113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.243805ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.11691ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.235414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 930.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.167718ms [martini] Started GET /api/lb-check for 10.1.1.81:43414 [martini] Completed 200 OK in 719.303µs [martini] Started GET /api/raft-health for 10.1.1.81:43430 [martini] Completed 200 OK in 838.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.376715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.054504ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.131309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.415215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 991.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.952009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.024513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 907.703µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23871ms [martini] Started GET /api/raft-follower-health-report/c8041b0c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 851.504µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.231527ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 945.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.33271ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.185013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 865.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.12991ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.593016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 943.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.155509ms [martini] Started GET /api/lb-check for 10.1.1.81:43546 [martini] Completed 200 OK in 895.504µs [martini] Started GET /api/raft-health for 10.1.1.81:43558 [martini] Completed 200 OK in 753.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.284614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 899.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.815825ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.718316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 910.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.898909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.952212ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 924.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.453419ms [martini] Started GET /api/raft-follower-health-report/1eda4041/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 926.704µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.479115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.018405ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.40361ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.394815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 904.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.312714ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.55642ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.111404ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.081314ms [martini] Started GET /api/lb-check for 10.1.1.81:43684 [martini] Completed 200 OK in 685.603µs [martini] Started GET /api/raft-health for 10.1.1.81:43710 [martini] Completed 200 OK in 716.103µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.749429ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.652708ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.256109ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.817116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 869.603µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.785212ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.988522ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 832.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.036809ms 2018-11-29 04:13:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 04:13:17 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/c582bf31/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 793.203µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.547515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 967.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.925708ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.110013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 897.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.103709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.193814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 795.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.018409ms [martini] Started GET /api/lb-check for 10.1.1.81:43850 [martini] Completed 200 OK in 706.703µs [martini] Started GET /api/raft-health for 10.1.1.81:43874 [martini] Completed 200 OK in 967.104µs 2018-11-29 04:13:23 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:13:23 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.743617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 856.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.902308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.258414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 998.205µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.100109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.132614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 985.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.837408ms [martini] Started GET /api/raft-follower-health-report/a964f597/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 712.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.938717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.312315ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.518711ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.137414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.189305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26861ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.213714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.585407ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.235809ms [martini] Started GET /api/lb-check for 10.1.1.81:43992 [martini] Completed 200 OK in 674.203µs [martini] Started GET /api/raft-health for 10.1.1.81:44006 [martini] Completed 200 OK in 712.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.311032ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 788.103µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22681ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.257414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.320706ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.153613ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.004621ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 872.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.999208ms [martini] Started GET /api/raft-follower-health-report/c8a979ec/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 733.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.914317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.078605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.17651ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.872421ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 992.305µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.693516ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.450519ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.021605ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.763612ms [martini] Started GET /api/lb-check for 10.1.1.81:44132 [martini] Completed 200 OK in 1.038605ms [martini] Started GET /api/raft-health for 10.1.1.81:44146 [martini] Completed 200 OK in 688.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.861617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 928.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.36661ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.604016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 828.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29331ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.009813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.086905ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.434311ms [martini] Started GET /api/raft-follower-health-report/57f40e3e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 810.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.680115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 884.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.004209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.058714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 749.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.784608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.107513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 940.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.670312ms [martini] Started GET /api/lb-check for 10.1.1.81:44266 [martini] Completed 200 OK in 682.003µs [martini] Started GET /api/raft-health for 10.1.1.81:44298 [martini] Completed 200 OK in 684.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.552316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.621907ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.802425ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.568215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.035304ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.960709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.017613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 732.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.771008ms [martini] Started GET /api/raft-follower-health-report/42eef979/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 863.604µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.031717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 757.703µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.097309ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.923012ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 922.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.010213ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.723216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 875.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31441ms [martini] Started GET /api/lb-check for 10.1.1.81:44420 [martini] Completed 200 OK in 781.404µs [martini] Started GET /api/raft-health for 10.1.1.81:44434 [martini] Completed 200 OK in 767.503µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.434215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.329106ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.102109ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.311715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.023405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.152009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.545716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.001104ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.506511ms [martini] Started GET /api/raft-follower-health-report/b4cf64a5/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.240905ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.586716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 944.905µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25771ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.225714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 905.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28651ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.654616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 805.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.113809ms [martini] Started GET /api/lb-check for 10.1.1.81:44558 [martini] Completed 200 OK in 907.704µs [martini] Started GET /api/raft-health for 10.1.1.81:44572 [martini] Completed 200 OK in 786.103µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.035417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.133905ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.784808ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.357215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.537007ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.028009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.467015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 805.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.069813ms 2018-11-29 04:14:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 04:14:17 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/7a5569b5/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.106805ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.975117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.136905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.345114ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.765821ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 918.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.890608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.742516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 998.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25781ms [martini] Started GET /api/lb-check for 10.1.1.81:44698 [martini] Completed 200 OK in 680.503µs [martini] Started GET /api/raft-health for 10.1.1.81:44716 [martini] Completed 200 OK in 985.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.441314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 850.903µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.913208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.441015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 814.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.334711ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.652716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.095704ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29701ms [martini] Started GET /api/raft-follower-health-report/f540941f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 686.003µs 2018-11-29 04:14:29 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:14:29 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.923516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 879.803µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.029308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.431614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 818.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.088309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.345215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.076705ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.42241ms [martini] Started GET /api/lb-check for 10.1.1.81:44836 [martini] Completed 200 OK in 1.964309ms [martini] Started GET /api/raft-health for 10.1.1.81:44864 [martini] Completed 200 OK in 862.204µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.620515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.295006ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.878308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.762012ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 749.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.157809ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.132718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 961.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.966209ms [martini] Started GET /api/raft-follower-health-report/a63fccc9/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 823.204µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.490824ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.601607ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.046709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.058517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 872.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.32681ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.640616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.036505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.201214ms [martini] Started GET /api/lb-check for 10.1.1.81:44986 [martini] Completed 200 OK in 783.703µs [martini] Started GET /api/raft-health for 10.1.1.81:45000 [martini] Completed 200 OK in 672.903µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.662824ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.703308ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.846008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.034113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.36911ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.41961ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.952617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 954.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.897009ms [martini] Started GET /api/raft-follower-health-report/cb9cd2a7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 681.203µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.756716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 784.203µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.870008ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.274414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 961.805µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29151ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.863617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.159005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.929817ms [martini] Started GET /api/lb-check for 10.1.1.81:45134 [martini] Completed 200 OK in 705.703µs [martini] Started GET /api/raft-health for 10.1.1.81:45150 [martini] Completed 200 OK in 703.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.142018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 966.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.609812ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.820717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.029505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27661ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.503415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 875.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.32631ms [martini] Started GET /api/raft-follower-health-report/0419b9ef/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.016805ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.932617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 877.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.978508ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.756516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 924.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.309314ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.181119ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.086004ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.37371ms [martini] Started GET /api/lb-check for 10.1.1.81:45280 [martini] Completed 200 OK in 744.403µs [martini] Started GET /api/raft-health for 10.1.1.81:45298 [martini] Completed 200 OK in 1.150105ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.909617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 992.305µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.019235ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.101513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 937.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.254909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.996818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.040005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.979109ms [martini] Started GET /api/raft-follower-health-report/5385d7ca/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 887.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.632216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 854.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.065309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.237614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 876.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.247323ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.905717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 871.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.683607ms [martini] Started GET /api/lb-check for 10.1.1.81:45420 [martini] Completed 200 OK in 778.903µs [martini] Started GET /api/raft-health for 10.1.1.81:45448 [martini] Completed 200 OK in 842.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.077418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.021604ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.33671ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.483615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.165105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21211ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.045917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.076104ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.002809ms 2018-11-29 04:15:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/da8be0ef/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 993.705µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.596215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 748.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.074409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.600315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 976.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.10351ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.135014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 797.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.888308ms [martini] Started GET /api/lb-check for 10.1.1.81:45598 [martini] Completed 200 OK in 648.403µs [martini] Started GET /api/raft-health for 10.1.1.81:45614 [martini] Completed 200 OK in 739.703µs 2018-11-29 04:15:23 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.936517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 990.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26131ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.427114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 884.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.987009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.659916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 943.305µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.097009ms [martini] Started GET /api/raft-follower-health-report/e161a24e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 733.404µs 2018-11-29 04:15:29 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:15:29 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.971821ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.117805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.968609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.234414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 873.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.170709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.168313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.092605ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.998509ms [martini] Started GET /api/lb-check for 10.1.1.81:45734 [martini] Completed 200 OK in 606.503µs [martini] Started GET /api/raft-health for 10.1.1.81:45746 [martini] Completed 200 OK in 635.802µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.292519ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.078004ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.212909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.420715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 914.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.748938ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.161714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.118905ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.994308ms [martini] Started GET /api/raft-follower-health-report/06246739/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 860.504µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.571615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 863.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.780007ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.570716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 876.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.044309ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.174014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 997.405µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.429915ms [martini] Started GET /api/lb-check for 10.1.1.81:45870 [martini] Completed 200 OK in 662.002µs [martini] Started GET /api/raft-health for 10.1.1.81:45898 [martini] Completed 200 OK in 922.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.381019ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 927.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.918312ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.471515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 922.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.32361ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.874013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.028304ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.873708ms [martini] Started GET /api/raft-follower-health-report/74e8b8f5/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 854.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.393715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.012504ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.984408ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.915317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 961.405µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.32901ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.177814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 930.405µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.409011ms [martini] Started GET /api/lb-check for 10.1.1.81:46012 [martini] Completed 200 OK in 760.503µs [martini] Started GET /api/raft-health for 10.1.1.81:46036 [martini] Completed 200 OK in 699.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.385623ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.211105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.39201ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.427315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 894.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.118209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.935313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 960.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.822408ms [martini] Started GET /api/raft-follower-health-report/454c5278/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 761.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.497315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 914.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.049309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.334415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.33111ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.15781ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.079913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 725.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.904208ms [martini] Started GET /api/lb-check for 10.1.1.81:46160 [martini] Completed 200 OK in 882.504µs [martini] Started GET /api/raft-health for 10.1.1.81:46172 [martini] Completed 200 OK in 922.904µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.567116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.000004ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21431ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.963113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 883.803µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.890808ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.467115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 926.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.054513ms [martini] Started GET /api/raft-follower-health-report/6bfc735a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 838.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.332819ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.000904ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.868708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.299314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 856.703µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.966008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.135213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 825.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.829508ms [martini] Started GET /api/lb-check for 10.1.1.81:46302 [martini] Completed 200 OK in 683.903µs [martini] Started GET /api/raft-health for 10.1.1.81:46314 [martini] Completed 200 OK in 749.003µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.138713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.116404ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.913908ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.800517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 877.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.945908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.704416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 961.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.859108ms 2018-11-29 04:16:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/8a84ea67/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 849.303µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.669115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21581ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31031ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.010113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 820.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.892809ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.964413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 813.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.760408ms [martini] Started GET /api/lb-check for 10.1.1.81:46442 [martini] Completed 200 OK in 684.403µs [martini] Started GET /api/raft-health for 10.1.1.81:46474 [martini] Completed 200 OK in 841.303µs 2018-11-29 04:16:23 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.670916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.019404ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.224909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.379914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.297306ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.304914ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.029313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 830.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.906909ms [martini] Started GET /api/raft-follower-health-report/bd93cf04/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 719.104µs 2018-11-29 04:16:29 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.656616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 989.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.916709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.302014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 839.703µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.970108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.281314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.001404ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.829808ms [martini] Started GET /api/lb-check for 10.1.1.81:46606 [martini] Completed 200 OK in 2.500011ms [martini] Started GET /api/raft-health for 10.1.1.81:46620 [martini] Completed 200 OK in 705.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.231336ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.459106ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.133513ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.82942ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.092304ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.410711ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.383914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.159805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.042509ms 2018-11-29 04:16:35 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/38e1abf2/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 646.702µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.001022ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.381111ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.129209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.218814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 901.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.791908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.218814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.213205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.850908ms [martini] Started GET /api/lb-check for 10.1.1.81:46752 [martini] Completed 200 OK in 777.604µs [martini] Started GET /api/raft-health for 10.1.1.81:46766 [martini] Completed 200 OK in 720.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.590116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 987.005µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.116909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.543816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.893412ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.30481ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.903112ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 847.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.054109ms [martini] Started GET /api/raft-follower-health-report/42f9b56e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 954.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.037117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 914.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.228109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.198914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 827.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.908609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.787112ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 944.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.913117ms [martini] Started GET /api/lb-check for 10.1.1.81:46888 [martini] Completed 200 OK in 771.603µs [martini] Started GET /api/raft-health for 10.1.1.81:46906 [martini] Completed 200 OK in 738.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.936117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.026104ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.024509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.244914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 911.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.806508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.065514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 845.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.744308ms [martini] Started GET /api/raft-follower-health-report/c50f251b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 710.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.166418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.026405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.097709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.676516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 869.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.058509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.255214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 814.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.841408ms [martini] Started GET /api/lb-check for 10.1.1.81:47028 [martini] Completed 200 OK in 619.302µs [martini] Started GET /api/raft-health for 10.1.1.81:47056 [martini] Completed 200 OK in 657.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.576115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 970.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.800116ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.610215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 816.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.003209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.986813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 795.803µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.956808ms [martini] Started GET /api/raft-follower-health-report/0f73c24d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 854.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.509015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 876.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.915709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.307314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 907.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.732007ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.881821ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.895108ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.004908ms [martini] Started GET /api/lb-check for 10.1.1.81:47182 [martini] Completed 200 OK in 593.602µs [martini] Started GET /api/raft-health for 10.1.1.81:47194 [martini] Completed 200 OK in 763.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.55062ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 964.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.145009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.570215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.018304ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27681ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.121013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 819.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.984909ms 2018-11-29 04:17:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/5dfff589/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 838.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.420123ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 927.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.856913ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.476519ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 903.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.34031ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.592416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 992.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20931ms [martini] Started GET /api/lb-check for 10.1.1.81:47322 [martini] Completed 200 OK in 654.403µs [martini] Started GET /api/raft-health for 10.1.1.81:47340 [martini] Completed 200 OK in 642.103µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.345214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 980.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.986909ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.235114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 890.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.861908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.331314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 846.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.115309ms [martini] Started GET /api/raft-follower-health-report/9e4523a6/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 880.104µs 2018-11-29 04:17:29 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:17:29 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.759817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 905.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.757116ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.356914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 794.903µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.731708ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.354414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 776.403µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.768008ms [martini] Started GET /api/lb-check for 10.1.1.81:47460 [martini] Completed 200 OK in 692.303µs [martini] Started GET /api/raft-health for 10.1.1.81:47474 [martini] Completed 200 OK in 846.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.806617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 863.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.038809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.445314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 881.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.964608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.337814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.66702ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.792408ms 2018-11-29 04:17:35 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/486cfe6b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 864.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.785616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.090205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.090009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.458014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 872.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.836208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.493215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 848.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.150709ms [martini] Started GET /api/lb-check for 10.1.1.81:47594 [martini] Completed 200 OK in 826.904µs [martini] Started GET /api/raft-health for 10.1.1.81:47622 [martini] Completed 200 OK in 4.415819ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.860921ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.046005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.927908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.635015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 814.703µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.101809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.286914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 932.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.911709ms [martini] Started GET /api/raft-follower-health-report/acb13735/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.054605ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.899917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 999.405µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.022709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.368714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 791.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.980009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.043013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 903.903µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.935609ms [martini] Started GET /api/lb-check for 10.1.1.81:47742 [martini] Completed 200 OK in 1.768508ms [martini] Started GET /api/raft-health for 10.1.1.81:47762 [martini] Completed 200 OK in 890.304µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.952717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.149705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.730516ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.901517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 909.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.896308ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.822821ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.173905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.601224ms [martini] Started GET /api/raft-follower-health-report/e2cd2ff7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 939.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.565315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 927.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.300009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.655516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 926.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.938508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.222718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.028205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.941409ms [martini] Started GET /api/lb-check for 10.1.1.81:47890 [martini] Completed 200 OK in 587.702µs [martini] Started GET /api/raft-health for 10.1.1.81:47904 [martini] Completed 200 OK in 857.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.851117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 812.503µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.24341ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.382815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 904.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.875517ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.080526ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.034205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.805608ms [martini] Started GET /api/raft-follower-health-report/5f2e7775/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 829.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.571015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 904.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.091209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.408915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 904.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.842508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.142313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 965.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.987809ms [martini] Started GET /api/lb-check for 10.1.1.81:48038 [martini] Completed 200 OK in 909.104µs [martini] Started GET /api/raft-health for 10.1.1.81:48066 [martini] Completed 200 OK in 829.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.634424ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.219306ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.543111ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.219714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 984.105µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.285709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.942913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 930.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.068109ms 2018-11-29 04:18:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/6f26ffd4/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 697.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.438515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 870.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.988209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.099013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.039108ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.885508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.437328ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 929.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.899908ms [martini] Started GET /api/lb-check for 10.1.1.81:48174 [martini] Completed 200 OK in 697.103µs [martini] Started GET /api/raft-health for 10.1.1.81:48208 [martini] Completed 200 OK in 2.35211ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.777516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.048004ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.134409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.472715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 835.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.897908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.124613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 804.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.953221ms [martini] Started GET /api/raft-follower-health-report/433060bd/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 826.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.358318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.162205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.193209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.690516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 794.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.871708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.902513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 875.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.857608ms [martini] Started GET /api/lb-check for 10.1.1.81:48334 [martini] Completed 200 OK in 666.203µs [martini] Started GET /api/raft-health for 10.1.1.81:48348 [martini] Completed 200 OK in 739.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.960117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 924.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.17361ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.668715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 935.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28611ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.386315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 969.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.082009ms 2018-11-29 04:18:35 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:18:35 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/89a859d8/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 664.203µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.615616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.018304ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.414336ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.141313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.044005ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.931909ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.217214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 868.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.845708ms [martini] Started GET /api/lb-check for 10.1.1.81:48470 [martini] Completed 200 OK in 719.003µs [martini] Started GET /api/raft-health for 10.1.1.81:48484 [martini] Completed 200 OK in 629.503µs 2018-11-29 04:18:41 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.752716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 856.303µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.385511ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.433414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.444211ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.877508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.272714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 982.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.102009ms [martini] Started GET /api/raft-follower-health-report/89f696f7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 840.004µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.019117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 971.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.789108ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.148414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 816.203µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.24901ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.251414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 842.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.818116ms [martini] Started GET /api/lb-check for 10.1.1.81:48606 [martini] Completed 200 OK in 736.203µs [martini] Started GET /api/raft-health for 10.1.1.81:48638 [martini] Completed 200 OK in 598.902µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.326815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.069605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.754816ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.304714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 848.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.998409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.331814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 894.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.998409ms [martini] Started GET /api/raft-follower-health-report/15c85424/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 897.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.545715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 957.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.34581ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.689216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 890.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.900108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.074413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 757.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.100109ms [martini] Started GET /api/lb-check for 10.1.1.81:48764 [martini] Completed 200 OK in 707.403µs [martini] Started GET /api/raft-health for 10.1.1.81:48776 [martini] Completed 200 OK in 708.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.670815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 898.103µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.918917ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.239014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 832.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.859908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.064413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 835.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19221ms [martini] Started GET /api/raft-follower-health-report/7d2857d0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 601.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.257718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.096309ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.565816ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.688416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 809.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.107409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.348023ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.101618ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.111509ms [martini] Started GET /api/lb-check for 10.1.1.81:48906 [martini] Completed 200 OK in 708.503µs [martini] Started GET /api/raft-health for 10.1.1.81:48918 [martini] Completed 200 OK in 740.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.616616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 881.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.082709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.714916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 713.703µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.053409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.898513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 868.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.029309ms 2018-11-29 04:19:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/01ee1a16/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 689.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.938117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 865.703µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.000509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.206614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 688.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.098109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.170714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 908.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.838008ms [martini] Started GET /api/lb-check for 10.1.1.81:49044 [martini] Completed 200 OK in 917.204µs [martini] Started GET /api/raft-health for 10.1.1.81:49060 [martini] Completed 200 OK in 766.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.972125ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.076205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.792813ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.487115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 773.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.312518ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.075914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 764.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.290009ms [martini] Started GET /api/raft-follower-health-report/a5286708/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 943.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.899217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 945.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.125117ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.67632ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 771.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.046109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.011813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 764.203µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.891908ms [martini] Started GET /api/lb-check for 10.1.1.81:49184 [martini] Completed 200 OK in 743.804µs [martini] Started GET /api/raft-health for 10.1.1.81:49214 [martini] Completed 200 OK in 692.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.273118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.047304ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.205309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.133414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.062505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.989709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.232214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.560311ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23701ms [martini] Started GET /api/raft-follower-health-report/aa985dd1/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 839.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.390014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 894.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.160309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.026013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 841.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.110909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.359714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 968.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.035909ms [martini] Started GET /api/lb-check for 10.1.1.81:49336 [martini] Completed 200 OK in 853.704µs [martini] Started GET /api/raft-health for 10.1.1.81:49350 [martini] Completed 200 OK in 696.703µs 2018-11-29 04:19:41 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:19:41 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:19:41 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.043218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.201605ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.028309ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.445915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.244105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.951608ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.388815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.121305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.723607ms [martini] Started GET /api/raft-follower-health-report/26754c6f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 773.604µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.763216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.868021ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.116609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.342214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.026204ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.072909ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.031813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 842.203µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.914708ms [martini] Started GET /api/lb-check for 10.1.1.81:49472 [martini] Completed 200 OK in 832.703µs [martini] Started GET /api/raft-health for 10.1.1.81:49490 [martini] Completed 200 OK in 688.803µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.086922ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.078504ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.769408ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.377527ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.033905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.965409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.174514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 921.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.011808ms [martini] Started GET /api/raft-follower-health-report/fd02de1c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 796.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.661816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 938.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25461ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.283814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 885.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.999408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.099013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.960808ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.074209ms [martini] Started GET /api/lb-check for 10.1.1.81:49618 [martini] Completed 200 OK in 608.603µs [martini] Started GET /api/raft-health for 10.1.1.81:49630 [martini] Completed 200 OK in 822.203µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.531316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 955.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.978608ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.912213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 754.403µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.032309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.549415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 958.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.919208ms [martini] Started GET /api/raft-follower-health-report/2b858425/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 691.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.623516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.092505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16921ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.422814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 835.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.976409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.202614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 841.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.001909ms [martini] Started GET /api/lb-check for 10.1.1.81:49762 [martini] Completed 200 OK in 860.004µs [martini] Started GET /api/raft-health for 10.1.1.81:49788 [martini] Completed 200 OK in 642.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.270918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.160413ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.957909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.426014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 885.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.925208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.036113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 986.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.948408ms 2018-11-29 04:20:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/670f30e4/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 848.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.639916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.017304ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.993709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.281114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.427611ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.40771ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.978213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 741.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.985308ms [martini] Started GET /api/lb-check for 10.1.1.81:49910 [martini] Completed 200 OK in 774.203µs [martini] Started GET /api/raft-health for 10.1.1.81:49928 [martini] Completed 200 OK in 1.062505ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.807717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 980.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.30761ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.490315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 822.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.047409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.120913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.340605ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.211514ms [martini] Started GET /api/raft-follower-health-report/462f6e4b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 716.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.253831ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.186405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.827016ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.612433ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 849.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.945209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.912912ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 870.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.025209ms [martini] Started GET /api/lb-check for 10.1.1.81:50056 [martini] Completed 200 OK in 706.103µs [martini] Started GET /api/raft-health for 10.1.1.81:50070 [martini] Completed 200 OK in 846.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.66402ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.037804ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.094813ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.247914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 832.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.993108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.096313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 784.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.958908ms [martini] Started GET /api/raft-follower-health-report/999a3ab3/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 677.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.436115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 974.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.425714ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.431123ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.974313ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.044621ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.315915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 937.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.788008ms [martini] Started GET /api/lb-check for 10.1.1.81:50196 [martini] Completed 200 OK in 818.803µs [martini] Started GET /api/raft-health for 10.1.1.81:50210 [martini] Completed 200 OK in 704.203µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.175518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 961.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.607211ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.916013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 922.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.014709ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.432341ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 878.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.880008ms 2018-11-29 04:20:47 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:20:47 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:20:47 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/a08644b1/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 824.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.442915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.010205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20321ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.227518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 833.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.018709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.147813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 899.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.811208ms [martini] Started GET /api/lb-check for 10.1.1.81:50328 [martini] Completed 200 OK in 2.22171ms [martini] Started GET /api/raft-health for 10.1.1.81:50358 [martini] Completed 200 OK in 766.104µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.414615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 899.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.078009ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.489715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 842.203µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.994008ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.229014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 920.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.996408ms [martini] Started GET /api/raft-follower-health-report/58f544d1/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 782.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.103717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.091505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19501ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.287918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 837.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.779107ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.171914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 934.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.951008ms [martini] Started GET /api/lb-check for 10.1.1.81:50486 [martini] Completed 200 OK in 670.402µs [martini] Started GET /api/raft-health for 10.1.1.81:50502 [martini] Completed 200 OK in 697.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.652016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 917.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.961508ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.127723ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.742907ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.861108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.948412ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 742.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.023809ms [martini] Started GET /api/raft-follower-health-report/32ad5886/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 737.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.820116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.123105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.983009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.194014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.136405ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.852508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.104714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 914.203µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.117822ms [martini] Started GET /api/lb-check for 10.1.1.81:50630 [martini] Completed 200 OK in 685.803µs [martini] Started GET /api/raft-health for 10.1.1.81:50642 [martini] Completed 200 OK in 705.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.803817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.111205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.939608ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.169014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.820008ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.069709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.525215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 862.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.013708ms 2018-11-29 04:21:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/2ba4e4e9/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 833.003µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.687716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 869.503µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.984809ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.059613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 895.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.913908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.615416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 771.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.928108ms [martini] Started GET /api/lb-check for 10.1.1.81:50770 [martini] Completed 200 OK in 811.804µs [martini] Started GET /api/raft-health for 10.1.1.81:50802 [martini] Completed 200 OK in 635.302µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.716116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 925.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.115509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.605015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.039405ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.832308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.346615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 899.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.42941ms [martini] Started GET /api/raft-follower-health-report/366534c0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 803.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.838717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.234306ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.056109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.904142ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 809.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.092609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.921717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.034004ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.891908ms [martini] Started GET /api/lb-check for 10.1.1.81:50908 [martini] Completed 200 OK in 777.704µs [martini] Started GET /api/raft-health for 10.1.1.81:50936 [martini] Completed 200 OK in 796.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.862317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.476106ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.991908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.408615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 957.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.054209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.546124ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 842.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.008309ms [martini] Started GET /api/raft-follower-health-report/a8c60f87/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 695.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.919317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 894.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.146209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.997217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 984.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.117709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.210013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 908.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.959809ms [martini] Started GET /api/lb-check for 10.1.1.81:51062 [martini] Completed 200 OK in 881.704µs [martini] Started GET /api/raft-health for 10.1.1.81:51076 [martini] Completed 200 OK in 1.835008ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.922217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.182505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.501111ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.165914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.158605ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.664012ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.023713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 849.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.665711ms 2018-11-29 04:21:47 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:21:47 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:21:47 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/411c99ee/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 789.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.296527ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.519419ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.388111ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.289614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.018505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.048108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.129013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 771.903µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.995008ms [martini] Started GET /api/lb-check for 10.1.1.81:51194 [martini] Completed 200 OK in 681.803µs [martini] Started GET /api/raft-health for 10.1.1.81:51212 [martini] Completed 200 OK in 870.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.756916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.008204ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.161809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.100418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 6.397328ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.810812ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.106613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 927.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.932208ms [martini] Started GET /api/raft-follower-health-report/f98305fe/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.161605ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.548615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.119005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.863008ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.103913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 867.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.938108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.881117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.051404ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.657138ms [martini] Started GET /api/lb-check for 10.1.1.81:51340 [martini] Completed 200 OK in 716.903µs [martini] Started GET /api/raft-health for 10.1.1.81:51368 [martini] Completed 200 OK in 1.458606ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.848316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.048804ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.143709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.397314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 900.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.086109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.592815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.242206ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.595511ms [martini] Started GET /api/raft-follower-health-report/c85a0c5a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 953.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.397114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.435411ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.960508ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.323514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 901.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.924008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.270914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 935.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.004508ms [martini] Started GET /api/lb-check for 10.1.1.81:51496 [martini] Completed 200 OK in 793.904µs [martini] Started GET /api/raft-health for 10.1.1.81:51510 [martini] Completed 200 OK in 918.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.352318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.113905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.911608ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.251014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 890.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.922908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.023613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 887.703µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.017009ms 2018-11-29 04:22:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/e2b8b6f6/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 996.004µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.740616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 929.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.13751ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.410015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.39701ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.855321ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.092513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 806.803µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.806107ms [martini] Started GET /api/lb-check for 10.1.1.81:51634 [martini] Completed 200 OK in 710.304µs [martini] Started GET /api/raft-health for 10.1.1.81:51652 [martini] Completed 200 OK in 721.403µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.668816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.000005ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.171409ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.218914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.131005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.942309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.169514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 875.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.474824ms [martini] Started GET /api/raft-follower-health-report/2132d698/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 723.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.272418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 852.203µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.904108ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.233014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 829.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.921109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.140813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 950.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.974709ms [martini] Started GET /api/lb-check for 10.1.1.81:51778 [martini] Completed 200 OK in 923.204µs [martini] Started GET /api/raft-health for 10.1.1.81:51792 [martini] Completed 200 OK in 856.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.446215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 839.503µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.009109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.457015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 760.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.001009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.111713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 809.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.039309ms [martini] Started GET /api/raft-follower-health-report/5a0205d1/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 792.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.581216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.150905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.898413ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.255114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 874.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.833508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.201713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 840.103µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.835708ms [martini] Started GET /api/lb-check for 10.1.1.81:51916 [martini] Completed 200 OK in 1.158005ms [martini] Started GET /api/raft-health for 10.1.1.81:51944 [martini] Completed 200 OK in 1.074204ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.990817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.042205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.067309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.384615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.145305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.462815ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.258119ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 812.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.860309ms [martini] Started GET /api/raft-follower-health-report/06d080fc/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 777.503µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.309623ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.012904ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.165009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.805212ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.011105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.920808ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.917312ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.132105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.994008ms [martini] Started GET /api/lb-check for 10.1.1.81:52062 [martini] Completed 200 OK in 775.303µs [martini] Started GET /api/raft-health for 10.1.1.81:52080 [martini] Completed 200 OK in 800.804µs 2018-11-29 04:22:53 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:22:53 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:22:53 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.723316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 853.103µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.017209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.162114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 831.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.186509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.382815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 834.503µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.999608ms [martini] Started GET /api/raft-follower-health-report/996aa105/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 736.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.189518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 936.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.492211ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.255014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 775.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.816008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.889613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 896.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.821407ms [martini] Started GET /api/lb-check for 10.1.1.81:52206 [martini] Completed 200 OK in 756.803µs [martini] Started GET /api/raft-health for 10.1.1.81:52222 [martini] Completed 200 OK in 736.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.724016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.020104ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.423115ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.363515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 952.105µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.159009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.942612ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 939.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.767208ms [martini] Started GET /api/raft-follower-health-report/b6328eaf/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 656.403µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.727216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 868.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.005908ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.134114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 803.603µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.824508ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.482419ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 882.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.970408ms [martini] Started GET /api/lb-check for 10.1.1.81:52354 [martini] Completed 200 OK in 645.003µs [martini] Started GET /api/raft-health for 10.1.1.81:52366 [martini] Completed 200 OK in 679.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.155418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.040004ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.883308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.077326ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 808.703µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.885508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.916813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 913.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.287309ms 2018-11-29 04:23:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/2eddc0a7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 960.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.702316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 978.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19901ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.340414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 926.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.978008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.518115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 918.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.947412ms [martini] Started GET /api/lb-check for 10.1.1.81:52490 [martini] Completed 200 OK in 687.003µs [martini] Started GET /api/raft-health for 10.1.1.81:52522 [martini] Completed 200 OK in 743.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.460415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.103904ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.037809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.353914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 887.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.997309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.968517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 879.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.888708ms [martini] Started GET /api/raft-follower-health-report/d4fd2406/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 767.503µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.085218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 979.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.899834ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.139213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 935.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.976609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.627815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 919.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.119209ms [martini] Started GET /api/lb-check for 10.1.1.81:52642 [martini] Completed 200 OK in 822.603µs [martini] Started GET /api/raft-health for 10.1.1.81:52660 [martini] Completed 200 OK in 877.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.324714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 842.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.922208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.397515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 921.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.831908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.301214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.384319ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.039309ms [martini] Started GET /api/raft-follower-health-report/044bc4ac/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 807.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.495815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.131805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.850108ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.718216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 840.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.025009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.025613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 857.203µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.823508ms [martini] Started GET /api/lb-check for 10.1.1.81:52784 [martini] Completed 200 OK in 872.404µs [martini] Started GET /api/raft-health for 10.1.1.81:52798 [martini] Completed 200 OK in 2.886312ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.892217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.063305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.125109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.224814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 959.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.15321ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.193514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.030704ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.887408ms [martini] Started GET /api/raft-follower-health-report/a8312f2a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 800.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.751321ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 912.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.955208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.73892ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 875.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.818508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.897412ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 862.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.855908ms [martini] Started GET /api/lb-check for 10.1.1.81:52918 [martini] Completed 200 OK in 800.503µs [martini] Started GET /api/raft-health for 10.1.1.81:52948 [martini] Completed 200 OK in 741.504µs 2018-11-29 04:23:53 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:23:53 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:23:53 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.794617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.048605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.960409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.380024ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.544006ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.058008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.164814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 832.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.986609ms [martini] Started GET /api/raft-follower-health-report/583de7ea/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 845.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.324215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 998.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.920608ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.413615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 814.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.966208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.757412ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 998.505µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.703829ms [martini] Started GET /api/lb-check for 10.1.1.81:53056 [martini] Completed 200 OK in 909.304µs [martini] Started GET /api/raft-health for 10.1.1.81:53080 [martini] Completed 200 OK in 1.975009ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.788125ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 918.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.24221ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.077214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 858.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.812108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.941712ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 925.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.920808ms [martini] Started GET /api/raft-follower-health-report/56ef51f5/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 2.789312ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.895717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.252306ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.199209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.853516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.013304ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.356111ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.001513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 825.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.018609ms [martini] Started GET /api/lb-check for 10.1.1.81:53220 [martini] Completed 200 OK in 949.204µs [martini] Started GET /api/raft-health for 10.1.1.81:53230 [martini] Completed 200 OK in 770.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.242414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 913.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.265023ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.968822ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 780.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.798508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.002113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 813.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.066109ms 2018-11-29 04:24:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/c4e63ca4/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 784.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.624716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.160605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.33041ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.289615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 889.703µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.940309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.110918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 868.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.964508ms [martini] Started GET /api/lb-check for 10.1.1.81:53354 [martini] Completed 200 OK in 675.103µs [martini] Started GET /api/raft-health for 10.1.1.81:53370 [martini] Completed 200 OK in 739.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.368414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.031605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.189009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.371915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 922.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.992408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.515515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.050405ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.41541ms [martini] Started GET /api/raft-follower-health-report/fe020caf/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 856.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.516415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 923.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.072709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.564415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 892.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.970409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.007813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 877.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.993508ms [martini] Started GET /api/lb-check for 10.1.1.81:53490 [martini] Completed 200 OK in 869.104µs [martini] Started GET /api/raft-health for 10.1.1.81:53516 [martini] Completed 200 OK in 679.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.062335ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 952.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.151009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.471915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 879.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.459315ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.970817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.424506ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.515311ms [martini] Started GET /api/raft-follower-health-report/54800682/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 744.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.438515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 985.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.032309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.064522ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.227605ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.846908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.204013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 803.903µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.982208ms [martini] Started GET /api/lb-check for 10.1.1.81:53644 [martini] Completed 200 OK in 722.203µs [martini] Started GET /api/raft-health for 10.1.1.81:53658 [martini] Completed 200 OK in 741.803µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.742817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.002604ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.957109ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.293814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.054004ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.24201ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.375015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.32201ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.778812ms [martini] Started GET /api/raft-follower-health-report/4c6ae927/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 981.805µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.008617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 993.005µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.118809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.519715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 987.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.841408ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.366015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 862.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.833907ms [martini] Started GET /api/lb-check for 10.1.1.81:53774 [martini] Completed 200 OK in 622.703µs [martini] Started GET /api/raft-health for 10.1.1.81:53790 [martini] Completed 200 OK in 765.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.571016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.066105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26541ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.411814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.093905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.043909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.352914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 974.105µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.845908ms [martini] Started GET /api/raft-follower-health-report/97b0a11b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 766.603µs 2018-11-29 04:24:59 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:24:59 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:24:59 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.061122ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.487206ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.150009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.345714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 856.003µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.977209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.001313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 896.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.898109ms [martini] Started GET /api/lb-check for 10.1.1.81:53918 [martini] Completed 200 OK in 673.803µs [martini] Started GET /api/raft-health for 10.1.1.81:53930 [martini] Completed 200 OK in 663.402µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.408615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.093504ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.024108ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.297714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 928.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.482828ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.933913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 895.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.084509ms [martini] Started GET /api/raft-follower-health-report/ecd7e2a5/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 833.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.632715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.001704ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.162809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.140313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 851.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.986509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.096614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 893.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.941709ms [martini] Started GET /api/lb-check for 10.1.1.81:54066 [martini] Completed 200 OK in 1.992709ms [martini] Started GET /api/raft-health for 10.1.1.81:54090 [martini] Completed 200 OK in 823.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.409115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 996.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.207709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.550715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 909.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.959309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.092213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 858.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.981009ms 2018-11-29 04:25:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/7ea15796/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 2.681711ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.157922ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.159805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.024309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.172014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 847.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.787708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.237114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 937.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.074109ms [martini] Started GET /api/lb-check for 10.1.1.81:54216 [martini] Completed 200 OK in 619.802µs [martini] Started GET /api/raft-health for 10.1.1.81:54228 [martini] Completed 200 OK in 891.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.548915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 993.105µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.801025ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.185314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 893.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.002908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.936512ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.251605ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.858108ms [martini] Started GET /api/raft-follower-health-report/0f9bd844/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 773.704µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.436515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.100604ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27711ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.054413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 769.703µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.227409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.349423ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.086814ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.796712ms [martini] Started GET /api/lb-check for 10.1.1.81:54352 [martini] Completed 200 OK in 769.203µs [martini] Started GET /api/raft-health for 10.1.1.81:54360 [martini] Completed 200 OK in 782.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.575933ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.094504ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.068009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.161318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.029204ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.068509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.316015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 945.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.134909ms [martini] Started GET /api/raft-follower-health-report/183d1426/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 697.103µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.798916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 818.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.966709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.104613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.004905ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.859108ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.952713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 728.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.923608ms [martini] Started GET /api/lb-check for 10.1.1.81:54496 [martini] Completed 200 OK in 847.203µs [martini] Started GET /api/raft-health for 10.1.1.81:54506 [martini] Completed 200 OK in 733.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 14.604963ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 858.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.065809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.467214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 680.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.855808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.868413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 749.103µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.14411ms [martini] Started GET /api/raft-follower-health-report/05ce3f3a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 698.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.189918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 832.803µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16891ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.034413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 923.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.334136ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.436915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 858.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.986309ms [martini] Started GET /api/lb-check for 10.1.1.81:54626 [martini] Completed 200 OK in 640.903µs [martini] Started GET /api/raft-health for 10.1.1.81:54654 [martini] Completed 200 OK in 923.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.698915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.100405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.139909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.207814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 906.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.895508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.038213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 956.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.674724ms [martini] Started GET /api/raft-follower-health-report/5d87e001/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 881.603µs 2018-11-29 04:25:59 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.100418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.781208ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.031309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.083514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 891.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.970808ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.808213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 970.105µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.870908ms [martini] Started GET /api/lb-check for 10.1.1.81:54782 [martini] Completed 200 OK in 813.603µs [martini] Started GET /api/raft-health for 10.1.1.81:54790 [martini] Completed 200 OK in 915.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.319814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.042609ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.520515ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.615516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.133205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.804012ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.563324ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 904.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.869008ms 2018-11-29 04:26:05 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:26:05 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/55d68336/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 837.304µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.497715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.171005ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.040909ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.028718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.146805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.234509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.426115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.041305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.997408ms [martini] Started GET /api/lb-check for 10.1.1.81:54930 [martini] Completed 200 OK in 849.403µs [martini] Started GET /api/raft-health for 10.1.1.81:54940 [martini] Completed 200 OK in 851.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.411115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.021805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.026809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.287114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.860908ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.966508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.141413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 812.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.891508ms 2018-11-29 04:26:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/edc3d0e3/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 657.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.241614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 991.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.24821ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.660816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.028904ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.962709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.062313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 911.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.994417ms [martini] Started GET /api/lb-check for 10.1.1.81:55070 [martini] Completed 200 OK in 616.803µs [martini] Started GET /api/raft-health for 10.1.1.81:55082 [martini] Completed 200 OK in 1.847708ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.316714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 970.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.168909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.653115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 935.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.038309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.367715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 931.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.801808ms [martini] Started GET /api/raft-follower-health-report/c227ad39/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 887.104µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.037217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 868.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.112309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.162618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 834.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.957708ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.148413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 879.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29121ms [martini] Started GET /api/lb-check for 10.1.1.81:55202 [martini] Completed 200 OK in 653.902µs [martini] Started GET /api/raft-health for 10.1.1.81:55226 [martini] Completed 200 OK in 627.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.450215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.098405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.617332ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.627315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.040804ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.716008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.028213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 884.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.141409ms [martini] Started GET /api/raft-follower-health-report/ba00ce42/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 911.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.646116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 904.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.886808ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.245014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 904.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.596715ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.030617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 838.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.885808ms [martini] Started GET /api/lb-check for 10.1.1.81:55360 [martini] Completed 200 OK in 754.703µs [martini] Started GET /api/raft-health for 10.1.1.81:55370 [martini] Completed 200 OK in 818.804µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.741516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 861.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.184209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.403714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 837.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.911708ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.981113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 829.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.074909ms [martini] Started GET /api/raft-follower-health-report/56cb80a0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 670.003µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.730516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 906.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.195909ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.347114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 810.703µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.992708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.321414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 842.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.844108ms [martini] Started GET /api/lb-check for 10.1.1.81:55490 [martini] Completed 200 OK in 795.203µs [martini] Started GET /api/raft-health for 10.1.1.81:55504 [martini] Completed 200 OK in 702.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.708616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 916.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.189609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.392414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 813.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22901ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.292815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 977.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.083409ms [martini] Started GET /api/raft-follower-health-report/9041646b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 878.303µs 2018-11-29 04:26:59 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.627715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.015513ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.053209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.154613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 858.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.120209ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.391914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.135305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.767808ms [martini] Started GET /api/lb-check for 10.1.1.81:55628 [martini] Completed 200 OK in 964.604µs [martini] Started GET /api/raft-health for 10.1.1.81:55652 [martini] Completed 200 OK in 792.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.776516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.255705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.885308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.203114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 802.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.026709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.668624ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 808.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26291ms 2018-11-29 04:27:05 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:27:05 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/8e5358c2/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 719.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.702916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 885.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.086609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.614116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.022504ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.007408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.126714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 968.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.794907ms [martini] Started GET /api/lb-check for 10.1.1.81:55774 [martini] Completed 200 OK in 2.31031ms [martini] Started GET /api/raft-health for 10.1.1.81:55798 [martini] Completed 200 OK in 682.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.446715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 862.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.066409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.527815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 844.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.871108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.054413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 940.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.971009ms 2018-11-29 04:27:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/072be919/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 4.146718ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.825417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 992.405µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.15551ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.164013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 929.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.115409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.536016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 984.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.834508ms [martini] Started GET /api/lb-check for 10.1.1.81:55924 [martini] Completed 200 OK in 821.603µs [martini] Started GET /api/raft-health for 10.1.1.81:55938 [martini] Completed 200 OK in 728.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.819417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 983.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.878016ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.747716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 856.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.887808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.103814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 959.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.914708ms [martini] Started GET /api/raft-follower-health-report/ca895f0b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 780.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.352614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 913.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.107209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.229814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 908.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.869408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.229123ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 732.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.816808ms [martini] Started GET /api/lb-check for 10.1.1.81:56058 [martini] Completed 200 OK in 590.402µs [martini] Started GET /api/raft-health for 10.1.1.81:56068 [martini] Completed 200 OK in 653.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.571115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.000404ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.096809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.498715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 818.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.074209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.634315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 824.803µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.136709ms [martini] Started GET /api/raft-follower-health-report/bf76bc59/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.012204ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.489528ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.043604ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.038708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.393515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 958.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.946508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.374215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.037205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.975708ms [martini] Started GET /api/lb-check for 10.1.1.81:56200 [martini] Completed 200 OK in 735.803µs [martini] Started GET /api/raft-health for 10.1.1.81:56226 [martini] Completed 200 OK in 728.104µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.543837ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 893.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.100809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.219214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 827.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.897909ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.953013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 860.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.856709ms [martini] Started GET /api/raft-follower-health-report/07ecb734/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 733.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.681816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 943.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.442411ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.263419ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27871ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.098809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.114013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 963.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.825008ms [martini] Started GET /api/lb-check for 10.1.1.81:56350 [martini] Completed 200 OK in 757.903µs [martini] Started GET /api/raft-health for 10.1.1.81:56364 [martini] Completed 200 OK in 767.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.238119ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 889.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.115209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.554815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 986.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.085109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.087213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.187918ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.941408ms [martini] Started GET /api/raft-follower-health-report/f5015880/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.047105ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.46992ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.099805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23401ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.376215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.204705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.035313ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.080113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 802.103µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.960508ms [martini] Started GET /api/lb-check for 10.1.1.81:56490 [martini] Completed 200 OK in 678.703µs [martini] Started GET /api/raft-health for 10.1.1.81:56500 [martini] Completed 200 OK in 5.236622ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.431215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.054405ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.213509ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.773317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.123504ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.44131ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.72242ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.074904ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.755708ms 2018-11-29 04:28:05 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/5eedefc1/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 823.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.712525ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.194014ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.434811ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.289414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 927.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.33691ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.842416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 810.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.833308ms [martini] Started GET /api/lb-check for 10.1.1.81:56640 [martini] Completed 200 OK in 763.704µs [martini] Started GET /api/raft-health for 10.1.1.81:56648 [martini] Completed 200 OK in 794.403µs 2018-11-29 04:28:11 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:28:11 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.845016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 788.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20461ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.418719ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.102205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.996609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.101813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 856.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.860908ms 2018-11-29 04:28:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/5d0f8701/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 807.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.942517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 882.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.129809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.149313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 805.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.104209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.094713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.265609ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.039722ms [martini] Started GET /api/lb-check for 10.1.1.81:56774 [martini] Completed 200 OK in 789.803µs [martini] Started GET /api/raft-health for 10.1.1.81:56800 [martini] Completed 200 OK in 661.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.206213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 917.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.170709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.257214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 946.005µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.902209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.060213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 963.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.884908ms [martini] Started GET /api/raft-follower-health-report/7429d162/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 2.183809ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.474415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 933.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.068409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.580915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 892.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.32301ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.047513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 853.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.825008ms [martini] Started GET /api/lb-check for 10.1.1.81:56922 [martini] Completed 200 OK in 639.703µs [martini] Started GET /api/raft-health for 10.1.1.81:56932 [martini] Completed 200 OK in 772.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.672316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 950.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.910517ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.264814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 826.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.008309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.666915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 962.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.922108ms [martini] Started GET /api/raft-follower-health-report/e3fb9d51/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.229705ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.699916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 749.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.10761ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.164014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 810.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.872908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.274218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.30451ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.136609ms [martini] Started GET /api/lb-check for 10.1.1.81:57062 [martini] Completed 200 OK in 811.303µs [martini] Started GET /api/raft-health for 10.1.1.81:57072 [martini] Completed 200 OK in 889.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.693716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 908.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.159609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.068613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 863.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.104809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.085713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 985.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.807108ms [martini] Started GET /api/raft-follower-health-report/ddfbb49d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.043204ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.586316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.176505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.729411ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.117713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.095904ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.801408ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.317514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 806.203µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.742411ms [martini] Started GET /api/lb-check for 10.1.1.81:57196 [martini] Completed 200 OK in 1.024505ms [martini] Started GET /api/raft-health for 10.1.1.81:57210 [martini] Completed 200 OK in 823.003µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.636716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 960.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.37221ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.041913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.116105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.950009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.436515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 885.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.003209ms [martini] Started GET /api/raft-follower-health-report/3017eb59/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 856.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.149114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 949.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.655916ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.050822ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 871.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.781108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.344915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 818.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.919508ms [martini] Started GET /api/lb-check for 10.1.1.81:57338 [martini] Completed 200 OK in 774.404µs [martini] Started GET /api/raft-health for 10.1.1.81:57364 [martini] Completed 200 OK in 681.003µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.701616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.007805ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.519811ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.411415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 962.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.249409ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.213714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 6.626329ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.40581ms [martini] Started GET /api/raft-follower-health-report/3cf5a9d3/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 925.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.614116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.145205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.981308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.422315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 929.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.882308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.144513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 890.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.860208ms [martini] Started GET /api/lb-check for 10.1.1.81:57496 [martini] Completed 200 OK in 790.803µs [martini] Started GET /api/raft-health for 10.1.1.81:57506 [martini] Completed 200 OK in 845.404µs 2018-11-29 04:29:11 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:29:11 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:29:11 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.698516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.185905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.038408ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.513515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.002304ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.922708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.450415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 835.703µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.884208ms 2018-11-29 04:29:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/cbb4e637/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 677.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.982826ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.172906ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.895908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.509015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 909.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.940508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.171414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.093505ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.780508ms [martini] Started GET /api/lb-check for 10.1.1.81:57634 [martini] Completed 200 OK in 775.304µs [martini] Started GET /api/raft-health for 10.1.1.81:57646 [martini] Completed 200 OK in 670.203µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.622116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 873.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20001ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.118418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.597707ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.738908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.990913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 984.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.762408ms [martini] Started GET /api/raft-follower-health-report/b4787cd5/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 711.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.517215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.094004ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.32721ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.519615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 915.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.17981ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.073814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 946.505µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.277823ms [martini] Started GET /api/lb-check for 10.1.1.81:57768 [martini] Completed 200 OK in 624.602µs [martini] Started GET /api/raft-health for 10.1.1.81:57782 [martini] Completed 200 OK in 709.204µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.504529ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.026204ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.896108ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.013813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 846.303µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.841108ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.218814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 817.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.951108ms [martini] Started GET /api/raft-follower-health-report/8673919d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 9.733842ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.078218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 902.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.067109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.076613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 869.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.847008ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.253914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 804.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.542611ms [martini] Started GET /api/lb-check for 10.1.1.81:57910 [martini] Completed 200 OK in 656.203µs [martini] Started GET /api/raft-health for 10.1.1.81:57932 [martini] Completed 200 OK in 729.503µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.53332ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.55172ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.513911ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.160614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.030505ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.972109ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.279414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 898.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.881908ms [martini] Started GET /api/raft-follower-health-report/c513f17f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 772.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.388719ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.143505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19131ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.321514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.644411ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.009418ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.011313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 854.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.687807ms [martini] Started GET /api/lb-check for 10.1.1.81:58054 [martini] Completed 200 OK in 660.103µs [martini] Started GET /api/raft-health for 10.1.1.81:58070 [martini] Completed 200 OK in 959.804µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.523615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 881.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.721708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.991013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 998.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.771307ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.921713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.020304ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.461523ms [martini] Started GET /api/raft-follower-health-report/e753018b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 831.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.493215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 961.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.13571ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.406315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 839.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.852708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.209514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 927.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.080009ms [martini] Started GET /api/lb-check for 10.1.1.81:58194 [martini] Completed 200 OK in 754.304µs [martini] Started GET /api/raft-health for 10.1.1.81:58202 [martini] Completed 200 OK in 1.291205ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.600624ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.010005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.100909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.088222ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 819.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.807908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.906213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 839.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.876508ms [martini] Started GET /api/raft-follower-health-report/d0e78b91/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 840.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.899817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 963.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.998126ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.608116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 979.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.883208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.845416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 897.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.135309ms [martini] Started GET /api/lb-check for 10.1.1.81:58336 [martini] Completed 200 OK in 796.304µs [martini] Started GET /api/raft-health for 10.1.1.81:58364 [martini] Completed 200 OK in 637.603µs 2018-11-29 04:30:11 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.521016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 978.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.943009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.126514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.877808ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.956217ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.944813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 947.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.688107ms 2018-11-29 04:30:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 04:30:17 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:30:17 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/c9d3d65e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 859.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.930317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 840.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.113309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.481815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 845.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.938808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.933613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 808.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.108713ms [martini] Started GET /api/lb-check for 10.1.1.81:58474 [martini] Completed 200 OK in 711.703µs [martini] Started GET /api/raft-health for 10.1.1.81:58502 [martini] Completed 200 OK in 840.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.736416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 937.905µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.959508ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.028517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.121205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.941609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.298315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 958.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.780108ms [martini] Started GET /api/raft-follower-health-report/b0cb6676/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 791.704µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.014817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.074805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.964109ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.092013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 966.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.36631ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.650216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 927.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.088809ms [martini] Started GET /api/lb-check for 10.1.1.81:58624 [martini] Completed 200 OK in 687.503µs [martini] Started GET /api/raft-health for 10.1.1.81:58634 [martini] Completed 200 OK in 669.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.673716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 6.047726ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.600129ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.171714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 747.003µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.012809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.071913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.045505ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.923308ms [martini] Started GET /api/raft-follower-health-report/a0aa0029/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 756.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.009717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.162805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.203609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.201618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 857.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.227114ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.192214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 628.503µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.255109ms [martini] Started GET /api/lb-check for 10.1.1.81:58758 [martini] Completed 200 OK in 740.203µs [martini] Started GET /api/raft-health for 10.1.1.81:58770 [martini] Completed 200 OK in 719.103µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.943817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 959.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.207109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.958413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 784.503µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.942408ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.020213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.016605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.136409ms [martini] Started GET /api/raft-follower-health-report/c1848069/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 829.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.045118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 991.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.910508ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.473315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 957.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.927109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.221114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.048305ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.967809ms [martini] Started GET /api/lb-check for 10.1.1.81:58898 [martini] Completed 200 OK in 768.004µs [martini] Started GET /api/raft-health for 10.1.1.81:58926 [martini] Completed 200 OK in 710.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.818117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.007504ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.902008ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.290414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.159505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.788508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.116814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 973.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.878008ms [martini] Started GET /api/raft-follower-health-report/d9f73236/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 717.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.616915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.156409ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.821112ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.124514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 680.703µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.919808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.933113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 905.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.953408ms [martini] Started GET /api/lb-check for 10.1.1.81:59048 [martini] Completed 200 OK in 652.503µs [martini] Started GET /api/raft-health for 10.1.1.81:59056 [martini] Completed 200 OK in 685.403µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.874516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.407206ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.924108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.197814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 920.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31271ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.956912ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 951.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.782208ms [martini] Started GET /api/raft-follower-health-report/7fc5535c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.621807ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.514216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 841.803µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.003508ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.172414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 853.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.843108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.083713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 793.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.944109ms [martini] Started GET /api/lb-check for 10.1.1.81:59192 [martini] Completed 200 OK in 1.064205ms [martini] Started GET /api/raft-health for 10.1.1.81:59202 [martini] Completed 200 OK in 638.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.130118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.006904ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19861ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.353514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 980.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.948209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.387514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 929.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.003509ms 2018-11-29 04:31:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 04:31:17 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:31:17 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:31:17 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/16912bc5/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 2.162509ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.815317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 885.103µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.041208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.377215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 956.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.027308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.168114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 766.903µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.023608ms [martini] Started GET /api/lb-check for 10.1.1.81:59330 [martini] Completed 200 OK in 833.203µs [martini] Started GET /api/raft-health for 10.1.1.81:59344 [martini] Completed 200 OK in 777.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.808716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.061405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.067635ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.102613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 911.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.830908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.66762ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 972.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.975909ms [martini] Started GET /api/raft-follower-health-report/8bc805c5/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 695.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.843117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.054004ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.228409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.502915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 893.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.943409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.294123ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 963.105µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.896109ms [martini] Started GET /api/lb-check for 10.1.1.81:59466 [martini] Completed 200 OK in 861.404µs [martini] Started GET /api/raft-health for 10.1.1.81:59488 [martini] Completed 200 OK in 825.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.915017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 957.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.144609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.261814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 804.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.875208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.072213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 801.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.791708ms [martini] Started GET /api/raft-follower-health-report/4a28e273/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 693.903µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.493715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 923.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.069909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.905312ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 848.503µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.015609ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.877712ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 738.203µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.692807ms [martini] Started GET /api/lb-check for 10.1.1.81:59616 [martini] Completed 200 OK in 727.003µs [martini] Started GET /api/raft-health for 10.1.1.81:59624 [martini] Completed 200 OK in 843.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.813539ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.974421ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.38801ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.683642ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.056204ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27311ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.88313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.258906ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.071109ms [martini] Started GET /api/raft-follower-health-report/1c72067c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.193105ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.783916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 871.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.107409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.249314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.786608ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.930208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.940413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 809.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.975709ms [martini] Started GET /api/lb-check for 10.1.1.81:59750 [martini] Completed 200 OK in 730.803µs [martini] Started GET /api/raft-health for 10.1.1.81:59764 [martini] Completed 200 OK in 748.103µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.959426ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.081205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31731ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.902917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 7.739933ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.035509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.927222ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.043305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.063344ms [martini] Started GET /api/raft-follower-health-report/6ebf6987/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.207005ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.515315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 989.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.013209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.175513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 841.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.875708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.962113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 965.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28741ms [martini] Started GET /api/lb-check for 10.1.1.81:59888 [martini] Completed 200 OK in 599.002µs [martini] Started GET /api/raft-health for 10.1.1.81:59898 [martini] Completed 200 OK in 693.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.715916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.066605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.811307ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.305514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 807.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.956408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.350915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 810.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.105709ms [martini] Started GET /api/raft-follower-health-report/c1476138/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 701.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.731416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.108304ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.572424ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.231914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 875.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.014013ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.184114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 938.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.226914ms [martini] Started GET /api/lb-check for 10.1.1.81:60028 [martini] Completed 200 OK in 739.603µs [martini] Started GET /api/raft-health for 10.1.1.81:60054 [martini] Completed 200 OK in 824.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.518615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.101705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.012809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.73052ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 964.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.31674ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.270915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.027704ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.952609ms 2018-11-29 04:32:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/11d37682/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 764.903µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.971318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.021104ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.141409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.233814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 914.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.964409ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.039813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.078605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.371623ms [martini] Started GET /api/lb-check for 10.1.1.81:60184 [martini] Completed 200 OK in 742.603µs [martini] Started GET /api/raft-health for 10.1.1.81:60196 [martini] Completed 200 OK in 926.404µs 2018-11-29 04:32:23 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:32:23 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:32:23 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.531516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 865.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.161709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.142614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 817.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.922508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.181914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 814.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.985509ms [martini] Started GET /api/raft-follower-health-report/9b810a41/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 716.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.578815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.079705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.006109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.555116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 935.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.737808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.038713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 815.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.902808ms [martini] Started GET /api/lb-check for 10.1.1.81:60320 [martini] Completed 200 OK in 724.603µs [martini] Started GET /api/raft-health for 10.1.1.81:60328 [martini] Completed 200 OK in 809.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.841517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.730408ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.969008ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.427415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 898.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.932408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.050014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 862.203µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.901608ms [martini] Started GET /api/raft-follower-health-report/d7ff404b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 825.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.528315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.117305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.021308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.445815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.036205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.749038ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.589616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 794.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.984009ms [martini] Started GET /api/lb-check for 10.1.1.81:60452 [martini] Completed 200 OK in 747.703µs [martini] Started GET /api/raft-health for 10.1.1.81:60464 [martini] Completed 200 OK in 642.602µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.405115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 969.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.933808ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.397815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 872.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.702207ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.100613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.269606ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.750512ms [martini] Started GET /api/raft-follower-health-report/18d440ee/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 814.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.158314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.138805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.24871ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.798217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 870.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.057409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.785717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 812.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.058109ms [martini] Started GET /api/lb-check for 10.1.1.81:60590 [martini] Completed 200 OK in 684.403µs [martini] Started GET /api/raft-health for 10.1.1.81:60618 [martini] Completed 200 OK in 888.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.477515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.097505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.058409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.155814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 939.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.951609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.144814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 947.305µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.847608ms [martini] Started GET /api/raft-follower-health-report/49cb4355/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 674.103µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.571019ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.429806ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31421ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.136414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 787.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.868508ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.043913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 958.105µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.909109ms [martini] Started GET /api/lb-check for 10.1.1.81:60748 [martini] Completed 200 OK in 853.904µs [martini] Started GET /api/raft-health for 10.1.1.81:60760 [martini] Completed 200 OK in 1.096205ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.719216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.020104ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23661ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.202114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.000205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.378028ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.499616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 754.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.840908ms [martini] Started GET /api/raft-follower-health-report/68704b5e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 775.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.974617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.109204ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.084909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.289914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 915.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.13971ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.073213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.065505ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.117618ms [martini] Started GET /api/lb-check for 10.1.1.81:60890 [martini] Completed 200 OK in 1.119905ms [martini] Started GET /api/raft-health for 10.1.1.81:60898 [martini] Completed 200 OK in 779.804µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.555215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.347306ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.013908ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.951413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.070105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.801508ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.305714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 975.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.000609ms 2018-11-29 04:33:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/a373eefd/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 927.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.779516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.023304ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16141ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.761116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.074914ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.845808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.102613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.035004ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.976209ms [martini] Started GET /api/lb-check for 10.1.1.81:32798 [martini] Completed 200 OK in 918.004µs [martini] Started GET /api/raft-health for 10.1.1.81:32826 [martini] Completed 200 OK in 769.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.541719ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.084805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.984709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.537715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 854.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.976809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.950713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 832.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.008213ms [martini] Started GET /api/raft-follower-health-report/e7240960/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 795.603µs 2018-11-29 04:33:29 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:33:29 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:33:29 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.603015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 997.705µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.953109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.970113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.939213ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.833921ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.169913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.873309ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.907008ms [martini] Started GET /api/lb-check for 10.1.1.81:32934 [martini] Completed 200 OK in 651.603µs [martini] Started GET /api/raft-health for 10.1.1.81:32960 [martini] Completed 200 OK in 874.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.615415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 951.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.14621ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.388015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 927.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.078409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.316014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 803.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28101ms [martini] Started GET /api/raft-follower-health-report/842bb39e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 811.103µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.723616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.204805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.946909ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.573716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 901.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.163209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.124813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 791.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.515711ms [martini] Started GET /api/lb-check for 10.1.1.81:33088 [martini] Completed 200 OK in 834.704µs [martini] Started GET /api/raft-health for 10.1.1.81:33096 [martini] Completed 200 OK in 907.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.106017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.011404ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.987408ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.374914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 949.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.073809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.074513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 949.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.029808ms [martini] Started GET /api/raft-follower-health-report/00261780/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 653.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.321714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.146018ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.484615ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.276914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 885.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.821408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.461615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.071504ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.570711ms [martini] Started GET /api/lb-check for 10.1.1.81:33230 [martini] Completed 200 OK in 773.304µs [martini] Started GET /api/raft-health for 10.1.1.81:33244 [martini] Completed 200 OK in 793.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.622316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 985.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.146409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.240414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 824.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.410323ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.252914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 734.103µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.953709ms [martini] Started GET /api/raft-follower-health-report/83409cf8/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 756.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.302814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 767.203µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.13401ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.537015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.115204ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.44941ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.872612ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 875.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.629715ms [martini] Started GET /api/lb-check for 10.1.1.81:33370 [martini] Completed 200 OK in 633.102µs [martini] Started GET /api/raft-health for 10.1.1.81:33392 [martini] Completed 200 OK in 678.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.523115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 896.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23181ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.321014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 875.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.882508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.956612ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 894.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.779507ms [martini] Started GET /api/raft-follower-health-report/46fb46ee/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 670.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.600015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.053805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.33321ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.283814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 911.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.855108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.965113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 784.703µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.895608ms [martini] Started GET /api/lb-check for 10.1.1.81:33530 [martini] Completed 200 OK in 876.704µs [martini] Started GET /api/raft-health for 10.1.1.81:33540 [martini] Completed 200 OK in 746.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.835817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 869.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.645537ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.428815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 916.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.876508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.263214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 987.905µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.019909ms 2018-11-29 04:34:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/69468157/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 778.403µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.641015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 840.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21581ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.025713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 835.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.539024ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.301414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.909408ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.844908ms [martini] Started GET /api/lb-check for 10.1.1.81:33670 [martini] Completed 200 OK in 779.003µs [martini] Started GET /api/raft-health for 10.1.1.81:33684 [martini] Completed 200 OK in 645.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.616616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 998.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.277109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.402515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 819.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.725212ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.875712ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 6.421728ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31301ms [martini] Started GET /api/raft-follower-health-report/65a2c6bf/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 788.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.674816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.072305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29521ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.402015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 952.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.878509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.125614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 803.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.963118ms [martini] Started GET /api/lb-check for 10.1.1.81:33808 [martini] Completed 200 OK in 841.503µs [martini] Started GET /api/raft-health for 10.1.1.81:33818 [martini] Completed 200 OK in 815.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.650115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 976.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.032009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.054313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.009104ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.857709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.372115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 892.903µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.011009ms 2018-11-29 04:34:35 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:34:35 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:34:35 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/1ef796ee/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 821.204µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.541116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 909.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.225427ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.033113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.105605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.989409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.263014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.192406ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.083109ms [martini] Started GET /api/lb-check for 10.1.1.81:33944 [martini] Completed 200 OK in 870.903µs [martini] Started GET /api/raft-health for 10.1.1.81:33970 [martini] Completed 200 OK in 805.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.177935ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 826.403µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.526511ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.157614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.282706ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.485337ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.479315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 936.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.961308ms [martini] Started GET /api/raft-follower-health-report/4c5df979/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 823.703µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.54072ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.367106ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.093609ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.533515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 975.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.034509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.560416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 947.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.069818ms [martini] Started GET /api/lb-check for 10.1.1.81:34098 [martini] Completed 200 OK in 1.046404ms [martini] Started GET /api/raft-health for 10.1.1.81:34112 [martini] Completed 200 OK in 777.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.385914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.272106ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.383811ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.315814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 815.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.051409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.285323ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.172305ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.802408ms [martini] Started GET /api/raft-follower-health-report/3c307289/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 786.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.865817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 827.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.963209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.573015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 808.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.881909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.881212ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 899.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.764108ms [martini] Started GET /api/lb-check for 10.1.1.81:34242 [martini] Completed 200 OK in 697.403µs [martini] Started GET /api/raft-health for 10.1.1.81:34254 [martini] Completed 200 OK in 748.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.397614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 993.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.741821ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.694316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.008004ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.093218ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.175314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.167906ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.446411ms [martini] Started GET /api/raft-follower-health-report/b4479565/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 766.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.407715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.112505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.025309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.305414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.095905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.010709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.41782ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.208018ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.39551ms [martini] Started GET /api/lb-check for 10.1.1.81:34388 [martini] Completed 200 OK in 825.004µs [martini] Started GET /api/raft-health for 10.1.1.81:34400 [martini] Completed 200 OK in 693.003µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.005218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.294105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.817313ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.020713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.015005ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.872908ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.161713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 858.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.959409ms 2018-11-29 04:35:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/51418c59/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 836.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.152027ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.465906ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.831312ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 14.742063ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.029904ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.896112ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.130414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.178005ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.923608ms [martini] Started GET /api/lb-check for 10.1.1.81:34534 [martini] Completed 200 OK in 882.404µs [martini] Started GET /api/raft-health for 10.1.1.81:34562 [martini] Completed 200 OK in 759.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.576915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 945.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.801608ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.201414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 832.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.869008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.700516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 868.703µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.905808ms [martini] Started GET /api/raft-follower-health-report/a1355775/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 801.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.512116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.069205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.925717ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.170118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 793.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.50111ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.218118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 846.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.008308ms [martini] Started GET /api/lb-check for 10.1.1.81:34688 [martini] Completed 200 OK in 804.503µs [martini] Started GET /api/raft-health for 10.1.1.81:34700 [martini] Completed 200 OK in 904.104µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.234314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 784.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.911508ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.315714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 809.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.600607ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.127514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.62122ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.976208ms 2018-11-29 04:35:35 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:35:35 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/2603a72b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 821.504µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.262614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 826.903µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.972208ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.097213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 899.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.998708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.216114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 912.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.818813ms [martini] Started GET /api/lb-check for 10.1.1.81:34826 [martini] Completed 200 OK in 600.303µs [martini] Started GET /api/raft-health for 10.1.1.81:34838 [martini] Completed 200 OK in 4.722121ms 2018-11-29 04:35:41 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.098718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 970.105µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.084609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.288415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 967.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.756408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.972113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.185005ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.164609ms [martini] Started GET /api/raft-follower-health-report/43a02c73/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.289806ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.855917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 959.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.122409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.144913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 920.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.898908ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.093913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 888.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.445511ms [martini] Started GET /api/lb-check for 10.1.1.81:34966 [martini] Completed 200 OK in 818.004µs [martini] Started GET /api/raft-health for 10.1.1.81:34986 [martini] Completed 200 OK in 773.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.551116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 957.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.474619ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.148713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.056105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.057009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.234914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 853.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.805507ms [martini] Started GET /api/raft-follower-health-report/4eef655f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 798.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.630216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.283405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.694812ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.222914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.075005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.967309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.384719ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.305806ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.40901ms [martini] Started GET /api/lb-check for 10.1.1.81:35116 [martini] Completed 200 OK in 859.404µs [martini] Started GET /api/raft-health for 10.1.1.81:35146 [martini] Completed 200 OK in 756.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.007018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.142305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.044708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.066518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 781.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.945109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.346114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 934.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.884008ms [martini] Started GET /api/raft-follower-health-report/d5cfab9c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 763.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.573915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.000304ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.722112ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.319115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 941.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.969808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.041018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 899.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.949209ms [martini] Started GET /api/lb-check for 10.1.1.81:35280 [martini] Completed 200 OK in 676.203µs [martini] Started GET /api/raft-health for 10.1.1.81:35292 [martini] Completed 200 OK in 855.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.560824ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.130814ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.384611ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.099417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 926.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.345411ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.227614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 884.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.993209ms 2018-11-29 04:36:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/0dd3a6fc/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 811.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.332631ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 997.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.151509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.909417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.026313ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.34361ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.467615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 869.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.38881ms [martini] Started GET /api/lb-check for 10.1.1.81:35422 [martini] Completed 200 OK in 934.404µs [martini] Started GET /api/raft-health for 10.1.1.81:35440 [martini] Completed 200 OK in 913.704µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.099918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 978.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.001309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.151814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 844.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.145013ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.725616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 926.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.752338ms [martini] Started GET /api/raft-follower-health-report/fd1cf557/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 651.102µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.919417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.001004ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.461815ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.723316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.101105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.782608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.013413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.233505ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.915908ms [martini] Started GET /api/lb-check for 10.1.1.81:35564 [martini] Completed 200 OK in 1.347106ms [martini] Started GET /api/raft-health for 10.1.1.81:35588 [martini] Completed 200 OK in 733.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.043818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 963.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.836213ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.187518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.070305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22961ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.142818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 980.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.005109ms [martini] Started GET /api/raft-follower-health-report/5461e287/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 853.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.176818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.866012ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.953808ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.499915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 890.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31011ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.690016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 838.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.046309ms [martini] Started GET /api/lb-check for 10.1.1.81:35702 [martini] Completed 200 OK in 703.403µs [martini] Started GET /api/raft-health for 10.1.1.81:35726 [martini] Completed 200 OK in 588.703µs 2018-11-29 04:36:41 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:36:41 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.129326ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.244206ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.012909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.392915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.953808ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.32951ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.976413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 978.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.104909ms 2018-11-29 04:36:47 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/36c6d3f5/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 753.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.572015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.030605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21201ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.626416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.020805ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.696212ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.935117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.115705ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.436815ms [martini] Started GET /api/lb-check for 10.1.1.81:35854 [martini] Completed 200 OK in 785.403µs [martini] Started GET /api/raft-health for 10.1.1.81:35872 [martini] Completed 200 OK in 766.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.314514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 851.903µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.163009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.606615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.025005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.120209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.76422ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.046304ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.965308ms [martini] Started GET /api/raft-follower-health-report/33790ec7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 818.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.510015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.132505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.172709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.554015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.015304ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.083909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.167913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 858.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.025509ms [martini] Started GET /api/lb-check for 10.1.1.81:36004 [martini] Completed 200 OK in 877.204µs [martini] Started GET /api/raft-health for 10.1.1.81:36018 [martini] Completed 200 OK in 905.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.221918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.001404ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.631625ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.515515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 997.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.944609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.048813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 7.943534ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.814208ms [martini] Started GET /api/raft-follower-health-report/0b234641/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 733.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.520015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 904.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.123609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.483415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 989.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.943408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.994122ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 966.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.861408ms [martini] Started GET /api/lb-check for 10.1.1.81:36154 [martini] Completed 200 OK in 762.004µs [martini] Started GET /api/raft-health for 10.1.1.81:36178 [martini] Completed 200 OK in 783.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.912617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.196105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.716612ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.189814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 911.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.945708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.095518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.033204ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.900409ms 2018-11-29 04:37:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/4f6ef70e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 745.203µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.944517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.033504ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.085909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.998013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 864.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.866908ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.416619ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 974.205µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16821ms [martini] Started GET /api/lb-check for 10.1.1.81:36306 [martini] Completed 200 OK in 801.604µs 2018/11/29 04:37:20 [INFO] raft: Starting snapshot up to 437601 2018/11/29 04:37:20 [INFO] snapshot: Creating new snapshot at /var/lib/orchestrator/snapshots/9352-437601-1543466240819.tmp 2018/11/29 04:37:20 [INFO] snapshot: reaping snapshot /var/lib/orchestrator/snapshots/9352-432402-1543439528357 2018/11/29 04:37:20 [INFO] raft: Compacting logs from 427127 to 427361 2018/11/29 04:37:20 [INFO] raft: Snapshot to 437601 complete [martini] Started GET /api/raft-health for 10.1.1.81:36320 [martini] Completed 200 OK in 646.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.616315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.242306ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22621ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.354715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 870.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.026708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.849221ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 894.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.974808ms [martini] Started GET /api/raft-follower-health-report/51f830ed/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 909.404µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.851216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.449319ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.633012ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.275314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 873.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.838908ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.124413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 808.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.12371ms [martini] Started GET /api/lb-check for 10.1.1.81:36452 [martini] Completed 200 OK in 643.703µs [martini] Started GET /api/raft-health for 10.1.1.81:36466 [martini] Completed 200 OK in 968.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.738616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 981.905µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.057909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.437715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.141909ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.437315ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.312614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 854.803µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.254309ms [martini] Started GET /api/raft-follower-health-report/52d4e26e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 898.104µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.323314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.012504ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.975308ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.459615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 821.703µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.916209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.202714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.083004ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.801216ms [martini] Started GET /api/lb-check for 10.1.1.81:36592 [martini] Completed 200 OK in 1.236305ms [martini] Started GET /api/raft-health for 10.1.1.81:36606 [martini] Completed 200 OK in 805.804µs 2018-11-29 04:37:41 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.575116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.332505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.30341ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.448115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 852.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.846108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.177218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.267206ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.937009ms 2018-11-29 04:37:47 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/adb2d01e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 703.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.504915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.085104ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.147709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.402015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 856.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.923608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.204614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 900.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.979808ms [martini] Started GET /api/lb-check for 10.1.1.81:36734 [martini] Completed 200 OK in 773.403µs [martini] Started GET /api/raft-health for 10.1.1.81:36764 [martini] Completed 200 OK in 871.704µs 2018-11-29 04:37:53 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.663415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.107004ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.967408ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.426515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 763.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.17861ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.238714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.260605ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.942609ms [martini] Started GET /api/raft-follower-health-report/ebb3dede/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 890.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.779917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 976.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27331ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.394115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.49961ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.035517ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.070613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 845.703µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20591ms [martini] Started GET /api/lb-check for 10.1.1.81:36900 [martini] Completed 200 OK in 711.103µs [martini] Started GET /api/raft-health for 10.1.1.81:36912 [martini] Completed 200 OK in 828.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.623016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 978.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.112309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.296914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 990.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.931213ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.998813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 995.605µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.146009ms [martini] Started GET /api/raft-follower-health-report/58fcb073/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 644.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.694816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 888.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.110109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.354815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 766.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.084609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.061714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 955.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.006609ms [martini] Started GET /api/lb-check for 10.1.1.81:37048 [martini] Completed 200 OK in 604.902µs [martini] Started GET /api/raft-health for 10.1.1.81:37060 [martini] Completed 200 OK in 942.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.648416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.125305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25671ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.379715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 938.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.908708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.414015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 911.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.35331ms 2018-11-29 04:38:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/159db945/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 895.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.638716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.40881ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.378215ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.451515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 757.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.982608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.490315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 906.103µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.036608ms [martini] Started GET /api/lb-check for 10.1.1.81:37188 [martini] Completed 200 OK in 776.804µs [martini] Started GET /api/raft-health for 10.1.1.81:37202 [martini] Completed 200 OK in 769.903µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.643516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.190306ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28261ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.245214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.416206ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.049608ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.399615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 964.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.040809ms [martini] Started GET /api/raft-follower-health-report/59577b52/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 617.302µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.593316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 900.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.899409ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.529415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 888.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.059409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.324014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.096205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.292119ms [martini] Started GET /api/lb-check for 10.1.1.81:37330 [martini] Completed 200 OK in 749.503µs [martini] Started GET /api/raft-health for 10.1.1.81:37356 [martini] Completed 200 OK in 718.903µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.537015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.087805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.981308ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.888817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.046204ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21791ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.376714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.024905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.990608ms [martini] Started GET /api/raft-follower-health-report/dd9a269c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 776.603µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.672021ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.134005ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.895708ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.929013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 877.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.895913ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.451515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 758.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.866208ms [martini] Started GET /api/lb-check for 10.1.1.81:37484 [martini] Completed 200 OK in 669.803µs [martini] Started GET /api/raft-health for 10.1.1.81:37496 [martini] Completed 200 OK in 691.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.595916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 906.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.747934ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.494128ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 972.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.857308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.345014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 797.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.908508ms 2018-11-29 04:38:47 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:38:47 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/1013b7a5/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 689.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.562915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 983.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.972409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.671916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 933.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.922809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.432915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.039004ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.080209ms [martini] Started GET /api/lb-check for 10.1.1.81:37622 [martini] Completed 200 OK in 633.603µs [martini] Started GET /api/raft-health for 10.1.1.81:37638 [martini] Completed 200 OK in 864.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.553419ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.060205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.013808ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.446415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 954.905µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.307514ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.408814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 875.803µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.81853ms [martini] Started GET /api/raft-follower-health-report/1dfd60a5/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 893.404µs 2018-11-29 04:38:59 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.896017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.048104ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.205709ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.192114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 836.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.878508ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.547615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 756.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.503311ms [martini] Started GET /api/lb-check for 10.1.1.81:37772 [martini] Completed 200 OK in 629.703µs [martini] Started GET /api/raft-health for 10.1.1.81:37792 [martini] Completed 200 OK in 934.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.74295ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.131605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.12201ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.215513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 860.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.982909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.258945ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 866.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.136309ms [martini] Started GET /api/raft-follower-health-report/67bcf25c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.084905ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.43002ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 819.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.527215ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.610915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.594211ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.115709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.930817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 960.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.489311ms [martini] Started GET /api/lb-check for 10.1.1.81:37922 [martini] Completed 200 OK in 808.804µs [martini] Started GET /api/raft-health for 10.1.1.81:37948 [martini] Completed 200 OK in 687.003µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.623115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 966.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.048909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.517516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.338106ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18601ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.440615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 961.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.936838ms 2018-11-29 04:39:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/e8030075/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 782.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.137118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 900.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.363311ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.449915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 981.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.129109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.119513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.284805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.972508ms [martini] Started GET /api/lb-check for 10.1.1.81:38078 [martini] Completed 200 OK in 811.103µs [martini] Started GET /api/raft-health for 10.1.1.81:38094 [martini] Completed 200 OK in 2.162109ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.70092ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 5.812725ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21831ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.672416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.033305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.946508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.211814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.009804ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.002109ms [martini] Started GET /api/raft-follower-health-report/89d7a9d3/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 799.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.485724ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.001404ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.056409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.789217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.200905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.885608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.688616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 949.905µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.962008ms [martini] Started GET /api/lb-check for 10.1.1.81:38222 [martini] Completed 200 OK in 783.004µs [martini] Started GET /api/raft-health for 10.1.1.81:38232 [martini] Completed 200 OK in 819.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.363315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.027704ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16141ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.213914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 833.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.194935ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.050714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 838.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.099009ms [martini] Started GET /api/raft-follower-health-report/08fe7a38/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 757.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.736616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 764.303µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.068009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.426315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 784.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.017409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.294914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 953.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.204814ms [martini] Started GET /api/lb-check for 10.1.1.81:38360 [martini] Completed 200 OK in 750.504µs [martini] Started GET /api/raft-health for 10.1.1.81:38386 [martini] Completed 200 OK in 751.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.056718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16041ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.142809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.986922ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 997.205µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.30731ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.104514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 834.203µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20091ms [martini] Started GET /api/raft-follower-health-report/13eb1d65/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 820.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.887417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 990.905µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20561ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.212814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.125105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.025609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.150018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 888.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.911521ms [martini] Started GET /api/lb-check for 10.1.1.81:38506 [martini] Completed 200 OK in 681.603µs [martini] Started GET /api/raft-health for 10.1.1.81:38530 [martini] Completed 200 OK in 810.604µs 2018-11-29 04:39:53 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:39:53 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.65852ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.418606ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.052409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.253719ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 731.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.790308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.023817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 890.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.30911ms [martini] Started GET /api/raft-follower-health-report/922f100d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 846.104µs 2018-11-29 04:39:59 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.025918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 938.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.105109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.309414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.117005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.228023ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.365015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 966.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.911708ms [martini] Started GET /api/lb-check for 10.1.1.81:38664 [martini] Completed 200 OK in 721.304µs [martini] Started GET /api/raft-health for 10.1.1.81:38678 [martini] Completed 200 OK in 795.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.407715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.036105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.137209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.416915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 941.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.123709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.116413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.056605ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.183109ms [martini] Started GET /api/raft-follower-health-report/c936bb07/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 860.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.483715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 747.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.981408ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.117414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 868.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.219809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.260714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.131905ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.095109ms [martini] Started GET /api/lb-check for 10.1.1.81:38812 [martini] Completed 200 OK in 851.104µs [martini] Started GET /api/raft-health for 10.1.1.81:38824 [martini] Completed 200 OK in 750.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.715916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.076505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.211409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.237814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 987.305µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.35241ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.588016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.043704ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22321ms 2018-11-29 04:40:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/35e1468b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 717.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.705116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.089005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.120913ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.953217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.594211ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.950609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.335214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.273805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.450611ms [martini] Started GET /api/lb-check for 10.1.1.81:38952 [martini] Completed 200 OK in 595.403µs [martini] Started GET /api/raft-health for 10.1.1.81:38982 [martini] Completed 200 OK in 736.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.641616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 917.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.929609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.509816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.319106ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.36161ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.928412ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 810.803µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.41261ms [martini] Started GET /api/raft-follower-health-report/e6d48624/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 742.603µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.443715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 894.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.105509ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.413315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.072405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.969409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.658816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.136705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.576016ms [martini] Started GET /api/lb-check for 10.1.1.81:39108 [martini] Completed 200 OK in 867.304µs [martini] Started GET /api/raft-health for 10.1.1.81:39118 [martini] Completed 200 OK in 983.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.935818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.061705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.940108ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.894717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 867.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.927408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.790329ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.401906ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.076409ms [martini] Started GET /api/raft-follower-health-report/9815d91c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 782.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.630516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.943913ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.009008ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.771116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 897.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.161809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.143622ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18221ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.712312ms [martini] Started GET /api/lb-check for 10.1.1.81:39246 [martini] Completed 200 OK in 775.904µs [martini] Started GET /api/raft-health for 10.1.1.81:39258 [martini] Completed 200 OK in 794.504µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.488115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 857.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.764217ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.214013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.318605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.018009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.456815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.190605ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.072609ms [martini] Started GET /api/raft-follower-health-report/0fa45ca9/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.197405ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.373815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 918.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.24301ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.231819ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 959.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.37681ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.026421ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.673107ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.927409ms [martini] Started GET /api/lb-check for 10.1.1.81:39382 [martini] Completed 200 OK in 673.603µs [martini] Started GET /api/raft-health for 10.1.1.81:39396 [martini] Completed 200 OK in 799.303µs 2018-11-29 04:40:53 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:40:53 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.316114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.071504ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.984309ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.242714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 965.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25121ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.270214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.379306ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.145409ms [martini] Started GET /api/raft-follower-health-report/ace1be63/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 813.504µs 2018-11-29 04:40:59 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.334214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 876.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.009909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.168214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.067105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.906108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.264114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 955.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.969508ms [martini] Started GET /api/lb-check for 10.1.1.81:39532 [martini] Completed 200 OK in 737.503µs [martini] Started GET /api/raft-health for 10.1.1.81:39560 [martini] Completed 200 OK in 1.288805ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.392423ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.460406ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.120709ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.194214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 985.505µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.964109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 24.966808ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 884.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.655911ms [martini] Started GET /api/raft-follower-health-report/2650185b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 693.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.410315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 962.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.021308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.614129ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.010104ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.465924ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.176527ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.125505ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.976909ms [martini] Started GET /api/lb-check for 10.1.1.81:39694 [martini] Completed 200 OK in 699.603µs [martini] Started GET /api/raft-health for 10.1.1.81:39706 [martini] Completed 200 OK in 802.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.461619ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 899.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.020408ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.085413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.015905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.022109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.819916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.061305ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.013309ms 2018-11-29 04:41:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/ba248d7c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 816.503µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.795516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 881.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.945308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.823816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 850.103µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.912208ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.502316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 961.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.946208ms [martini] Started GET /api/lb-check for 10.1.1.81:39838 [martini] Completed 200 OK in 743.403µs [martini] Started GET /api/raft-health for 10.1.1.81:39854 [martini] Completed 200 OK in 840.604µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.498915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 825.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.801308ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.91423ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 933.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.811212ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.372815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 898.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.941908ms [martini] Started GET /api/raft-follower-health-report/e67362e6/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 807.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.309532ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.464511ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.158409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.514633ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.006904ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.41161ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.068313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 993.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.078309ms [martini] Started GET /api/lb-check for 10.1.1.81:39986 [martini] Completed 200 OK in 789.404µs [martini] Started GET /api/raft-health for 10.1.1.81:39998 [martini] Completed 200 OK in 831.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.423015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 975.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.025009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.164414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 998.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.458023ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.654424ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.134605ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.088909ms [martini] Started GET /api/raft-follower-health-report/36e86587/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 819.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.447715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 952.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.209809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.011217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 936.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.841908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.422424ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 986.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.013839ms [martini] Started GET /api/lb-check for 10.1.1.81:40126 [martini] Completed 200 OK in 805.604µs [martini] Started GET /api/raft-health for 10.1.1.81:40150 [martini] Completed 200 OK in 756.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.458415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 843.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.997309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.563816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.020204ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.105409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.388515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 893.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.152409ms [martini] Started GET /api/raft-follower-health-report/121d6b42/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 789.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.610015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 914.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.071809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.674016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 853.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.923908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.435915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.019905ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.021009ms [martini] Started GET /api/lb-check for 10.1.1.81:40278 [martini] Completed 200 OK in 762.304µs [martini] Started GET /api/raft-health for 10.1.1.81:40294 [martini] Completed 200 OK in 844.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.381214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.72872ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.135613ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.776816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 766.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.759608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.885613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 840.903µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.090509ms [martini] Started GET /api/raft-follower-health-report/7ac42a37/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 998.104µs 2018-11-29 04:41:59 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:41:59 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.540516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.049204ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.161609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.962717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.35011ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.560111ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.454415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 923.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.022209ms [martini] Started GET /api/lb-check for 10.1.1.81:40426 [martini] Completed 200 OK in 1.125205ms [martini] Started GET /api/raft-health for 10.1.1.81:40442 [martini] Completed 200 OK in 643.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.634316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 784.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.167509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.077017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.206405ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.940508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.463445ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 824.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.888408ms 2018-11-29 04:42:05 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/71f6223d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.057904ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.544616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 885.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.023408ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.005917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 931.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.172709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.092817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 917.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.632911ms [martini] Started GET /api/lb-check for 10.1.1.81:40580 [martini] Completed 200 OK in 559.402µs [martini] Started GET /api/raft-health for 10.1.1.81:40604 [martini] Completed 200 OK in 1.072105ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.563615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 990.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.135609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.167613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.016804ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.918608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.093314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 928.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.196713ms 2018-11-29 04:42:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/a3da94c7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 690.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.493728ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.223809ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.858617ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.512016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.629916ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.034109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.361415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 920.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.491811ms [martini] Started GET /api/lb-check for 10.1.1.81:40718 [martini] Completed 200 OK in 752.803µs [martini] Started GET /api/raft-health for 10.1.1.81:40748 [martini] Completed 200 OK in 853.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.748116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.075105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21991ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.381215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 932.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.255836ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.215114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 850.103µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.002109ms [martini] Started GET /api/raft-follower-health-report/495eae91/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 653.303µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.027718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.084804ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.980213ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.535716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.010704ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18621ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.151514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.607007ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.64332ms [martini] Started GET /api/lb-check for 10.1.1.81:40868 [martini] Completed 200 OK in 655.603µs [martini] Started GET /api/raft-health for 10.1.1.81:40882 [martini] Completed 200 OK in 1.131805ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.637216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.137905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.609115ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.617016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 988.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.095909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.104731ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.426507ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.853408ms [martini] Started GET /api/raft-follower-health-report/71384c07/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 600.602µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.675716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.132505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.530611ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.297714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 756.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19811ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.987713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.925908ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.420911ms [martini] Started GET /api/lb-check for 10.1.1.81:41012 [martini] Completed 200 OK in 910.504µs [martini] Started GET /api/raft-health for 10.1.1.81:41022 [martini] Completed 200 OK in 644.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.539915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 761.303µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.316932ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.318614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.354506ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.815108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.517115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 915.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.971709ms [martini] Started GET /api/raft-follower-health-report/6ef55cfe/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 816.403µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.656015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.031605ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.32331ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.098614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 940.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.645715ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.155235ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 798.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.34681ms [martini] Started GET /api/lb-check for 10.1.1.81:41142 [martini] Completed 200 OK in 787.004µs [martini] Started GET /api/raft-health for 10.1.1.81:41172 [martini] Completed 200 OK in 788.604µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.441715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.053804ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.048808ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.417915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 879.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.34721ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.536815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 946.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.077613ms [martini] Started GET /api/raft-follower-health-report/fa5943f6/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 811.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.502215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.078404ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.129313ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.328715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 813.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.043309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.742516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 704.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.160627ms [martini] Started GET /api/lb-check for 10.1.1.81:41302 [martini] Completed 200 OK in 891.004µs [martini] Started GET /api/raft-health for 10.1.1.81:41314 [martini] Completed 200 OK in 892.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.728016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 952.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.597611ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.340615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 11.402949ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.949008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.034213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 875.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.902009ms 2018-11-29 04:43:05 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:43:05 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/8210a3dc/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 762.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.333514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 864.503µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.984609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.276127ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 899.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.821508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.994821ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 762.903µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16821ms [martini] Started GET /api/lb-check for 10.1.1.81:41454 [martini] Completed 200 OK in 771.103µs [martini] Started GET /api/raft-health for 10.1.1.81:41466 [martini] Completed 200 OK in 801.903µs 2018-11-29 04:43:11 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.497915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.099705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.166909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.750716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 934.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.874716ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.388915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 891.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.840208ms 2018-11-29 04:43:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/62335839/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.035905ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.645016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 976.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.981213ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.264314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 926.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.738212ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.443315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.105905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.260414ms [martini] Started GET /api/lb-check for 10.1.1.81:41594 [martini] Completed 200 OK in 2.264309ms [martini] Started GET /api/raft-health for 10.1.1.81:41608 [martini] Completed 200 OK in 701.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.777317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 988.105µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28691ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.537316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 957.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.026509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.699916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 755.803µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.075209ms [martini] Started GET /api/raft-follower-health-report/f8473a24/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 816.804µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.986421ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 997.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.352311ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.536024ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.036004ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.887708ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.912512ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.028705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.878908ms [martini] Started GET /api/lb-check for 10.1.1.81:41732 [martini] Completed 200 OK in 634.203µs [martini] Started GET /api/raft-health for 10.1.1.81:41756 [martini] Completed 200 OK in 641.202µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.883217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21401ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.703911ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.257431ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 962.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.164809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.707416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 911.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.687112ms [martini] Started GET /api/raft-follower-health-report/bf4ea13a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 835.003µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.099617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29331ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.118909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.373432ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.147305ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.381219ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.278249ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 952.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.943509ms [martini] Started GET /api/lb-check for 10.1.1.81:41884 [martini] Completed 200 OK in 876.704µs [martini] Started GET /api/raft-health for 10.1.1.81:41896 [martini] Completed 200 OK in 682.403µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.45882ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.078105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.39801ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.148217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 897.503µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.590811ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.913612ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 931.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.968508ms [martini] Started GET /api/raft-follower-health-report/fc53a118/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 809.803µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.845516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.034704ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.233614ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.278314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.028305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.141309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.277515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 760.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.895808ms [martini] Started GET /api/lb-check for 10.1.1.81:42022 [martini] Completed 200 OK in 635.103µs [martini] Started GET /api/raft-health for 10.1.1.81:42036 [martini] Completed 200 OK in 988.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.940017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.246205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.564411ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.724017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.022205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.141609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.070318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 803.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.088309ms [martini] Started GET /api/raft-follower-health-report/a8d0c2d9/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 805.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.699916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 936.805µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.777316ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.263018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.263905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.000608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.125814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 851.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.155309ms [martini] Started GET /api/lb-check for 10.1.1.81:42162 [martini] Completed 200 OK in 806.003µs [martini] Started GET /api/raft-health for 10.1.1.81:42176 [martini] Completed 200 OK in 652.503µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.714216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.037805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.955108ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.702816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.230206ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.974808ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.719047ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 23.698502ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29701ms 2018-11-29 04:44:05 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/466bc6c3/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 956.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.603615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 898.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.102009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.65892ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.005804ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.985908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.543324ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 915.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.109609ms [martini] Started GET /api/lb-check for 10.1.1.81:42312 [martini] Completed 200 OK in 800.203µs [martini] Started GET /api/raft-health for 10.1.1.81:42336 [martini] Completed 200 OK in 4.58502ms 2018-11-29 04:44:11 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:44:11 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.908117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.112705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.896308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.373915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 769.003µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.966609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.721816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.074505ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.951809ms 2018-11-29 04:44:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/b9a101cb/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 2.32741ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.276728ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.882708ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.481911ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.597715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.212706ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28511ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.816016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 965.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.150209ms [martini] Started GET /api/lb-check for 10.1.1.81:42462 [martini] Completed 200 OK in 910.704µs [martini] Started GET /api/raft-health for 10.1.1.81:42476 [martini] Completed 200 OK in 820.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.518516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.627207ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.995017ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.242718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.044604ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.000708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.368515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.104605ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.815608ms [martini] Started GET /api/raft-follower-health-report/ce3bb821/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 754.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.463115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.110105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16991ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.844917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 919.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.801608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.038322ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.636107ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.119009ms [martini] Started GET /api/lb-check for 10.1.1.81:42598 [martini] Completed 200 OK in 655.503µs [martini] Started GET /api/raft-health for 10.1.1.81:42610 [martini] Completed 200 OK in 777.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.795716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.249406ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.049209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.724624ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 838.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.36581ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.861817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 995.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.998909ms [martini] Started GET /api/raft-follower-health-report/fc269586/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.343906ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.267219ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 958.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26151ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.253819ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 905.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.421823ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.383515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.016205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29711ms [martini] Started GET /api/lb-check for 10.1.1.81:42742 [martini] Completed 200 OK in 787.403µs [martini] Started GET /api/raft-health for 10.1.1.81:42752 [martini] Completed 200 OK in 801.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.416032ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.940909ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.976809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.434015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 917.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20491ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.000213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 913.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.13941ms [martini] Started GET /api/raft-follower-health-report/624b241c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.267806ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.267914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.000904ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.938009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.391215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.30701ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.133509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.056713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.018105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.961808ms [martini] Started GET /api/lb-check for 10.1.1.81:42878 [martini] Completed 200 OK in 773.203µs [martini] Started GET /api/raft-health for 10.1.1.81:42906 [martini] Completed 200 OK in 816.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.589716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 826.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.147509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.536015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 958.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.617412ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.242514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.166705ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.235009ms [martini] Started GET /api/raft-follower-health-report/d2c169b4/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.706107ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.819721ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.653607ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.112809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.396515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 883.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.887808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.157914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.272505ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.069009ms [martini] Started GET /api/lb-check for 10.1.1.81:43038 [martini] Completed 200 OK in 697.703µs [martini] Started GET /api/raft-health for 10.1.1.81:43050 [martini] Completed 200 OK in 880.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.029239ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.680908ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19531ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 19.496085ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 955.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.246135ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.58632ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 749.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.34011ms 2018-11-29 04:45:05 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/d779e206/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 751.503µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.405619ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.985709ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.828212ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.801617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 887.703µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.927309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.275614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.092105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.205809ms [martini] Started GET /api/lb-check for 10.1.1.81:43194 [martini] Completed 200 OK in 707.103µs [martini] Started GET /api/raft-health for 10.1.1.81:43204 [martini] Completed 200 OK in 776.803µs 2018-11-29 04:45:11 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.004717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.050204ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.138309ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.266114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.241106ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.863708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.332114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 894.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.907809ms 2018-11-29 04:45:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 04:45:17 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/dc6b0f20/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.731207ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.422115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.108305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18261ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.345718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 838.003µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.659811ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.43482ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 892.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.998731ms [martini] Started GET /api/lb-check for 10.1.1.81:43330 [martini] Completed 200 OK in 769.604µs [martini] Started GET /api/raft-health for 10.1.1.81:43358 [martini] Completed 200 OK in 794.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.844221ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.064705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31851ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.494415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.215006ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.130909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.330115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 909.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.196509ms [martini] Started GET /api/raft-follower-health-report/01f857fb/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 767.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.028422ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.011404ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.624212ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.864517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 974.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.066809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.252115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.030404ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.758812ms [martini] Started GET /api/lb-check for 10.1.1.81:43470 [martini] Completed 200 OK in 644.103µs [martini] Started GET /api/raft-health for 10.1.1.81:43496 [martini] Completed 200 OK in 680.403µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.856721ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 861.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.425724ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.340523ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.469207ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26461ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.344815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.326905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.943008ms [martini] Started GET /api/raft-follower-health-report/c054a2a7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 764.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.595119ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.168405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.132209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.100118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.183605ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.376815ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.478819ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 941.905µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.151209ms [martini] Started GET /api/lb-check for 10.1.1.81:43630 [martini] Completed 200 OK in 1.023304ms [martini] Started GET /api/raft-health for 10.1.1.81:43642 [martini] Completed 200 OK in 669.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.69792ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 959.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16901ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.203013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 948.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.156009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.041413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.494406ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.998009ms [martini] Started GET /api/raft-follower-health-report/98a66630/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 652.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.415115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.867608ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.607311ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.894717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.164905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.131709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.511516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 910.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.746812ms [martini] Started GET /api/lb-check for 10.1.1.81:43766 [martini] Completed 200 OK in 657.203µs [martini] Started GET /api/raft-health for 10.1.1.81:43782 [martini] Completed 200 OK in 906.704µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.557515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 960.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.952208ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.406219ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 882.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.646111ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.339614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 914.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.941408ms [martini] Started GET /api/raft-follower-health-report/4dbd7731/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 602.802µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.171418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 7.823934ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.704611ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.324715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.056705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.080409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.393715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 778.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.642311ms [martini] Started GET /api/lb-check for 10.1.1.81:43910 [martini] Completed 200 OK in 750.603µs [martini] Started GET /api/raft-health for 10.1.1.81:43934 [martini] Completed 200 OK in 699.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.346619ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 940.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.128409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.226914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 759.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.718507ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 16.935773ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 817.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.921309ms 2018-11-29 04:46:05 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/e3748b64/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 856.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.72612ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 942.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.158109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.706416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 899.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.777107ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.234419ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.242406ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.074309ms [martini] Started GET /api/lb-check for 10.1.1.81:44074 [martini] Completed 200 OK in 1.849208ms [martini] Started GET /api/raft-health for 10.1.1.81:44086 [martini] Completed 200 OK in 740.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.824821ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 831.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.607311ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.171814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.110305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19661ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.058713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 945.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.969608ms 2018-11-29 04:46:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 04:46:17 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:46:17 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/ba1662c1/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 2.46331ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.003826ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 964.905µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.197809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.994217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 932.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.113909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.032813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 764.103µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.577711ms [martini] Started GET /api/lb-check for 10.1.1.81:44212 [martini] Completed 200 OK in 825.104µs [martini] Started GET /api/raft-health for 10.1.1.81:44228 [martini] Completed 200 OK in 759.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.780516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 936.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.91683ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.992217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 741.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.799208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.127614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 879.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.005109ms [martini] Started GET /api/raft-follower-health-report/b05814f1/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 611.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.375119ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 961.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.521211ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.730316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.077805ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.959408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.245235ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.121305ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.628516ms [martini] Started GET /api/lb-check for 10.1.1.81:44354 [martini] Completed 200 OK in 592.402µs [martini] Started GET /api/raft-health for 10.1.1.81:44366 [martini] Completed 200 OK in 816.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.652516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 990.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.055308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.585316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 935.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.871808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.275723ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 887.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.902813ms [martini] Started GET /api/raft-follower-health-report/1944b407/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 832.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.438541ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 859.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20011ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.22434ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.778516ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.956817ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.756438ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.957721ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.42361ms [martini] Started GET /api/lb-check for 10.1.1.81:44496 [martini] Completed 200 OK in 613.703µs [martini] Started GET /api/raft-health for 10.1.1.81:44520 [martini] Completed 200 OK in 787.904µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.693233ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.099705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.968108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.286314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 829.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.895108ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.133714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.574115ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.914309ms [martini] Started GET /api/raft-follower-health-report/be75a115/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 812.103µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.904217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.051405ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.222309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.745929ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.064305ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.722507ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.282714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 988.605µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.021109ms [martini] Started GET /api/lb-check for 10.1.1.81:44644 [martini] Completed 200 OK in 712.603µs [martini] Started GET /api/raft-health for 10.1.1.81:44658 [martini] Completed 200 OK in 715.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.663016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 965.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.408611ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.889721ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 871.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.823808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.491019ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.187605ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.862008ms [martini] Started GET /api/raft-follower-health-report/c0260a4d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 857.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.869117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.338705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.34651ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.643615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 987.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.948309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.001113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 887.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.116109ms [martini] Started GET /api/lb-check for 10.1.1.81:44784 [martini] Completed 200 OK in 682.803µs [martini] Started GET /api/raft-health for 10.1.1.81:44796 [martini] Completed 200 OK in 2.25731ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.903943ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 872.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.865012ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.472737ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.000404ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.48491ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.772621ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.455606ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31341ms [martini] Started GET /api/raft-follower-health-report/ed1a6421/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 834.604µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.817216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.763512ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.664611ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.369623ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 902.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.398311ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.144222ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 941.905µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.047109ms [martini] Started GET /api/lb-check for 10.1.1.81:44936 [martini] Completed 200 OK in 607.703µs [martini] Started GET /api/raft-health for 10.1.1.81:44946 [martini] Completed 200 OK in 999.904µs 2018-11-29 04:47:11 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.732816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 976.605µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.415111ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.494315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 977.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.258923ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.106213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 967.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.953209ms 2018-11-29 04:47:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/83985fdb/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 665.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.417215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.020804ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.687812ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.645746ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 955.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.181509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.350915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 852.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.335514ms [martini] Started GET /api/lb-check for 10.1.1.81:45070 [martini] Completed 200 OK in 634.303µs [martini] Started GET /api/raft-health for 10.1.1.81:45102 [martini] Completed 200 OK in 707.703µs 2018-11-29 04:47:23 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:47:23 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.572415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 955.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.025609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.300614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 971.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.915809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.875712ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 944.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.982109ms [martini] Started GET /api/raft-follower-health-report/9cabf131/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 872.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.831216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 867.703µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.17261ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.297315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.041404ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.014709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.423615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 903.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.025608ms [martini] Started GET /api/lb-check for 10.1.1.81:45224 [martini] Completed 200 OK in 698.003µs [martini] Started GET /api/raft-health for 10.1.1.81:45236 [martini] Completed 200 OK in 820.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.46592ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.372506ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.985522ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.422919ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.363106ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.979109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.127418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.061404ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.41321ms [martini] Started GET /api/raft-follower-health-report/c79fa215/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 859.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.641416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 896.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26901ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.173135ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.014104ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.913508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 13.156957ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 839.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.886708ms [martini] Started GET /api/lb-check for 10.1.1.81:45370 [martini] Completed 200 OK in 712.003µs [martini] Started GET /api/raft-health for 10.1.1.81:45382 [martini] Completed 200 OK in 690.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.110917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 855.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.007909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.235218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 816.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.131409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.048013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 826.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.170009ms [martini] Started GET /api/raft-follower-health-report/f9c97071/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.371906ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.669115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.197106ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.098209ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.392715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 678.503µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.977409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.020014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 791.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.819708ms [martini] Started GET /api/lb-check for 10.1.1.81:45504 [martini] Completed 200 OK in 924.304µs [martini] Started GET /api/raft-health for 10.1.1.81:45530 [martini] Completed 200 OK in 1.283706ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.114818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.051704ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29201ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.390015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.068404ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.042008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.713611ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 865.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29951ms [martini] Started GET /api/raft-follower-health-report/8a131298/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 802.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.945017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.100405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.688329ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.413314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 905.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.956708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.957513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.078004ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.915308ms [martini] Started GET /api/lb-check for 10.1.1.81:45646 [martini] Completed 200 OK in 873.304µs [martini] Started GET /api/raft-health for 10.1.1.81:45674 [martini] Completed 200 OK in 1.035204ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.527616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 994.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.152409ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.986352ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.076509ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.998209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.370928ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 880.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.917808ms [martini] Started GET /api/raft-follower-health-report/0afce84d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 755.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.021617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 896.503µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.059309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.992535ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.526006ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.337911ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.63192ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 985.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.030809ms [martini] Started GET /api/lb-check for 10.1.1.81:45814 [martini] Completed 200 OK in 690.503µs [martini] Started GET /api/raft-health for 10.1.1.81:45826 [martini] Completed 200 OK in 2.33831ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.046718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 855.903µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.878608ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.414815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 765.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.106209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.259814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.012904ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25971ms 2018-11-29 04:48:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 04:48:17 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/4da4d413/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 883.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.574224ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.077204ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.904608ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.076214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 932.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.915809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.348415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 821.703µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.125409ms [martini] Started GET /api/lb-check for 10.1.1.81:45950 [martini] Completed 200 OK in 850.803µs [martini] Started GET /api/raft-health for 10.1.1.81:45966 [martini] Completed 200 OK in 729.503µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.624715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 707.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.39511ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.775416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.037405ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.992209ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.157713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.026904ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.998408ms [martini] Started GET /api/raft-follower-health-report/26636eab/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 744.404µs 2018-11-29 04:48:29 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 04:48:29 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.030218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 932.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.014608ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.433215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 885.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.807708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.061513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.910212ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.515011ms [martini] Started GET /api/lb-check for 10.1.1.81:46086 [martini] Completed 200 OK in 683.003µs [martini] Started GET /api/raft-health for 10.1.1.81:46110 [martini] Completed 200 OK in 651.203µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.859016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.039104ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.863009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.017321ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 832.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.509111ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.285823ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 910.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.129609ms [martini] Started GET /api/raft-follower-health-report/befdd42a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 7.342831ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.61332ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.060704ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.182109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.268118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.103505ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.13001ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.837325ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 971.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.253509ms [martini] Started GET /api/lb-check for 10.1.1.81:46228 [martini] Completed 200 OK in 894.804µs [martini] Started GET /api/raft-health for 10.1.1.81:46254 [martini] Completed 200 OK in 906.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.178819ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.417311ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.057209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.252814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 998.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.976008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.180214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 781.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26071ms [martini] Started GET /api/raft-follower-health-report/f8ab2e47/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 805.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.416228ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 954.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27631ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.321614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 991.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 12.091352ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.396215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 958.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.015609ms [martini] Started GET /api/lb-check for 10.1.1.81:46382 [martini] Completed 200 OK in 599.603µs [martini] Started GET /api/raft-health for 10.1.1.81:46398 [martini] Completed 200 OK in 753.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.576816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 966.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.450411ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.456315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 903.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.972509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.281714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.039305ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.980326ms [martini] Started GET /api/raft-follower-health-report/47231502/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.479706ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.117618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.025809ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.508115ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.177627ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.510507ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.007408ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.128718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 850.203µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.092609ms [martini] Started GET /api/lb-check for 10.1.1.81:46530 [martini] Completed 200 OK in 957.004µs [martini] Started GET /api/raft-health for 10.1.1.81:46542 [martini] Completed 200 OK in 913.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.991321ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.184806ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.487811ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.985217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 822.003µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 14.650664ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.029926ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 873.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.786608ms [martini] Started GET /api/raft-follower-health-report/b8959940/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.142105ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.191018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.335006ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.829621ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.019522ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.131005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.149509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.122913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.721212ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.550311ms [martini] Started GET /api/lb-check for 10.1.1.81:46684 [martini] Completed 200 OK in 821.403µs [martini] Started GET /api/raft-health for 10.1.1.81:46710 [martini] Completed 200 OK in 662.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.611015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 818.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.39921ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.173114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 711.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.389619ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.365715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.388106ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.879208ms 2018-11-29 04:49:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/565d2149/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 955.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.227123ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.054509ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.968009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.624138ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.032204ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.008708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.886717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 764.203µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.833408ms [martini] Started GET /api/lb-check for 10.1.1.81:46838 [martini] Completed 200 OK in 2.571112ms [martini] Started GET /api/raft-health for 10.1.1.81:46852 [martini] Completed 200 OK in 832.203µs 2018-11-29 04:49:23 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.753016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 974.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.089909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.326015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 811.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.986609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.330615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 844.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.985408ms [martini] Started GET /api/raft-follower-health-report/9f073b7e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 719.603µs 2018-11-29 04:49:29 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.214118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.398806ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.968508ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.181014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 849.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.666511ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.109413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 833.203µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.36361ms [martini] Started GET /api/lb-check for 10.1.1.81:46974 [martini] Completed 200 OK in 636.603µs [martini] Started GET /api/raft-health for 10.1.1.81:46984 [martini] Completed 200 OK in 622.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.669515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 984.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.249809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.480041ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29771ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.858608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.058017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.658107ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.097509ms 2018-11-29 04:49:35 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/a86f0aeb/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 964.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.568316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 913.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.33771ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.264823ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 971.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.152909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.336723ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.482515ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.565711ms [martini] Started GET /api/lb-check for 10.1.1.81:47116 [martini] Completed 200 OK in 882.904µs [martini] Started GET /api/raft-health for 10.1.1.81:47132 [martini] Completed 200 OK in 727.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.285114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 911.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.893913ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.303814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 832.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.964009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.157314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 789.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.904108ms [martini] Started GET /api/raft-follower-health-report/6e23aec4/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 771.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.884317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 958.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.538011ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.464215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 996.505µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.005109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.174114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.014504ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.601511ms [martini] Started GET /api/lb-check for 10.1.1.81:47258 [martini] Completed 200 OK in 1.018405ms [martini] Started GET /api/raft-health for 10.1.1.81:47286 [martini] Completed 200 OK in 795.403µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.101039ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 872.903µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.108909ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.320714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 869.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.14091ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.627616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 928.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.845408ms [martini] Started GET /api/raft-follower-health-report/806ab34a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 845.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.433415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.139105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.210509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.014622ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 5.148222ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.945309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.431415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.024304ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.904008ms [martini] Started GET /api/lb-check for 10.1.1.81:47412 [martini] Completed 200 OK in 728.603µs [martini] Started GET /api/raft-health for 10.1.1.81:47424 [martini] Completed 200 OK in 792.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.411619ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.151705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.780012ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.616516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.085305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.08161ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.049114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.071808ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.590816ms [martini] Started GET /api/raft-follower-health-report/9b4b4f53/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 949.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.653015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.067405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.963509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.593216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 811.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.585212ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.166413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.089305ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.17941ms [martini] Started GET /api/lb-check for 10.1.1.81:47564 [martini] Completed 200 OK in 765.003µs [martini] Started GET /api/raft-health for 10.1.1.81:47578 [martini] Completed 200 OK in 1.643807ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.647015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.037205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.982409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.316314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 946.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.117209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.079413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 783.503µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.286909ms 2018-11-29 04:50:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/75a13162/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 674.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.730416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.686612ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.387514ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.355114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.069505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.108809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.663816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 967.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.941713ms [martini] Started GET /api/lb-check for 10.1.1.81:47708 [martini] Completed 200 OK in 849.804µs [martini] Started GET /api/raft-health for 10.1.1.81:47724 [martini] Completed 200 OK in 735.203µs 2018-11-29 04:50:23 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.677516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.524507ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.939309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.515715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.231905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.806816ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.522715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.031805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.120509ms [martini] Started GET /api/raft-follower-health-report/4d1a7d44/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 731.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.972117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.284306ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.160209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.170314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 869.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.307714ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.308414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.067905ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.134309ms [martini] Started GET /api/lb-check for 10.1.1.81:47848 [martini] Completed 200 OK in 1.858108ms [martini] Started GET /api/raft-health for 10.1.1.81:47874 [martini] Completed 200 OK in 632.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.691716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.017405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.018909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.583224ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.121705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.895508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.737721ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 981.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.585611ms 2018-11-29 04:50:35 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/d831e8d1/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 668.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.75692ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.552511ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.252914ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.357424ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 900.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.318836ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.420219ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.999508ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.020409ms [martini] Started GET /api/lb-check for 10.1.1.81:48002 [martini] Completed 200 OK in 656.603µs [martini] Started GET /api/raft-health for 10.1.1.81:48012 [martini] Completed 200 OK in 613.203µs 2018-11-29 04:50:41 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.322213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 878.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.849107ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.609414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.162116ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.042508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.004716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 900.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.872308ms [martini] Started GET /api/raft-follower-health-report/668c7887/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.006204ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.659914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.035104ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.035008ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.271713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 907.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.069509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.366813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.646715ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.524622ms [martini] Started GET /api/lb-check for 10.1.1.81:48138 [martini] Completed 200 OK in 945.604µs [martini] Started GET /api/raft-health for 10.1.1.81:48154 [martini] Completed 200 OK in 804.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.825816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 774.803µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.002808ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.183225ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.205304ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.913107ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.054513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 947.903µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.699711ms [martini] Started GET /api/raft-follower-health-report/6d20bc3f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 675.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.950515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.104604ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.960908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.224913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 973.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.353309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.552414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 808.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.834408ms [martini] Started GET /api/lb-check for 10.1.1.81:48280 [martini] Completed 200 OK in 703.503µs [martini] Started GET /api/raft-health for 10.1.1.81:48302 [martini] Completed 200 OK in 770.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.338113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.874608ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.181109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.904932ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 933.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.980408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.229521ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 874.203µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.055608ms [martini] Started GET /api/raft-follower-health-report/984ac753/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 836.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.427018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 973.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.963608ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.497622ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.168804ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.14502ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.497214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 813.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.902608ms [martini] Started GET /api/lb-check for 10.1.1.81:48426 [martini] Completed 200 OK in 871.403µs [martini] Started GET /api/raft-health for 10.1.1.81:48454 [martini] Completed 200 OK in 624.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.442518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 960.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.701111ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.278114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.527106ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.852508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.501414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.587511ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.973808ms 2018-11-29 04:51:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/25a03780/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 620.802µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.874919ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.014204ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.259009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.599614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.356905ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.088508ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.216713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 824.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.245309ms [martini] Started GET /api/lb-check for 10.1.1.81:48586 [martini] Completed 200 OK in 793.303µs [martini] Started GET /api/raft-health for 10.1.1.81:48600 [martini] Completed 200 OK in 708.903µs 2018-11-29 04:51:23 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.948916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.663706ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.34181ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.148217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 818.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.697011ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.218913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 842.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.991308ms [martini] Started GET /api/raft-follower-health-report/b0090ba7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 667.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.624722ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.172809ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.41661ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.94242ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 763.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.052112ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.772615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 813.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.025708ms [martini] Started GET /api/lb-check for 10.1.1.81:48724 [martini] Completed 200 OK in 804.904µs [martini] Started GET /api/raft-health for 10.1.1.81:48734 [martini] Completed 200 OK in 747.503µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.854715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.030908ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.251909ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.891336ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.617111ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.274517ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.05732ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 878.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.733607ms [martini] Started GET /api/raft-follower-health-report/54b7a9d8/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 846.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.198817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 976.103µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.137608ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.85632ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.016404ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.33431ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.588819ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 976.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.248509ms [martini] Started GET /api/lb-check for 10.1.1.81:48860 [martini] Completed 200 OK in 7.093328ms [martini] Started GET /api/raft-health for 10.1.1.81:48884 [martini] Completed 200 OK in 910.904µs 2018-11-29 04:51:41 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.631014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 946.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.157409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.288033ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 999.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.181009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.645114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.166805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.954608ms 2018-11-29 04:51:47 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/c05d268b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 967.504µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.974316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 894.703µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.134309ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.200113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.037504ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.964908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.347113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 945.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.994408ms [martini] Started GET /api/lb-check for 10.1.1.81:49006 [martini] Completed 200 OK in 1.187204ms [martini] Started GET /api/raft-health for 10.1.1.81:49028 [martini] Completed 200 OK in 697.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.002116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.036604ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.876123ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.351214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 819.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.221509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.162213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.001404ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.822708ms [martini] Started GET /api/raft-follower-health-report/d8b6141d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 970.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.363017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 918.603µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.060608ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.416914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 948.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.929316ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.720839ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.671307ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.140109ms [martini] Started GET /api/lb-check for 10.1.1.81:49158 [martini] Completed 200 OK in 740.203µs [martini] Started GET /api/raft-health for 10.1.1.81:49172 [martini] Completed 200 OK in 3.082012ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.98592ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.082004ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.39411ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.019712ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.023904ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.36991ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.041313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 797.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.770507ms [martini] Started GET /api/raft-follower-health-report/4bedb1b6/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 906.004µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.019016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 955.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.047009ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.475318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.436906ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.222109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.664723ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 971.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.60401ms [martini] Started GET /api/lb-check for 10.1.1.81:49306 [martini] Completed 200 OK in 681.003µs [martini] Started GET /api/raft-health for 10.1.1.81:49316 [martini] Completed 200 OK in 781.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.339717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.171404ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.377009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.207813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.002804ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.884907ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.427514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.043904ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.104309ms 2018-11-29 04:52:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/a4141eaa/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 768.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.543014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 938.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.412114ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.868115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 875.703µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.42391ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.629315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 956.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.887707ms [martini] Started GET /api/lb-check for 10.1.1.81:49452 [martini] Completed 200 OK in 723.003µs [martini] Started GET /api/raft-health for 10.1.1.81:49482 [martini] Completed 200 OK in 734.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.553014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 877.003µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.309009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.471014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 855.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.162009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.568122ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 843.203µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.315809ms [martini] Started GET /api/raft-follower-health-report/b9e124f2/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 897.604µs 2018-11-29 04:52:29 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.585014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 960.603µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.060208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.429013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.069205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.047009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.563914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.061705ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.015408ms [martini] Started GET /api/lb-check for 10.1.1.81:49604 [martini] Completed 200 OK in 729.803µs [martini] Started GET /api/raft-health for 10.1.1.81:49618 [martini] Completed 200 OK in 4.87482ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.264817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 974.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.299409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.490718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.034304ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.183809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.322613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 903.903µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.071009ms [martini] Started GET /api/raft-follower-health-report/71a7f586/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 770.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.959324ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.063309ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.966908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.870223ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 845.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.307709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.466118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 996.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.866212ms [martini] Started GET /api/lb-check for 10.1.1.81:49744 [martini] Completed 200 OK in 1.007404ms [martini] Started GET /api/raft-health for 10.1.1.81:49756 [martini] Completed 200 OK in 795.903µs 2018-11-29 04:52:41 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.798316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.114205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.124308ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.286813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 5.910123ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.234909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.106213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 813.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.940107ms 2018-11-29 04:52:47 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/2efd1b7e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 875.504µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.281213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.206205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.120309ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.151113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.426906ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.009013ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.858815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.686711ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.44531ms [martini] Started GET /api/lb-check for 10.1.1.81:49890 [martini] Completed 200 OK in 732.703µs [martini] Started GET /api/raft-health for 10.1.1.81:49906 [martini] Completed 200 OK in 645.302µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.061917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 930.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.238909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.642015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 895.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.025108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.244813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 907.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.47561ms [martini] Started GET /api/raft-follower-health-report/85adf9ce/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 9.098837ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.477114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.106505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.102208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.399214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 935.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.43631ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.007912ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 959.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.56071ms [martini] Started GET /api/lb-check for 10.1.1.81:50032 [martini] Completed 200 OK in 709.203µs [martini] Started GET /api/raft-health for 10.1.1.81:50056 [martini] Completed 200 OK in 764.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.312617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 5.423122ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.306009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.315013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 942.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.920916ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.107213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.136404ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.120312ms [martini] Started GET /api/raft-follower-health-report/add4dfb8/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 805.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.498414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 850.303µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.103909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.232121ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.042313ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.990816ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.096413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.296705ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.371109ms [martini] Started GET /api/lb-check for 10.1.1.81:50196 [martini] Completed 200 OK in 749.903µs [martini] Started GET /api/raft-health for 10.1.1.81:50208 [martini] Completed 200 OK in 765.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.611415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.058304ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.952708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.680114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 924.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.756707ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.435314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 934.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.259522ms 2018-11-29 04:53:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/67538574/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 639.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.899816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 5.360122ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.017808ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.108712ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 808.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.980208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.299513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.180805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.088809ms [martini] Started GET /api/lb-check for 10.1.1.81:50338 [martini] Completed 200 OK in 856.503µs [martini] Started GET /api/raft-health for 10.1.1.81:50354 [martini] Completed 200 OK in 720.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.351213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.447706ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27661ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.375214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 969.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.660911ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.118712ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 922.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.924607ms [martini] Started GET /api/raft-follower-health-report/0aec11bf/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 684.603µs 2018-11-29 04:53:29 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.91862ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.299305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.246109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.190913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 881.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.989208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.426514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 818.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.963908ms [martini] Started GET /api/lb-check for 10.1.1.81:50480 [martini] Completed 200 OK in 587.102µs [martini] Started GET /api/raft-health for 10.1.1.81:50490 [martini] Completed 200 OK in 800.503µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.733615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 985.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.940708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.464047ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.140105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.999924ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.571319ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.315005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29731ms [martini] Started GET /api/raft-follower-health-report/66944bd4/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 811.604µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.83242ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 916.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.033808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.455222ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 902.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.32421ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.828628ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.157805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.668615ms [martini] Started GET /api/lb-check for 10.1.1.81:50616 [martini] Completed 200 OK in 844.904µs [martini] Started GET /api/raft-health for 10.1.1.81:50642 [martini] Completed 200 OK in 790.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.347314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 963.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.121009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.446618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 926.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.50071ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.962512ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 874.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.123909ms 2018-11-29 04:53:47 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/5c1a0f16/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 5.076921ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.662114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 984.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.208809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.272113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 911.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.030008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.864212ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 876.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.273209ms [martini] Started GET /api/lb-check for 10.1.1.81:50768 [martini] Completed 200 OK in 724.403µs [martini] Started GET /api/raft-health for 10.1.1.81:50784 [martini] Completed 200 OK in 819.603µs 2018-11-29 04:53:53 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.184413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.477519ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.935208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.683315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 879.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.067008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.257913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 919.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.777207ms [martini] Started GET /api/raft-follower-health-report/81f5ab55/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 861.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.500614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.564507ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.148608ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.248313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 7.172929ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.881811ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.922712ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 799.203µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.178909ms [martini] Started GET /api/lb-check for 10.1.1.81:50912 [martini] Completed 200 OK in 692.303µs [martini] Started GET /api/raft-health for 10.1.1.81:50924 [martini] Completed 200 OK in 825.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.505118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 979.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.015208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.953316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 777.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.220109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 13.120454ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 747.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.080912ms [martini] Started GET /api/raft-follower-health-report/d3caf7b9/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.168704ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.685015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.708607ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.000908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.667431ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 872.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.986408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.696719ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.48021ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.42261ms [martini] Started GET /api/lb-check for 10.1.1.81:51062 [martini] Completed 200 OK in 882.103µs [martini] Started GET /api/raft-health for 10.1.1.81:51086 [martini] Completed 200 OK in 804.903µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.681615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 843.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.950908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.439614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 939.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.083908ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.176713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 822.103µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.870408ms 2018-11-29 04:54:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/a68b4198/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 751.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.525314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 13.283155ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.115717ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.881616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 925.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.130009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.251413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 757.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.959208ms [martini] Started GET /api/lb-check for 10.1.1.81:51208 [martini] Completed 200 OK in 808.703µs [martini] Started GET /api/raft-health for 10.1.1.81:51238 [martini] Completed 200 OK in 614.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.401614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.133905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.563719ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.204117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 750.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.171821ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.195413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 852.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.547511ms [martini] Started GET /api/raft-follower-health-report/fcb8bb30/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 724.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.727516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 952.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.150109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.490615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.420806ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.012508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.037312ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 995.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.350013ms [martini] Started GET /api/lb-check for 10.1.1.81:51358 [martini] Completed 200 OK in 690.403µs [martini] Started GET /api/raft-health for 10.1.1.81:51368 [martini] Completed 200 OK in 696.602µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.770916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.155504ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.945212ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.449422ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 932.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.035708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.036621ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.191105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.090309ms 2018-11-29 04:54:35 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/1cedec2c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 934.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.447514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.042704ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.001808ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.908116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 853.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.859308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.077221ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.055204ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.235509ms [martini] Started GET /api/lb-check for 10.1.1.81:51496 [martini] Completed 200 OK in 634.003µs [martini] Started GET /api/raft-health for 10.1.1.81:51508 [martini] Completed 200 OK in 872.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.240217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 949.903µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.602315ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.383714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 873.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.869107ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.036612ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 888.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.040908ms 2018-11-29 04:54:47 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/8bd73d9a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 764.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.489115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.148905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.087416ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.541219ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 902.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.998608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.83922ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.132205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.959708ms [martini] Started GET /api/lb-check for 10.1.1.81:51634 [martini] Completed 200 OK in 822.004µs [martini] Started GET /api/raft-health for 10.1.1.81:51662 [martini] Completed 200 OK in 694.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.648015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.141104ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.003408ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.409714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 974.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.322818ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.922912ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.037404ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.086809ms [martini] Started GET /api/raft-follower-health-report/b8a5e7c7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 689.002µs 2018-11-29 04:54:59 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.705415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 918.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.191009ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.312414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.273505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.37001ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.120213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 937.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.121309ms [martini] Started GET /api/lb-check for 10.1.1.81:51794 [martini] Completed 200 OK in 677.603µs [martini] Started GET /api/raft-health for 10.1.1.81:51808 [martini] Completed 200 OK in 866.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.587227ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 765.103µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.967508ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.824516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 944.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.010509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.585615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 827.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.042809ms [martini] Started GET /api/raft-follower-health-report/ad22f56c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.206305ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.641915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 986.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.064009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.066312ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.017217ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.986408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.175321ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.167105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.302009ms [martini] Started GET /api/lb-check for 10.1.1.81:51948 [martini] Completed 200 OK in 792.203µs [martini] Started GET /api/raft-health for 10.1.1.81:51960 [martini] Completed 200 OK in 689.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.473914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.057905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.931108ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.133413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.013904ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.971408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.332914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.030304ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.359838ms 2018-11-29 04:55:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/c3adac1c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 865.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.441914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.144704ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.052208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.296034ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 825.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.958508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.552015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 963.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.912008ms [martini] Started GET /api/lb-check for 10.1.1.81:52094 [martini] Completed 200 OK in 779.004µs [martini] Started GET /api/raft-health for 10.1.1.81:52108 [martini] Completed 200 OK in 939.504µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.681224ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 882.903µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.963308ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.577815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 951.603µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.916508ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.398114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 878.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.997608ms [martini] Started GET /api/raft-follower-health-report/fcd7779d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 816.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.426323ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.064904ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.44431ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.357413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 923.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.047309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.148713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 902.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.179909ms [martini] Started GET /api/lb-check for 10.1.1.81:52230 [martini] Completed 200 OK in 1.023004ms [martini] Started GET /api/raft-health for 10.1.1.81:52256 [martini] Completed 200 OK in 819.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.627115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.125204ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.085509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.056113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 751.003µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.997433ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.196122ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.086604ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.282222ms 2018-11-29 04:55:35 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/0f0ebf2c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 738.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.423114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 961.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.120409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.311118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.045704ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.41871ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.86732ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 967.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.659019ms [martini] Started GET /api/lb-check for 10.1.1.81:52386 [martini] Completed 200 OK in 918.804µs [martini] Started GET /api/raft-health for 10.1.1.81:52398 [martini] Completed 200 OK in 787.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.305822ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 912.003µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.49471ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.354414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 880.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.986508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.101913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 828.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.980608ms [martini] Started GET /api/raft-follower-health-report/05446342/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 7.874633ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.228234ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.832307ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.49261ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.760715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 782.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.749507ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.95812ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 869.803µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.840507ms [martini] Started GET /api/lb-check for 10.1.1.81:52526 [martini] Completed 200 OK in 783.203µs [martini] Started GET /api/raft-health for 10.1.1.81:52542 [martini] Completed 200 OK in 633.002µs 2018-11-29 04:55:53 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.629615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 8.167534ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.36241ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.367114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 820.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.957408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.578215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 796.803µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.909308ms [martini] Started GET /api/raft-follower-health-report/a5c96407/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 649.803µs 2018-11-29 04:55:59 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.01312ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 835.203µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.210609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.506314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.42711ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.830612ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.457414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.227605ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.184309ms [martini] Started GET /api/lb-check for 10.1.1.81:52670 [martini] Completed 200 OK in 740.003µs [martini] Started GET /api/raft-health for 10.1.1.81:52686 [martini] Completed 200 OK in 1.004305ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.626515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 926.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.270509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.159013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 821.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.58851ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.116713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.017005ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.034721ms [martini] Started GET /api/raft-follower-health-report/f6a77698/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 892.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.703616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.017504ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.021109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.304326ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.140605ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.056308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.381818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 923.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.177809ms [martini] Started GET /api/lb-check for 10.1.1.81:52820 [martini] Completed 200 OK in 627.803µs [martini] Started GET /api/raft-health for 10.1.1.81:52848 [martini] Completed 200 OK in 754.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.279018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.135405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.952208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.642915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 978.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.191909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.344514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 834.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.518027ms 2018-11-29 04:56:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/85aaf4c2/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 742.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.527314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.39721ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.615415ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.382014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 865.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.922808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.206813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 956.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.195309ms [martini] Started GET /api/lb-check for 10.1.1.81:52976 [martini] Completed 200 OK in 960.304µs [martini] Started GET /api/raft-health for 10.1.1.81:52994 [martini] Completed 200 OK in 811.203µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.586614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 875.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.134808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.489714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.139805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.901808ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.050012ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.012604ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.087609ms [martini] Started GET /api/raft-follower-health-report/8f60abb7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 933.604µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.805916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 939.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.063509ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.836716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 992.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.075308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.169513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.100204ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.393918ms [martini] Started GET /api/lb-check for 10.1.1.81:53122 [martini] Completed 200 OK in 878.004µs [martini] Started GET /api/raft-health for 10.1.1.81:53132 [martini] Completed 200 OK in 750.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.430914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 890.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.766811ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.738915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 790.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.024309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.75882ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.719607ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.023308ms [martini] Started GET /api/raft-follower-health-report/25f60c93/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.064504ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.877316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.310505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.005908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.562215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 866.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23421ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.507322ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 877.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.46471ms [martini] Started GET /api/lb-check for 10.1.1.81:53256 [martini] Completed 200 OK in 761.503µs [martini] Started GET /api/raft-health for 10.1.1.81:53268 [martini] Completed 200 OK in 712.703µs 2018-11-29 04:56:41 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.637615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 899.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.719628ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.569514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 954.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.518711ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.505715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 888.503µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.807807ms [martini] Started GET /api/raft-follower-health-report/65ed4d9b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 857.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.286114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.025704ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.229209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.967216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 989.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.557615ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.746916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 963.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.009208ms [martini] Started GET /api/lb-check for 10.1.1.81:53392 [martini] Completed 200 OK in 732.303µs [martini] Started GET /api/raft-health for 10.1.1.81:53424 [martini] Completed 200 OK in 832.503µs 2018-11-29 04:56:53 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.735816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 991.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.952608ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.897816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 910.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.918708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.064413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 962.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.631011ms [martini] Started GET /api/raft-follower-health-report/95983e74/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 819.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.647315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 925.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.069908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.662416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 871.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.065808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.531814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 867.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.017013ms [martini] Started GET /api/lb-check for 10.1.1.81:53554 [martini] Completed 200 OK in 808.104µs [martini] Started GET /api/raft-health for 10.1.1.81:53564 [martini] Completed 200 OK in 793.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.741416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 976.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.705915ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.405214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.375106ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.769528ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.124613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.191905ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.951608ms 2018-11-29 04:57:05 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/c249969e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 948.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.767115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 902.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.83062ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.421714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.120205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.263809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.692315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 814.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.712915ms [martini] Started GET /api/lb-check for 10.1.1.81:53700 [martini] Completed 200 OK in 806.504µs [martini] Started GET /api/raft-health for 10.1.1.81:53712 [martini] Completed 200 OK in 810.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.594115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 947.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.128708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.422315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 913.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.897716ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.086725ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 933.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.900508ms 2018-11-29 04:57:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/7472d7fb/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 830.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.556415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 996.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.087408ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.240913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 917.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.981208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.563815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.003604ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.156709ms [martini] Started GET /api/lb-check for 10.1.1.81:53842 [martini] Completed 200 OK in 1.066604ms [martini] Started GET /api/raft-health for 10.1.1.81:53872 [martini] Completed 200 OK in 799.403µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.76872ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.122205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.059309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.200413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 844.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.948108ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.610315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 878.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.999609ms [martini] Started GET /api/raft-follower-health-report/cbf61252/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 702.703µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.069925ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.332606ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.114517ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.274522ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.020313ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.651515ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.486127ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 964.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.702611ms [martini] Started GET /api/lb-check for 10.1.1.81:53986 [martini] Completed 200 OK in 772.003µs [martini] Started GET /api/raft-health for 10.1.1.81:54012 [martini] Completed 200 OK in 723.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.568915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.296205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.154409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 16.279967ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.249805ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.193009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.263317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.000317ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.169209ms [martini] Started GET /api/raft-follower-health-report/da01eb26/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.118805ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.655615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.249005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.073808ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.999321ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.170905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.077213ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 21.089187ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.040104ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.043308ms [martini] Started GET /api/lb-check for 10.1.1.81:54142 [martini] Completed 200 OK in 744.103µs [martini] Started GET /api/raft-health for 10.1.1.81:54152 [martini] Completed 200 OK in 738.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.264918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.262805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.193209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.451114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.068005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.116609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.472314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 946.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.952308ms 2018-11-29 04:57:47 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/11a15972/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.010004ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.74342ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 989.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.258409ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.228314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 793.703µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.930608ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.494615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 903.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.152508ms [martini] Started GET /api/lb-check for 10.1.1.81:54274 [martini] Completed 200 OK in 770.503µs [martini] Started GET /api/raft-health for 10.1.1.81:54290 [martini] Completed 200 OK in 857.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.532015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 870.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.134309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.374914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 939.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.984409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.66302ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 989.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.776507ms [martini] Started GET /api/raft-follower-health-report/d2fd19a8/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 993.104µs 2018-11-29 04:57:59 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.561319ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.462211ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.944612ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.214213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 946.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.718507ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.258422ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 932.903µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.888908ms [martini] Started GET /api/lb-check for 10.1.1.81:54420 [martini] Completed 200 OK in 833.304µs [martini] Started GET /api/raft-health for 10.1.1.81:54446 [martini] Completed 200 OK in 777.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.026817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 739.603µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.184909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.421435ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 958.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.899508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.705248ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 930.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.958208ms [martini] Started GET /api/raft-follower-health-report/694ca39b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 806.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.391814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 791.403µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.956108ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.735916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 785.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.739311ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.108017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.159505ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.098609ms [martini] Started GET /api/lb-check for 10.1.1.81:54580 [martini] Completed 200 OK in 2.36651ms [martini] Started GET /api/raft-health for 10.1.1.81:54592 [martini] Completed 200 OK in 725.803µs 2018-11-29 04:58:11 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.983516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.118004ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.099109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.240314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 983.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.866508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.374914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 788.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.247109ms 2018-11-29 04:58:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/0cfa7bca/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 2.540811ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.734215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 866.303µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.316009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.243214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 920.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.913708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.269514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 948.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.984809ms [martini] Started GET /api/lb-check for 10.1.1.81:54724 [martini] Completed 200 OK in 845.403µs [martini] Started GET /api/raft-health for 10.1.1.81:54742 [martini] Completed 200 OK in 814.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.779716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 921.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.674815ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.589715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.064105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.164509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.069312ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.028704ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.911608ms [martini] Started GET /api/raft-follower-health-report/d57c7cc0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 627.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.957525ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 881.903µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.462114ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.279613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.44271ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.920113ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.042529ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.723308ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.916708ms [martini] Started GET /api/lb-check for 10.1.1.81:54870 [martini] Completed 200 OK in 625.903µs [martini] Started GET /api/raft-health for 10.1.1.81:54882 [martini] Completed 200 OK in 899.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.191718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.135005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.015908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.48854ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 986.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.130508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.682316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.186917ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.982509ms [martini] Started GET /api/raft-follower-health-report/fc674937/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 788.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.585919ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.174905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.201209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.567819ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.108904ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.847408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.914929ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 933.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.985508ms [martini] Started GET /api/lb-check for 10.1.1.81:55008 [martini] Completed 200 OK in 764.803µs [martini] Started GET /api/raft-health for 10.1.1.81:55034 [martini] Completed 200 OK in 833.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.25973ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 939.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.909608ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.412714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.830907ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.981708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.532215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 797.203µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.955408ms [martini] Started GET /api/raft-follower-health-report/a1a67287/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 834.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.048117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.356905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.140009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.389923ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.035405ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.027309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.156713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 887.803µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.129808ms [martini] Started GET /api/lb-check for 10.1.1.81:55162 [martini] Completed 200 OK in 672.603µs [martini] Started GET /api/raft-health for 10.1.1.81:55176 [martini] Completed 200 OK in 793.903µs 2018-11-29 04:58:53 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.326218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.038105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.006508ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.465815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 909.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27301ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.078017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.780707ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.866207ms [martini] Started GET /api/raft-follower-health-report/622a6ed7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 747.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.783016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 942.603µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.151809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.674815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 920.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.67222ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.512614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 992.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23821ms [martini] Started GET /api/lb-check for 10.1.1.81:55306 [martini] Completed 200 OK in 813.603µs [martini] Started GET /api/raft-health for 10.1.1.81:55320 [martini] Completed 200 OK in 677.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.490515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 824.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.122708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.518215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 922.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.192209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.621915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 853.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.791408ms 2018-11-29 04:59:05 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/2d4b6c3c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 653.902µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.580315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.869508ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.574811ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.736424ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.329205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.124909ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.641415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.008904ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.826608ms [martini] Started GET /api/lb-check for 10.1.1.81:55458 [martini] Completed 200 OK in 777.003µs [martini] Started GET /api/raft-health for 10.1.1.81:55468 [martini] Completed 200 OK in 744.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.510814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.369105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.203209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.605215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.417806ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.231821ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.283914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 952.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.149409ms 2018-11-29 04:59:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 04:59:17 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/c5f9b2b6/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 913.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.568215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.027005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.036609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.573115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 842.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.798507ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.779112ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 981.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.603636ms [martini] Started GET /api/lb-check for 10.1.1.81:55604 [martini] Completed 200 OK in 877.004µs [martini] Started GET /api/raft-health for 10.1.1.81:55634 [martini] Completed 200 OK in 936.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.575223ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.061204ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.854811ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.476615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 991.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31841ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.929513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 826.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.030908ms [martini] Started GET /api/raft-follower-health-report/794839a1/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 969.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.288314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 865.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.946608ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.470318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.199705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.102909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.160013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 977.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.863108ms [martini] Started GET /api/lb-check for 10.1.1.81:55762 [martini] Completed 200 OK in 773.703µs [martini] Started GET /api/raft-health for 10.1.1.81:55774 [martini] Completed 200 OK in 700.102µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.059921ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.751607ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.171909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.136325ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 975.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.986908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.80022ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 866.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.011808ms [martini] Started GET /api/raft-follower-health-report/c3606407/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 786.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.980316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 968.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.203709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.392819ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.251905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.672823ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.516919ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 907.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.906708ms [martini] Started GET /api/lb-check for 10.1.1.81:55902 [martini] Completed 200 OK in 1.107404ms [martini] Started GET /api/raft-health for 10.1.1.81:55912 [martini] Completed 200 OK in 803.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.381818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 801.703µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.992612ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.958716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 878.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.864908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.101713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 923.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.348822ms [martini] Started GET /api/raft-follower-health-report/a03ed5d5/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 745.703µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.110017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.088905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.939512ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.777616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.025204ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25561ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.164113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 847.103µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.995608ms [martini] Started GET /api/lb-check for 10.1.1.81:56036 [martini] Completed 200 OK in 823.103µs [martini] Started GET /api/raft-health for 10.1.1.81:56056 [martini] Completed 200 OK in 674.602µs 2018-11-29 04:59:53 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.124622ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 974.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.279309ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.667316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.024704ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.936508ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.593915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 773.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.886917ms [martini] Started GET /api/raft-follower-health-report/715a5d03/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 698.603µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.72742ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.432506ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.44991ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.799316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.109805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.176609ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.502215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 789.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.269114ms [martini] Started GET /api/lb-check for 10.1.1.81:56182 [martini] Completed 200 OK in 906.104µs [martini] Started GET /api/raft-health for 10.1.1.81:56206 [martini] Completed 200 OK in 1.065104ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.343814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 956.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.902008ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 12.308152ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 5.540923ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 20.471985ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.362218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.001604ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.011608ms 2018-11-29 05:00:05 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/4b409394/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 618.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.615915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.276705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.066609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.768516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 843.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.124609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.018012ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 916.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.75782ms [martini] Started GET /api/lb-check for 10.1.1.81:56354 [martini] Completed 200 OK in 917.304µs [martini] Started GET /api/raft-health for 10.1.1.81:56368 [martini] Completed 200 OK in 643.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.716716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.199605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.37941ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.388414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 997.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.239409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.150013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 959.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.286209ms 2018-11-29 05:00:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 05:00:17 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/0a17945d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 706.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.301714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.106005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.124808ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.697316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 969.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23391ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.293014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 983.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.818212ms [martini] Started GET /api/lb-check for 10.1.1.81:56504 [martini] Completed 200 OK in 924.904µs [martini] Started GET /api/raft-health for 10.1.1.81:56520 [martini] Completed 200 OK in 901.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 19.729783ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.432706ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.076808ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.617115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.045505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.49521ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.358814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 756.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.745307ms [martini] Started GET /api/raft-follower-health-report/0413d0ac/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 741.603µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.798525ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 975.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.126514ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.609515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.832812ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.902512ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.933016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 904.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.759908ms [martini] Started GET /api/lb-check for 10.1.1.81:56648 [martini] Completed 200 OK in 835.003µs [martini] Started GET /api/raft-health for 10.1.1.81:56674 [martini] Completed 200 OK in 732.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.867916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 960.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.958908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.512314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.017605ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.018608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.58682ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.369414ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.910908ms [martini] Started GET /api/raft-follower-health-report/9f621ae0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 773.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.277014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.026404ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.880908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.450831ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 842.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.044809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.106526ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.376205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.061109ms [martini] Started GET /api/lb-check for 10.1.1.81:56788 [martini] Completed 200 OK in 747.803µs [martini] Started GET /api/raft-health for 10.1.1.81:56816 [martini] Completed 200 OK in 792.203µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.942616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.037305ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.096809ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.222414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 916.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.011909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.873816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 773.003µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.134409ms [martini] Started GET /api/raft-follower-health-report/50d8e493/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 929.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.546515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.910917ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.845012ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.329514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.032104ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.119909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.126713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 847.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.044709ms [martini] Started GET /api/lb-check for 10.1.1.81:56936 [martini] Completed 200 OK in 929.104µs [martini] Started GET /api/raft-health for 10.1.1.81:56952 [martini] Completed 200 OK in 735.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.881417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 972.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.227909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.440715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 811.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.507136ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.035113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 916.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.021808ms [martini] Started GET /api/raft-follower-health-report/76055ecd/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 761.003µs 2018-11-29 05:00:59 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.881816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 872.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.116608ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.484414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 857.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.055108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.087413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 847.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.200713ms [martini] Started GET /api/lb-check for 10.1.1.81:57082 [martini] Completed 200 OK in 640.203µs [martini] Started GET /api/raft-health for 10.1.1.81:57094 [martini] Completed 200 OK in 658.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.598515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 890.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.029308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 15.440965ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 869.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.115609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.282418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 911.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.168509ms 2018-11-29 05:01:05 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/116f1582/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 669.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.204917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 970.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28081ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.349614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 865.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.955108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.325814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 840.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.815908ms [martini] Started GET /api/lb-check for 10.1.1.81:57232 [martini] Completed 200 OK in 753.703µs [martini] Started GET /api/raft-health for 10.1.1.81:57258 [martini] Completed 200 OK in 783.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.194917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 950.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.607515ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.355514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 835.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27201ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.062713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 822.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.996208ms 2018-11-29 05:01:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/237c14d3/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 770.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.802216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.193005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.773307ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.211013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 14.36416ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.420214ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.530927ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.079705ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.098009ms [martini] Started GET /api/lb-check for 10.1.1.81:57388 [martini] Completed 200 OK in 903.303µs [martini] Started GET /api/raft-health for 10.1.1.81:57404 [martini] Completed 200 OK in 700.803µs 2018-11-29 05:01:23 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.497715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 933.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.102009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.499614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 903.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.880808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.080013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 962.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.502515ms [martini] Started GET /api/raft-follower-health-report/e1550dc4/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 761.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.529015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.054604ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.995109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.200214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 734.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.023509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.075413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 836.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.037409ms [martini] Started GET /api/lb-check for 10.1.1.81:57534 [martini] Completed 200 OK in 903.204µs [martini] Started GET /api/raft-health for 10.1.1.81:57546 [martini] Completed 200 OK in 770.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.613416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.279206ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.37851ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.195935ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 958.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.196509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.73502ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 957.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.252309ms [martini] Started GET /api/raft-follower-health-report/c9d8bbb2/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 779.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.607315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.090105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.044808ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 12.448852ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 842.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.879708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.456615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.011304ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.997708ms [martini] Started GET /api/lb-check for 10.1.1.81:57678 [martini] Completed 200 OK in 613.503µs [martini] Started GET /api/raft-health for 10.1.1.81:57688 [martini] Completed 200 OK in 841.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.533215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 926.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.239709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.320014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 805.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.537015ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.309414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 934.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.707307ms [martini] Started GET /api/raft-follower-health-report/f4fd39ba/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 811.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.408018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.000704ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.948308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.006713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 830.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.704311ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.144913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 894.203µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.992608ms [martini] Started GET /api/lb-check for 10.1.1.81:57818 [martini] Completed 200 OK in 760.103µs [martini] Started GET /api/raft-health for 10.1.1.81:57848 [martini] Completed 200 OK in 849.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.937317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 880.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.781307ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.436615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 995.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.992508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.183313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.200905ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.711707ms [martini] Started GET /api/raft-follower-health-report/2944aedf/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 670.703µs 2018-11-29 05:01:59 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.459518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.071904ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22811ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.150213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 975.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.946808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.091713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 971.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.086309ms [martini] Started GET /api/lb-check for 10.1.1.81:57978 [martini] Completed 200 OK in 793.003µs [martini] Started GET /api/raft-health for 10.1.1.81:57990 [martini] Completed 200 OK in 821.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.340814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 841.503µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.484415ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.392515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.620411ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.131309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.530319ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.427206ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.311214ms 2018-11-29 05:02:05 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/29532761/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.105605ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.674116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 844.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.008908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.695916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 792.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.015708ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.312347ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.783608ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.43361ms [martini] Started GET /api/lb-check for 10.1.1.81:58128 [martini] Completed 200 OK in 748.703µs [martini] Started GET /api/raft-health for 10.1.1.81:58140 [martini] Completed 200 OK in 751.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.915217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.099805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.178909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.435315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 840.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.040209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.130513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 789.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.028809ms 2018-11-29 05:02:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/8b67ebdf/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 888.203µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.759516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 826.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.431214ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.624328ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 746.203µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.685615ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.025913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 994.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.858408ms [martini] Started GET /api/lb-check for 10.1.1.81:58270 [martini] Completed 200 OK in 759.803µs [martini] Started GET /api/raft-health for 10.1.1.81:58288 [martini] Completed 200 OK in 840.404µs 2018-11-29 05:02:23 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.603716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 986.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.924508ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.272714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 872.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.850308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.368114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 787.503µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.959108ms [martini] Started GET /api/raft-follower-health-report/d68f3203/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 723.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.099017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.038004ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.213239ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.666115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 878.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.892508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.250414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 987.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.794307ms [martini] Started GET /api/lb-check for 10.1.1.81:58420 [martini] Completed 200 OK in 894.504µs [martini] Started GET /api/raft-health for 10.1.1.81:58446 [martini] Completed 200 OK in 663.002µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.510919ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 913.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.071009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.688532ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 931.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.73352ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.68132ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 956.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.959409ms [martini] Started GET /api/raft-follower-health-report/85c5adaf/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 812.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.647016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.057104ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.016109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.163214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.072504ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.421911ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.536215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.138305ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.563315ms [martini] Started GET /api/lb-check for 10.1.1.81:58574 [martini] Completed 200 OK in 2.28691ms [martini] Started GET /api/raft-health for 10.1.1.81:58586 [martini] Completed 200 OK in 786.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.536115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 834.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.910508ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.271314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.047905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.187209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.187214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.075104ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.929708ms [martini] Started GET /api/raft-follower-health-report/6bb11f8f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.060304ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.851616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.158205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.079509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.326114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.095905ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.550311ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.345614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.030804ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.998709ms [martini] Started GET /api/lb-check for 10.1.1.81:58708 [martini] Completed 200 OK in 825.204µs [martini] Started GET /api/raft-health for 10.1.1.81:58724 [martini] Completed 200 OK in 864.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.635215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 781.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.67102ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.486815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 860.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.40561ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.114713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 864.803µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.767307ms [martini] Started GET /api/raft-follower-health-report/011a207b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 691.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.807316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 902.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.129809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.638915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 970.905µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.972309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.921621ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 968.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.810608ms [martini] Started GET /api/lb-check for 10.1.1.81:58854 [martini] Completed 200 OK in 833.103µs [martini] Started GET /api/raft-health for 10.1.1.81:58886 [martini] Completed 200 OK in 696.103µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.678615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 886.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.125109ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.034613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.986512ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.017208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.605316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.176705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.772912ms 2018-11-29 05:03:05 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/50e9a3d1/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 741.003µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.543514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.040504ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.993609ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.080117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.116205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.207209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.248313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.280205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.226309ms [martini] Started GET /api/lb-check for 10.1.1.81:59006 [martini] Completed 200 OK in 676.603µs [martini] Started GET /api/raft-health for 10.1.1.81:59032 [martini] Completed 200 OK in 763.603µs 2018-11-29 05:03:11 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.244622ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.923008ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.101708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.840816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 949.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.910508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.190813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 810.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.978109ms 2018-11-29 05:03:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/af407d35/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 758.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.060717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 939.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.257709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.304714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.353609ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.890008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.896813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 979.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.30611ms [martini] Started GET /api/lb-check for 10.1.1.81:59166 [martini] Completed 200 OK in 869.203µs [martini] Started GET /api/raft-health for 10.1.1.81:59182 [martini] Completed 200 OK in 868.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.638916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 945.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.046108ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.218013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 923.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.032908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.197413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.198505ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.47761ms [martini] Started GET /api/raft-follower-health-report/42eb3995/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 713.103µs 2018-11-29 05:03:29 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.998117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 890.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.070109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.520515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 883.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.998709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.143214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 786.503µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.911508ms [martini] Started GET /api/lb-check for 10.1.1.81:59308 [martini] Completed 200 OK in 740.703µs [martini] Started GET /api/raft-health for 10.1.1.81:59322 [martini] Completed 200 OK in 2.32991ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.910016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 950.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.696611ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.050638ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 781.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.959808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.45924ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.090604ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.631811ms [martini] Started GET /api/raft-follower-health-report/ce9ac558/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 755.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.419814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 919.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.817524ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.881038ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.090304ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.153609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.846329ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.294205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.952509ms [martini] Started GET /api/lb-check for 10.1.1.81:59456 [martini] Completed 200 OK in 843.204µs [martini] Started GET /api/raft-health for 10.1.1.81:59480 [martini] Completed 200 OK in 967.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.944417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.013905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.993008ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.269113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.734807ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.196114ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.312714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 943.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.858908ms [martini] Started GET /api/raft-follower-health-report/0b35d41a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 744.603µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.059617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 976.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.34701ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.525715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.110505ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.063108ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.658115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.062404ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.062209ms [martini] Started GET /api/lb-check for 10.1.1.81:59598 [martini] Completed 200 OK in 2.849312ms [martini] Started GET /api/raft-health for 10.1.1.81:59622 [martini] Completed 200 OK in 771.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.486615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 829.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.113909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.046521ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 916.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.057308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.239014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 918.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.160709ms [martini] Started GET /api/raft-follower-health-report/15732d9e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 783.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.108817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 872.203µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.117709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.761316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 979.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.112809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.282114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 916.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.940808ms [martini] Started GET /api/lb-check for 10.1.1.81:59750 [martini] Completed 200 OK in 682.403µs [martini] Started GET /api/raft-health for 10.1.1.81:59764 [martini] Completed 200 OK in 950.104µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.594315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 917.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.162409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.37764ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.366806ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.005108ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.213813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 897.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.860307ms [martini] Started GET /api/raft-follower-health-report/730c99ad/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.054405ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.530815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 969.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25931ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.031813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.117205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.539511ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.80192ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21091ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.116109ms [martini] Started GET /api/lb-check for 10.1.1.81:59906 [martini] Completed 200 OK in 644.403µs [martini] Started GET /api/raft-health for 10.1.1.81:59918 [martini] Completed 200 OK in 590.402µs 2018-11-29 05:04:11 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 05:04:11 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.352727ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 967.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.37721ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.826516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 772.003µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.013109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.476315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.137705ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.543411ms 2018-11-29 05:04:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/e6c0804d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 968.805µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.758616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.048705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.30891ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.723715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.196705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.282709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.421014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 907.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.142409ms [martini] Started GET /api/lb-check for 10.1.1.81:60050 [martini] Completed 200 OK in 904.604µs [martini] Started GET /api/raft-health for 10.1.1.81:60082 [martini] Completed 200 OK in 730.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.610815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.017404ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.089309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.333114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.046805ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.914108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.183913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 843.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.863808ms [martini] Started GET /api/raft-follower-health-report/0e782e10/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 802.303µs 2018-11-29 05:04:29 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.681715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.037305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.246914ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.645216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 949.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.175818ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.184014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 825.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.018309ms [martini] Started GET /api/lb-check for 10.1.1.81:60208 [martini] Completed 200 OK in 645.003µs [martini] Started GET /api/raft-health for 10.1.1.81:60218 [martini] Completed 200 OK in 725.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.533315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 997.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.861707ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.124318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 840.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28801ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.20473ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 5.781925ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.989608ms [martini] Started GET /api/raft-follower-health-report/19e84b3d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 921.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.805116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 914.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.023808ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.878421ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.037204ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.993508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.384115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.112004ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.617111ms [martini] Started GET /api/lb-check for 10.1.1.81:60352 [martini] Completed 200 OK in 821.004µs [martini] Started GET /api/raft-health for 10.1.1.81:60366 [martini] Completed 200 OK in 798.004µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.552015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.151505ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.044509ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.128913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 857.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.997208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.618316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.133804ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.191009ms [martini] Started GET /api/raft-follower-health-report/ca5297fb/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 597.802µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.237422ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.900313ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.256109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.637715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 853.003µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.092509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.341314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 824.503µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.930208ms [martini] Started GET /api/lb-check for 10.1.1.81:60488 [martini] Completed 200 OK in 843.403µs [martini] Started GET /api/raft-health for 10.1.1.81:60502 [martini] Completed 200 OK in 729.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.591015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.177405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26041ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.468815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.909712ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.795829ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.394314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 850.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.30061ms [martini] Started GET /api/raft-follower-health-report/2ea39677/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 846.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.708016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 852.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.007609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.576215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 837.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.178609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.412114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.039105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.837716ms [martini] Started GET /api/lb-check for 10.1.1.81:60632 [martini] Completed 200 OK in 601.803µs [martini] Started GET /api/raft-health for 10.1.1.81:60660 [martini] Completed 200 OK in 759.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.886116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 880.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.976308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.81882ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.30571ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.178509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.322219ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.165805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.40791ms [martini] Started GET /api/raft-follower-health-report/303816b3/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.642207ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.16333ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.206405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.145909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.096017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.103304ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.095008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.64022ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.141304ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.613811ms [martini] Started GET /api/lb-check for 10.1.1.81:60802 [martini] Completed 200 OK in 790.803µs [martini] Started GET /api/raft-health for 10.1.1.81:60812 [martini] Completed 200 OK in 881.804µs 2018-11-29 05:05:11 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.774516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.038304ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.606228ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.606516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 836.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.818707ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.409814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 920.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.103909ms 2018-11-29 05:05:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 05:05:17 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/807d778f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 909.504µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.129626ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.692107ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.019008ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.923516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 995.205µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.854224ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.388814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 832.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.132609ms [martini] Started GET /api/lb-check for 10.1.1.81:60938 [martini] Completed 200 OK in 789.803µs [martini] Started GET /api/raft-health for 10.1.1.81:60954 [martini] Completed 200 OK in 1.078104ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.595615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 927.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.32621ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.994417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 973.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.134409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.339314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.249505ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.708616ms [martini] Started GET /api/raft-follower-health-report/56c70325/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 825.504µs 2018-11-29 05:05:29 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.481119ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 977.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.228009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.267814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 925.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.109709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.388914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 964.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.933808ms [martini] Started GET /api/lb-check for 10.1.1.81:32848 [martini] Completed 200 OK in 750.903µs [martini] Started GET /api/raft-health for 10.1.1.81:32860 [martini] Completed 200 OK in 653.503µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.760116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 766.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.234209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.640728ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 924.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.080709ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.588524ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.013905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.024509ms [martini] Started GET /api/raft-follower-health-report/a2f8eb38/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 777.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.718415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 985.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.024517ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.760725ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 892.003µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.018709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.979721ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.438906ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.345014ms [martini] Started GET /api/lb-check for 10.1.1.81:32992 [martini] Completed 200 OK in 1.037204ms [martini] Started GET /api/raft-health for 10.1.1.81:33020 [martini] Completed 200 OK in 733.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.934217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.403206ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.027808ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.532414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 844.703µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.15141ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.555728ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.026605ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20521ms [martini] Started GET /api/raft-follower-health-report/a969fe0e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 830.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.632715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.166505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.000809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.514715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.066404ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.853708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.487115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 888.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.078809ms [martini] Started GET /api/lb-check for 10.1.1.81:33140 [martini] Completed 200 OK in 976.805µs [martini] Started GET /api/raft-health for 10.1.1.81:33158 [martini] Completed 200 OK in 734.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.364314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.066804ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.079708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.396015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 949.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.207909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.287314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.047804ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23991ms [martini] Started GET /api/raft-follower-health-report/6bc74889/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.049705ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.540815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 879.303µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.875508ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.514923ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 994.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.813107ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.928412ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 911.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.52911ms [martini] Started GET /api/lb-check for 10.1.1.81:33288 [martini] Completed 200 OK in 644.903µs [martini] Started GET /api/raft-health for 10.1.1.81:33298 [martini] Completed 200 OK in 980.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.169034ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 798.203µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.536619ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.875938ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 11.103947ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.138709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 13.066955ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 5.215322ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.33471ms [martini] Started GET /api/raft-follower-health-report/e741d0e3/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 877.704µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.514015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 776.803µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.141209ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.064713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.415006ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.38671ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.781325ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.041704ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.526824ms [martini] Started GET /api/lb-check for 10.1.1.81:33434 [martini] Completed 200 OK in 912.304µs [martini] Started GET /api/raft-health for 10.1.1.81:33460 [martini] Completed 200 OK in 942.704µs 2018-11-29 05:06:11 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.90382ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 993.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.938409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.721515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 913.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22611ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.121313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 948.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.890108ms 2018-11-29 05:06:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/22b67e0c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 899.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.729415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 855.203µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.952308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.448119ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 854.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.871608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.218214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 882.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.857308ms [martini] Started GET /api/lb-check for 10.1.1.81:33578 [martini] Completed 200 OK in 780.203µs [martini] Started GET /api/raft-health for 10.1.1.81:33606 [martini] Completed 200 OK in 833.104µs 2018-11-29 05:06:23 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.004326ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.896909ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.38321ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.75542ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 798.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.276609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.948412ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 779.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.106409ms [martini] Started GET /api/raft-follower-health-report/3848eaed/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 952.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.254822ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.136005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.835412ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.996317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.703112ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.026812ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.329514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 794.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.196809ms [martini] Started GET /api/lb-check for 10.1.1.81:33734 [martini] Completed 200 OK in 891.004µs [martini] Started GET /api/raft-health for 10.1.1.81:33746 [martini] Completed 200 OK in 827.603µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.182118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.251105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.930112ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.116213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.090705ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.542011ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.748329ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.337606ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.980309ms 2018-11-29 05:06:35 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/fc94868e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 741.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.472315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 981.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.147809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.658215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 785.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.168609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.749333ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.561606ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.45111ms [martini] Started GET /api/lb-check for 10.1.1.81:33884 [martini] Completed 200 OK in 659.702µs [martini] Started GET /api/raft-health for 10.1.1.81:33896 [martini] Completed 200 OK in 704.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.650316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.084604ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.36581ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.635215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.176605ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.784411ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.378714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 987.205µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.962708ms [martini] Started GET /api/raft-follower-health-report/e1f4bb18/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 665.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.75302ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.049204ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.939425ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.491115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.047504ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.114509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.834716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 915.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.30271ms [martini] Started GET /api/lb-check for 10.1.1.81:34024 [martini] Completed 200 OK in 843.803µs [martini] Started GET /api/raft-health for 10.1.1.81:34052 [martini] Completed 200 OK in 787.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.868316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 838.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.008108ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.401914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.50521ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.733512ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.108013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 789.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.078809ms [martini] Started GET /api/raft-follower-health-report/d784e9ba/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 895.304µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.013617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.189605ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.057408ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.520715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.018404ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.724508ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.487815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 806.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.41361ms [martini] Started GET /api/lb-check for 10.1.1.81:34176 [martini] Completed 200 OK in 985.504µs [martini] Started GET /api/raft-health for 10.1.1.81:34194 [martini] Completed 200 OK in 744.103µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.706416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 825.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.35781ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.90922ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.037204ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.068909ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.461415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.254705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26681ms [martini] Started GET /api/raft-follower-health-report/0ee4cfda/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 731.903µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.147218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 945.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.160909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.234814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.011904ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.318014ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.600015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 974.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.089121ms [martini] Started GET /api/lb-check for 10.1.1.81:34332 [martini] Completed 200 OK in 839.504µs [martini] Started GET /api/raft-health for 10.1.1.81:34344 [martini] Completed 200 OK in 731.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.281614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 840.603µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.734216ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.680815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 905.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.957108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.256814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 970.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.920408ms 2018-11-29 05:07:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 05:07:17 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/d1b2cc9d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.065204ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.685116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 955.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.160309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.451315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 919.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.091709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.076622ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.694407ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.039808ms [martini] Started GET /api/lb-check for 10.1.1.81:34472 [martini] Completed 200 OK in 1.033204ms [martini] Started GET /api/raft-health for 10.1.1.81:34486 [martini] Completed 200 OK in 928.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.287514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.191405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.109909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.659716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.067304ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.193109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.162414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 932.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.862008ms [martini] Started GET /api/raft-follower-health-report/bef26b78/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 888.304µs 2018-11-29 05:07:29 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.587715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 828.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.078908ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.282413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 869.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.831507ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.183614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 843.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.758408ms [martini] Started GET /api/lb-check for 10.1.1.81:34616 [martini] Completed 200 OK in 904.804µs [martini] Started GET /api/raft-health for 10.1.1.81:34644 [martini] Completed 200 OK in 779.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.142821ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.077708ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.30321ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.019825ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.045304ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.033208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.915534ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.097705ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.115922ms [martini] Started GET /api/raft-follower-health-report/618a7614/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 927.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.833717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 919.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.54921ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.030521ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.786007ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.875208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.534119ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 827.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.898308ms [martini] Started GET /api/lb-check for 10.1.1.81:34774 [martini] Completed 200 OK in 859.704µs [martini] Started GET /api/raft-health for 10.1.1.81:34784 [martini] Completed 200 OK in 751.203µs 2018-11-29 05:07:41 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.155318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.077305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.191209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.485615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.006204ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.960308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.608715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.824108ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.991609ms [martini] Started GET /api/raft-follower-health-report/2768c358/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 944.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.55992ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.39691ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.697811ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.75162ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.144505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.113609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.653616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 957.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.650511ms [martini] Started GET /api/lb-check for 10.1.1.81:34912 [martini] Completed 200 OK in 982.104µs [martini] Started GET /api/raft-health for 10.1.1.81:34928 [martini] Completed 200 OK in 861.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.674516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 836.903µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.057409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.360214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.086205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.17851ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.102913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 933.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.866108ms [martini] Started GET /api/raft-follower-health-report/c3080046/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 674.402µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.80262ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31691ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.586411ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.156013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.070305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.813108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.961913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 718.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.500211ms [martini] Started GET /api/lb-check for 10.1.1.81:35056 [martini] Completed 200 OK in 635.302µs [martini] Started GET /api/raft-health for 10.1.1.81:35066 [martini] Completed 200 OK in 1.422406ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.440315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 881.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.167026ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.565315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 877.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.504632ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.460014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.077305ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.492115ms [martini] Started GET /api/raft-follower-health-report/b8f76b7c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 723.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.717516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.046804ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.444811ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.610715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.173005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.017908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.205214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 6.777229ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.36121ms [martini] Started GET /api/lb-check for 10.1.1.81:35198 [martini] Completed 200 OK in 5.962526ms [martini] Started GET /api/raft-health for 10.1.1.81:35232 [martini] Completed 200 OK in 824.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.511515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.364906ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.248109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.487914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 980.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.320209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.318714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 878.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.36951ms 2018-11-29 05:08:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 05:08:17 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/e9fb2036/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 2.827812ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.675715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 976.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.978809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.138613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 946.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.071409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.017113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 932.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.853708ms [martini] Started GET /api/lb-check for 10.1.1.81:35360 [martini] Completed 200 OK in 878.904µs [martini] Started GET /api/raft-health for 10.1.1.81:35374 [martini] Completed 200 OK in 640.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.465014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.103304ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.200317ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.724516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 964.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22891ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.170113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 849.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.927508ms [martini] Started GET /api/raft-follower-health-report/01317096/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 688.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.833016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 992.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.898209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.151613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 814.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.768107ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.246318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.480806ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.883508ms [martini] Started GET /api/lb-check for 10.1.1.81:35500 [martini] Completed 200 OK in 846.704µs [martini] Started GET /api/raft-health for 10.1.1.81:35514 [martini] Completed 200 OK in 695.402µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.028417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.004605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.41681ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.90992ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.034408ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29581ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.396622ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.060805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.844916ms 2018-11-29 05:08:35 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/6a8bfea4/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 748.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.595315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.036604ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.802108ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.360314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.371406ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.33321ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.864029ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.141105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.536911ms [martini] Started GET /api/lb-check for 10.1.1.81:35648 [martini] Completed 200 OK in 669.903µs [martini] Started GET /api/raft-health for 10.1.1.81:35660 [martini] Completed 200 OK in 687.603µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.982821ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.140005ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.040109ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.450514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 869.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.161609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.205113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 777.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.034609ms 2018-11-29 05:08:47 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/3c5480c5/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 830.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.363827ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 957.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.919408ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.449314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.064509ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.155109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.182913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 762.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.974508ms [martini] Started GET /api/lb-check for 10.1.1.81:35786 [martini] Completed 200 OK in 635.903µs [martini] Started GET /api/raft-health for 10.1.1.81:35814 [martini] Completed 200 OK in 667.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.356014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.111405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25001ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.267514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.174105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.869808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.337014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.903908ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20461ms [martini] Started GET /api/raft-follower-health-report/3dee7d1c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 755.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.097718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.122405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20001ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.553415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.358306ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.948708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.221314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 908.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.157709ms [martini] Started GET /api/lb-check for 10.1.1.81:35942 [martini] Completed 200 OK in 872.504µs [martini] Started GET /api/raft-health for 10.1.1.81:35954 [martini] Completed 200 OK in 704.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.333214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 891.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.832507ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.13843ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 851.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.906508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.854617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 760.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.877408ms [martini] Started GET /api/raft-follower-health-report/a9e544e8/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 877.904µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.908617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.284905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.681711ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.177413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 894.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.843608ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.669124ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 895.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.061308ms [martini] Started GET /api/lb-check for 10.1.1.81:36090 [martini] Completed 200 OK in 779.904µs [martini] Started GET /api/raft-health for 10.1.1.81:36110 [martini] Completed 200 OK in 803.703µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.543615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.058805ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.46501ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.352514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.391106ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.35391ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.103014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 793.003µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.145709ms 2018-11-29 05:09:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 05:09:17 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/0dea3a3c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 752.203µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.435115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 782.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.041208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.214814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 822.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.974109ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.156914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 790.303µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.338223ms [martini] Started GET /api/lb-check for 10.1.1.81:36236 [martini] Completed 200 OK in 876.503µs [martini] Started GET /api/raft-health for 10.1.1.81:36266 [martini] Completed 200 OK in 695.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.144618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 900.403µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.926609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.316614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 929.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.889908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.251614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 846.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.891108ms [martini] Started GET /api/raft-follower-health-report/3a864a3f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 703.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.659715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 917.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.055109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.158017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.041705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.089809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.184414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 953.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.134609ms [martini] Started GET /api/lb-check for 10.1.1.81:36378 [martini] Completed 200 OK in 651.903µs [martini] Started GET /api/raft-health for 10.1.1.81:36402 [martini] Completed 200 OK in 855.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.580219ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.935713ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.991108ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.341814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.040905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.37061ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.984021ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.141005ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.592211ms [martini] Started GET /api/raft-follower-health-report/4b5debc1/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 774.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.976416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.001805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.198509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.34814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.768007ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 14.26796ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.493432ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.766608ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.45951ms [martini] Started GET /api/lb-check for 10.1.1.81:36538 [martini] Completed 200 OK in 642.103µs [martini] Started GET /api/raft-health for 10.1.1.81:36550 [martini] Completed 200 OK in 826.404µs 2018-11-29 05:09:41 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.542815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 969.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.076409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.148513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 788.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.955008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.253414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 859.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.233322ms 2018-11-29 05:09:47 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/d3be08ad/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 780.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.434514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 976.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.939108ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.571115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.004504ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.957008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.715516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 920.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.942108ms [martini] Started GET /api/lb-check for 10.1.1.81:36672 [martini] Completed 200 OK in 647.703µs [martini] Started GET /api/raft-health for 10.1.1.81:36688 [martini] Completed 200 OK in 845.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.417114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.40471ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.973809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.570124ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 983.005µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.794608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.568215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 895.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28491ms [martini] Started GET /api/raft-follower-health-report/352b1a29/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 780.003µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.789216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.533919ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.115509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.284414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.056204ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26421ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.491814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 925.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.001309ms [martini] Started GET /api/lb-check for 10.1.1.81:36816 [martini] Completed 200 OK in 688.102µs [martini] Started GET /api/raft-health for 10.1.1.81:36842 [martini] Completed 200 OK in 755.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.648915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.008105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.901008ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.959317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.858012ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.837712ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.590824ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.622006ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.119109ms [martini] Started GET /api/raft-follower-health-report/f8bc639d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 928.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.949621ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.002804ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.017109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.437718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.012104ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.055209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.027129ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 867.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.179322ms [martini] Started GET /api/lb-check for 10.1.1.81:36972 [martini] Completed 200 OK in 768.503µs [martini] Started GET /api/raft-health for 10.1.1.81:36994 [martini] Completed 200 OK in 654.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.820316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 950.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.35781ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.268114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.023505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.189709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.081013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 923.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.040709ms 2018-11-29 05:10:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/574fc030/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 878.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.778717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 934.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.152109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.268214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 936.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.956208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.353214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 887.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.848207ms [martini] Started GET /api/lb-check for 10.1.1.81:37124 [martini] Completed 200 OK in 730.403µs [martini] Started GET /api/raft-health for 10.1.1.81:37140 [martini] Completed 200 OK in 971.604µs 2018-11-29 05:10:23 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.880521ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.206314ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.225709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.158513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 943.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.900708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.150214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 938.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.660311ms [martini] Started GET /api/raft-follower-health-report/d6632333/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 912.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.187718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.051504ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.976321ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.293214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 918.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.061038ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.292714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.138004ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.118709ms [martini] Started GET /api/lb-check for 10.1.1.81:37264 [martini] Completed 200 OK in 793.804µs [martini] Started GET /api/raft-health for 10.1.1.81:37276 [martini] Completed 200 OK in 839.803µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.624815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.028004ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.180909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.165014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.257005ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.135509ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.431618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 976.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.518324ms [martini] Started GET /api/raft-follower-health-report/8b2bf807/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 819.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.218918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 914.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.35911ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.684625ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.057104ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.054609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.217114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.482111ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.168609ms [martini] Started GET /api/lb-check for 10.1.1.81:37406 [martini] Completed 200 OK in 1.605507ms [martini] Started GET /api/raft-health for 10.1.1.81:37436 [martini] Completed 200 OK in 804.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.738916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.066405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.093208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.568415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 827.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.021109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.226314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 912.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.831407ms 2018-11-29 05:10:47 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 05:10:47 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/4cd19670/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 896.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.807916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.034004ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.057938ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.344414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 972.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.937808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.931112ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 820.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23491ms [martini] Started GET /api/lb-check for 10.1.1.81:37564 [martini] Completed 200 OK in 887.804µs [martini] Started GET /api/raft-health for 10.1.1.81:37578 [martini] Completed 200 OK in 874.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.462814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.461411ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.913013ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.426014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.021908ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.027009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.049013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 925.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.986608ms [martini] Started GET /api/raft-follower-health-report/913f8d3a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.076505ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.478815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 825.703µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.40701ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.388215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 805.203µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.885008ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.092513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.118905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.659515ms [martini] Started GET /api/lb-check for 10.1.1.81:37708 [martini] Completed 200 OK in 703.103µs [martini] Started GET /api/raft-health for 10.1.1.81:37722 [martini] Completed 200 OK in 878.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.582715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 856.203µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.960108ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.109713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 821.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.833708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.095018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.538607ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25851ms [martini] Started GET /api/raft-follower-health-report/0b4bd4eb/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 769.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.747516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 997.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.052009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.034626ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 814.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.064609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.402636ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.935108ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.929808ms [martini] Started GET /api/lb-check for 10.1.1.81:37846 [martini] Completed 200 OK in 725.103µs [martini] Started GET /api/raft-health for 10.1.1.81:37874 [martini] Completed 200 OK in 2.802812ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.376014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 847.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.719637ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.176214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 807.803µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.024608ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.587715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 841.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.809007ms 2018-11-29 05:11:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/58772019/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.178705ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.742516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.062404ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.136809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.153714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 991.805µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.546423ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.240714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 802.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.952008ms [martini] Started GET /api/lb-check for 10.1.1.81:38000 [martini] Completed 200 OK in 726.903µs [martini] Started GET /api/raft-health for 10.1.1.81:38028 [martini] Completed 200 OK in 746.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.390314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 853.203µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.207309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.524215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 847.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.35051ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.185013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.079109ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.034809ms [martini] Started GET /api/raft-follower-health-report/2b4e73b6/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 867.103µs 2018-11-29 05:11:29 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.889517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 855.603µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.069009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.142714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 807.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.004208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.086713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 911.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.920308ms [martini] Started GET /api/lb-check for 10.1.1.81:38156 [martini] Completed 200 OK in 827.204µs [martini] Started GET /api/raft-health for 10.1.1.81:38166 [martini] Completed 200 OK in 619.502µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.832716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.009104ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.242909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.468523ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.250306ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.495811ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.327918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 820.203µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.537211ms [martini] Started GET /api/raft-follower-health-report/c23e8d55/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 702.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.292214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.152905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.616311ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.494824ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.384206ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.023108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.78622ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.048904ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.346819ms [martini] Started GET /api/lb-check for 10.1.1.81:38298 [martini] Completed 200 OK in 678.702µs [martini] Started GET /api/raft-health for 10.1.1.81:38308 [martini] Completed 200 OK in 734.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.011318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.279205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.32591ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.213514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.588207ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.128909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.175413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 941.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.762507ms 2018-11-29 05:11:47 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 05:11:47 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/c86af7b1/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 807.203µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.631416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.050104ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.273109ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.101313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 869.803µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27111ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.535315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 974.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.670816ms [martini] Started GET /api/lb-check for 10.1.1.81:38438 [martini] Completed 200 OK in 802.403µs [martini] Started GET /api/raft-health for 10.1.1.81:38462 [martini] Completed 200 OK in 945.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.803116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.175905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.198309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.430923ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 810.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.871508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.206514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 916.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.113709ms [martini] Started GET /api/raft-follower-health-report/36c29f62/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 820.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.893616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.001104ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.079409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.386614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 955.905µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.073009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.432114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 875.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.280209ms [martini] Started GET /api/lb-check for 10.1.1.81:38582 [martini] Completed 200 OK in 683.403µs [martini] Started GET /api/raft-health for 10.1.1.81:38608 [martini] Completed 200 OK in 828.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.300914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 897.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 14.798763ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.250118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.078405ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.481111ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.131813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.354106ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.17581ms [martini] Started GET /api/raft-follower-health-report/5c419acb/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.134705ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.411715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.041705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.959609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.122914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 742.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.633815ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.73172ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.222205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.697512ms [martini] Started GET /api/lb-check for 10.1.1.81:38734 [martini] Completed 200 OK in 765.603µs [martini] Started GET /api/raft-health for 10.1.1.81:38756 [martini] Completed 200 OK in 813.404µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.796116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 825.803µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.017008ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.133913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 972.905µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.966509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.024913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 816.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.820408ms 2018-11-29 05:12:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/b5e6960f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 957.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.596116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 964.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.078009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.752116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.025404ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.054308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.007013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 986.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.971308ms [martini] Started GET /api/lb-check for 10.1.1.81:38888 [martini] Completed 200 OK in 830.204µs [martini] Started GET /api/raft-health for 10.1.1.81:38904 [martini] Completed 200 OK in 757.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.217118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.014208ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.077109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.500615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 814.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.772708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.925713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 721.203µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.970608ms [martini] Started GET /api/raft-follower-health-report/3126be30/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.062204ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.539215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.418518ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.37521ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.254314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 852.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.000808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.962313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 792.903µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.047909ms [martini] Started GET /api/lb-check for 10.1.1.81:39028 [martini] Completed 200 OK in 750.403µs [martini] Started GET /api/raft-health for 10.1.1.81:39054 [martini] Completed 200 OK in 839.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.661016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 992.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.189709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.280018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 5.409723ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.999308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.58392ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 922.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.741008ms 2018-11-29 05:12:35 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/42b453a4/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 744.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.504715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 989.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.117409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.118035ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 913.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.193309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.276222ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.736707ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.485723ms [martini] Started GET /api/lb-check for 10.1.1.81:39176 [martini] Completed 200 OK in 1.362705ms [martini] Started GET /api/raft-health for 10.1.1.81:39192 [martini] Completed 200 OK in 887.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.968317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.029805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.34401ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.460214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 950.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.116509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.387515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.002104ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.000509ms [martini] Started GET /api/raft-follower-health-report/3860ed8c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 2.112509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.688416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 898.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.087309ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.478715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 945.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.081609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.260114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.017704ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28901ms [martini] Started GET /api/lb-check for 10.1.1.81:39324 [martini] Completed 200 OK in 712.803µs [martini] Started GET /api/raft-health for 10.1.1.81:39340 [martini] Completed 200 OK in 781.203µs 2018-11-29 05:12:53 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 05:12:53 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.523715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 861.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.242935ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.425015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 941.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.887108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.257714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 943.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.910208ms [martini] Started GET /api/raft-follower-health-report/94bc8a07/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 804.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.636916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.042104ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.615311ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.287914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.010204ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.347715ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.664115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 808.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.926008ms [martini] Started GET /api/lb-check for 10.1.1.81:39476 [martini] Completed 200 OK in 791.904µs [martini] Started GET /api/raft-health for 10.1.1.81:39488 [martini] Completed 200 OK in 614.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.387318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.126205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22501ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.740316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.166305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.976108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.219018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 786.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.908308ms [martini] Started GET /api/raft-follower-health-report/fd406a3b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 705.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.977217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.581307ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.032709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.645524ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 816.703µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.003808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 14.222561ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26001ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.790112ms [martini] Started GET /api/lb-check for 10.1.1.81:39616 [martini] Completed 200 OK in 662.702µs [martini] Started GET /api/raft-health for 10.1.1.81:39652 [martini] Completed 200 OK in 679.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.880216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 997.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26791ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.335315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 949.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.054809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.109814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 953.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.710708ms 2018-11-29 05:13:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/61bd59ca/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 783.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.683616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.048805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.334014ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.141513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 851.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.009808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.988413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 962.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.812208ms [martini] Started GET /api/lb-check for 10.1.1.81:39786 [martini] Completed 200 OK in 927.604µs [martini] Started GET /api/raft-health for 10.1.1.81:39802 [martini] Completed 200 OK in 1.075604ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.700015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 787.203µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22481ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.273914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 848.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.535515ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.864016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 768.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.929608ms [martini] Started GET /api/raft-follower-health-report/2b25b7c0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 829.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.898917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 921.403µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.135609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.233113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.070505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.217409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.827621ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 898.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.021309ms [martini] Started GET /api/lb-check for 10.1.1.81:39930 [martini] Completed 200 OK in 1.750708ms [martini] Started GET /api/raft-health for 10.1.1.81:39942 [martini] Completed 200 OK in 699.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.770316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 991.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.133009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.884517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.991408ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.34611ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.288614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 993.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.558011ms 2018-11-29 05:13:35 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/4f96f8c2/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 781.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.266422ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 942.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.970509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.71062ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.035205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.159509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.515715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 762.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.39771ms [martini] Started GET /api/lb-check for 10.1.1.81:40078 [martini] Completed 200 OK in 602.603µs [martini] Started GET /api/raft-health for 10.1.1.81:40090 [martini] Completed 200 OK in 806.703µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.020917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 991.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.959808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.488915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.537319ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.966709ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.280814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 856.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.13031ms [martini] Started GET /api/raft-follower-health-report/579156d7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 774.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.001417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.057005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.168114ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.572515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.021804ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.066309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.134414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.058313ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.101309ms [martini] Started GET /api/lb-check for 10.1.1.81:40224 [martini] Completed 200 OK in 808.203µs [martini] Started GET /api/raft-health for 10.1.1.81:40254 [martini] Completed 200 OK in 839.304µs 2018-11-29 05:13:53 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.848617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.080705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.085809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.350314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 982.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.360723ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.325714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 921.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.195009ms [martini] Started GET /api/raft-follower-health-report/4bc9e614/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 760.704µs 2018-11-29 05:13:59 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.723916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.094804ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23201ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.353614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 936.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.835608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.240314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 725.803µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.915808ms [martini] Started GET /api/lb-check for 10.1.1.81:40388 [martini] Completed 200 OK in 864.003µs [martini] Started GET /api/raft-health for 10.1.1.81:40400 [martini] Completed 200 OK in 937.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.897821ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.33501ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.089309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.795533ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 935.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.883308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.252518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.086704ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.957609ms [martini] Started GET /api/raft-follower-health-report/190d2774/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 718.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.499215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.014604ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.149509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.041713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 800.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.853637ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.912213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.204105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.42221ms [martini] Started GET /api/lb-check for 10.1.1.81:40532 [martini] Completed 200 OK in 897.804µs [martini] Started GET /api/raft-health for 10.1.1.81:40554 [martini] Completed 200 OK in 771.704µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.038917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.087205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.24761ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.293714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 891.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.095809ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.152513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 850.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.121421ms 2018-11-29 05:14:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/20539601/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 814.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.342314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 990.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.948909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.250014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 809.003µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.983308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.048913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 991.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.969608ms [martini] Started GET /api/lb-check for 10.1.1.81:40690 [martini] Completed 200 OK in 614.302µs [martini] Started GET /api/raft-health for 10.1.1.81:40706 [martini] Completed 200 OK in 995.905µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.643715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 930.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.056009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.192513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 834.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.12921ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.038113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 918.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.156209ms [martini] Started GET /api/raft-follower-health-report/ccaccd00/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.507207ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.102321ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.409706ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.023208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.326714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 872.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.833707ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.328215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 964.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.178213ms [martini] Started GET /api/lb-check for 10.1.1.81:40832 [martini] Completed 200 OK in 872.303µs [martini] Started GET /api/raft-health for 10.1.1.81:40858 [martini] Completed 200 OK in 799.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.64992ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.218406ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28481ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.445524ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.061305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.859225ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.029022ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.173105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.392011ms 2018-11-29 05:14:35 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/ffd69625/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 710.503µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.577015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 862.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.013508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.806429ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 877.503µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.963608ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.124414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 816.003µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.877817ms [martini] Started GET /api/lb-check for 10.1.1.81:40992 [martini] Completed 200 OK in 660.602µs [martini] Started GET /api/raft-health for 10.1.1.81:41006 [martini] Completed 200 OK in 622.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.850917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 970.805µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.094909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.155613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 833.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28751ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.208314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 938.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.835508ms [martini] Started GET /api/raft-follower-health-report/ae78bf85/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 11.79595ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.718216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 914.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.696212ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.472515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 917.703µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.280909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.262914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.116705ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.972509ms [martini] Started GET /api/lb-check for 10.1.1.81:41138 [martini] Completed 200 OK in 802.004µs [martini] Started GET /api/raft-health for 10.1.1.81:41154 [martini] Completed 200 OK in 845.603µs 2018-11-29 05:14:53 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.444223ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.922517ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.400911ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.472115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.350206ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.205814ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.143514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 877.203µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.823707ms [martini] Started GET /api/raft-follower-health-report/5a6351d6/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 664.103µs 2018-11-29 05:14:59 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.588219ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.031404ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.066809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.131113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 883.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.51392ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.869612ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 786.703µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.913508ms [martini] Started GET /api/lb-check for 10.1.1.81:41284 [martini] Completed 200 OK in 583.302µs [martini] Started GET /api/raft-health for 10.1.1.81:41312 [martini] Completed 200 OK in 712.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.815316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 991.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.859408ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.800433ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 819.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.610912ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.642416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 931.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.084308ms [martini] Started GET /api/raft-follower-health-report/672525ca/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.012505ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.697716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.139204ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28421ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.921721ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.015705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.133609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.300814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.186705ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.080435ms [martini] Started GET /api/lb-check for 10.1.1.81:41430 [martini] Completed 200 OK in 701.503µs [martini] Started GET /api/raft-health for 10.1.1.81:41466 [martini] Completed 200 OK in 670.903µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.700516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 907.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.37771ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.373414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.017305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18881ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.517815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.001004ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20911ms 2018-11-29 05:15:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/0b20ffa5/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 950.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.258531ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 5.212922ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.608411ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.376114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.157605ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.012408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.936717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.011704ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.276109ms [martini] Started GET /api/lb-check for 10.1.1.81:41602 [martini] Completed 200 OK in 871.304µs [martini] Started GET /api/raft-health for 10.1.1.81:41618 [martini] Completed 200 OK in 796.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.74242ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 852.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.099509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.577015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.34441ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.730312ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.045413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 752.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.096413ms [martini] Started GET /api/raft-follower-health-report/e0af4f79/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 799.803µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.718116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 784.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.055009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.014513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 896.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.995008ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.965213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 966.305µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.173122ms [martini] Started GET /api/lb-check for 10.1.1.81:41744 [martini] Completed 200 OK in 683.803µs [martini] Started GET /api/raft-health for 10.1.1.81:41756 [martini] Completed 200 OK in 777.203µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.851417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.052304ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.083509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.166023ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 903.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.149009ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.211623ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.031305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.067709ms [martini] Started GET /api/raft-follower-health-report/8c9ab3ee/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 849.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.101339ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.047105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.46101ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.783424ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 977.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.500311ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.132113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 999.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.804116ms [martini] Started GET /api/lb-check for 10.1.1.81:41890 [martini] Completed 200 OK in 788.003µs [martini] Started GET /api/raft-health for 10.1.1.81:41920 [martini] Completed 200 OK in 896.404µs 2018-11-29 05:15:41 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.404819ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.733007ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.607315ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.064035ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.332606ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.116409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.872517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.040813ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.17331ms [martini] Started GET /api/raft-follower-health-report/1edb63c7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 761.703µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.827716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.075205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.558211ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.432415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 976.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.614311ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.759745ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 8.108334ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.753211ms [martini] Started GET /api/lb-check for 10.1.1.81:42048 [martini] Completed 200 OK in 890.104µs [martini] Started GET /api/raft-health for 10.1.1.81:42068 [martini] Completed 200 OK in 786.103µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.162018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.030804ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.680411ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.410115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.123305ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.169409ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.031812ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 861.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.846108ms [martini] Started GET /api/raft-follower-health-report/775f094d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 921.604µs 2018-11-29 05:15:59 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.683116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.189205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.17421ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.118013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 838.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27681ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.310514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 889.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.954109ms [martini] Started GET /api/lb-check for 10.1.1.81:42204 [martini] Completed 200 OK in 711.903µs [martini] Started GET /api/raft-health for 10.1.1.81:42214 [martini] Completed 200 OK in 736.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.075822ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.518007ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.944508ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.546415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 892.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.021409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.213844ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.731811ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.637611ms 2018-11-29 05:16:05 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/6b18a313/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 845.504µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.708116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 905.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.023509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.853225ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.493815ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.321214ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.174413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.934708ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.531811ms [martini] Started GET /api/lb-check for 10.1.1.81:42342 [martini] Completed 200 OK in 790.503µs [martini] Started GET /api/raft-health for 10.1.1.81:42362 [martini] Completed 200 OK in 717.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.816316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 892.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.171509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.437315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 830.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.602911ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.987912ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 926.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.305831ms 2018-11-29 05:16:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/52654352/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.038404ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.436014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 837.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.057209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.224813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 940.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.973008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.303814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.061205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.077009ms [martini] Started GET /api/lb-check for 10.1.1.81:42498 [martini] Completed 200 OK in 640.303µs [martini] Started GET /api/raft-health for 10.1.1.81:42530 [martini] Completed 200 OK in 883.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.595815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 907.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.121009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.304414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 883.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.835908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.035912ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 912.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.814208ms [martini] Started GET /api/raft-follower-health-report/d8f0719d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 700.503µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.472823ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.389406ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19411ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.262214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 944.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.034409ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.834012ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 862.403µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.939408ms [martini] Started GET /api/lb-check for 10.1.1.81:42662 [martini] Completed 200 OK in 696.803µs [martini] Started GET /api/raft-health for 10.1.1.81:42674 [martini] Completed 200 OK in 724.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.540215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.133204ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.14991ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.457823ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 870.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.858617ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.720116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 852.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.007509ms [martini] Started GET /api/raft-follower-health-report/223d877b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 745.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.996717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.071904ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.014509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.029717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.081805ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26321ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.366014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.525806ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.021108ms [martini] Started GET /api/lb-check for 10.1.1.81:42804 [martini] Completed 200 OK in 1.208105ms [martini] Started GET /api/raft-health for 10.1.1.81:42816 [martini] Completed 200 OK in 702.403µs 2018-11-29 05:16:41 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.401115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.049204ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.45691ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.176613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 865.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.061809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.154114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 906.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.17811ms [martini] Started GET /api/raft-follower-health-report/50cbdb37/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.000105ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.782225ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 923.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.842308ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.005713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 821.503µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.843908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.223613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 862.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.908309ms [martini] Started GET /api/lb-check for 10.1.1.81:42942 [martini] Completed 200 OK in 828.103µs [martini] Started GET /api/raft-health for 10.1.1.81:42956 [martini] Completed 200 OK in 688.203µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.557015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.122205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.448327ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.985513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 952.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.880608ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.098013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.515311ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.32121ms [martini] Started GET /api/raft-follower-health-report/e7f31df1/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 833.604µs 2018-11-29 05:16:59 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.452615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.192705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22981ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.352114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 901.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.132417ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.081613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 915.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.941908ms [martini] Started GET /api/lb-check for 10.1.1.81:43088 [martini] Completed 200 OK in 894.004µs [martini] Started GET /api/raft-health for 10.1.1.81:43114 [martini] Completed 200 OK in 949.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.525415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.002105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21561ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.948612ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.601107ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27681ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.928912ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.060105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.240914ms [martini] Started GET /api/raft-follower-health-report/8c07f342/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 697.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.776916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.086704ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.064909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.451148ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.063404ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.002813ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.927538ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.395606ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.998509ms [martini] Started GET /api/lb-check for 10.1.1.81:43240 [martini] Completed 200 OK in 866.804µs [martini] Started GET /api/raft-health for 10.1.1.81:43250 [martini] Completed 200 OK in 831.104µs 2018-11-29 05:17:11 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.478415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 996.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.38191ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.181214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 797.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.036109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.074414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 813.803µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.896508ms 2018-11-29 05:17:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/59f33d9c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 729.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.745016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.016304ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.117809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.335427ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.418606ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.972209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.138913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 856.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.852912ms [martini] Started GET /api/lb-check for 10.1.1.81:43386 [martini] Completed 200 OK in 825.704µs [martini] Started GET /api/raft-health for 10.1.1.81:43402 [martini] Completed 200 OK in 704.003µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.517215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 945.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.100308ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.316314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 743.603µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.056413ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.638915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 801.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.011008ms [martini] Started GET /api/raft-follower-health-report/3e7d320c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 732.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.185314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 964.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.287609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.119813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 921.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.025909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.043313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.012404ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.982808ms [martini] Started GET /api/lb-check for 10.1.1.81:43534 [martini] Completed 200 OK in 1.951908ms [martini] Started GET /api/raft-health for 10.1.1.81:43548 [martini] Completed 200 OK in 660.402µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.698315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.885708ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.081809ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.300418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.062705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26081ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.788416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.534607ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28911ms [martini] Started GET /api/raft-follower-health-report/f0000eae/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.504306ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.171522ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.127705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21811ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.105821ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 840.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.228309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.821929ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.049304ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20461ms [martini] Started GET /api/lb-check for 10.1.1.81:43678 [martini] Completed 200 OK in 778.904µs [martini] Started GET /api/raft-health for 10.1.1.81:43704 [martini] Completed 200 OK in 754.704µs 2018-11-29 05:17:41 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.323714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.115004ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.072708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.780417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.177605ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.005708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.948013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.030405ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.915908ms [martini] Started GET /api/raft-follower-health-report/ef132192/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 910.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.588216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.016905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.577315ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.857616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 903.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.931208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.099413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.116109ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16251ms [martini] Started GET /api/lb-check for 10.1.1.81:43824 [martini] Completed 200 OK in 816.403µs [martini] Started GET /api/raft-health for 10.1.1.81:43840 [martini] Completed 200 OK in 915.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.683815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.033805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.924708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.692616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 915.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.030109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.161914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.124105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.437911ms [martini] Started GET /api/raft-follower-health-report/abb70dae/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 7.628133ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.543715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 898.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.906508ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.103414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 800.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.022608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.958712ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 837.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.833008ms [martini] Started GET /api/lb-check for 10.1.1.81:43972 [martini] Completed 200 OK in 816.304µs [martini] Started GET /api/raft-health for 10.1.1.81:43984 [martini] Completed 200 OK in 783.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.610016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.048108ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.024709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.366614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 951.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.918308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.64452ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.194714ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.672524ms 2018-11-29 05:18:05 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/d68c252a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 895.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.512619ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 947.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.986409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.337723ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 8.241235ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.41661ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.052221ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 935.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.092613ms [martini] Started GET /api/lb-check for 10.1.1.81:44106 [martini] Completed 200 OK in 914.004µs [martini] Started GET /api/raft-health for 10.1.1.81:44132 [martini] Completed 200 OK in 697.503µs 2018-11-29 05:18:11 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.400815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.049604ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.037409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.405214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 741.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.807007ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.404619ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.507707ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.797908ms 2018-11-29 05:18:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/7fc973a9/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 842.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.415115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.073004ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.985309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.179014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 842.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.982909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.178913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 834.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.058309ms [martini] Started GET /api/lb-check for 10.1.1.81:44256 [martini] Completed 200 OK in 597.003µs [martini] Started GET /api/raft-health for 10.1.1.81:44286 [martini] Completed 200 OK in 2.989813ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.610015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 931.503µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21201ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.127713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 769.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.033809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.133214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 813.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.992208ms [martini] Started GET /api/raft-follower-health-report/fdead315/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 800.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.27034ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 839.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.895708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.589915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 777.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.005808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.196614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 907.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.967908ms [martini] Started GET /api/lb-check for 10.1.1.81:44412 [martini] Completed 200 OK in 851.704µs [martini] Started GET /api/raft-health for 10.1.1.81:44424 [martini] Completed 200 OK in 782.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.387314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 757.303µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.110709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.721537ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 982.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.315923ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.221314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.024904ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.164709ms [martini] Started GET /api/raft-follower-health-report/10cfbf58/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 791.104µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.651515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 901.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.453111ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.220623ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.159705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.124009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.683315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.107604ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.826517ms [martini] Started GET /api/lb-check for 10.1.1.81:44552 [martini] Completed 200 OK in 894.304µs [martini] Started GET /api/raft-health for 10.1.1.81:44562 [martini] Completed 200 OK in 780.404µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.731416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.134005ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.180209ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.179213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 849.003µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.840408ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.188114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.264705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19001ms 2018-11-29 05:18:47 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/5aaea49f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.942409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.483615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 868.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.165609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.993613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 859.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.848608ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.949813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 785.303µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.058709ms [martini] Started GET /api/lb-check for 10.1.1.81:44688 [martini] Completed 200 OK in 659.903µs [martini] Started GET /api/raft-health for 10.1.1.81:44716 [martini] Completed 200 OK in 703.303µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.987017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.052404ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.262014ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.407715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 859.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.839108ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.270213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.157905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.17931ms [martini] Started GET /api/raft-follower-health-report/3ef215df/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 867.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.783717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.061404ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21371ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.509715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 911.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.24191ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.100522ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.584919ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.954009ms [martini] Started GET /api/lb-check for 10.1.1.81:44848 [martini] Completed 200 OK in 808.704µs [martini] Started GET /api/raft-health for 10.1.1.81:44862 [martini] Completed 200 OK in 855.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.663916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.057805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.211909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.002717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.333106ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28601ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.936913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 940.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.30581ms [martini] Started GET /api/raft-follower-health-report/22788588/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.119305ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.836717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.084805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.093609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.017622ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 973.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.178009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.605816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.035604ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.318618ms [martini] Started GET /api/lb-check for 10.1.1.81:44996 [martini] Completed 200 OK in 894.804µs [martini] Started GET /api/raft-health for 10.1.1.81:45006 [martini] Completed 200 OK in 819.403µs 2018-11-29 05:19:11 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 05:19:11 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.199126ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.219206ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.037708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.272413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 827.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.783407ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.63052ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 948.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.051808ms 2018-11-29 05:19:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/e4542232/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 697.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.889616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 916.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18091ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.439319ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.887808ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.802112ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.327914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 849.803µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.858008ms [martini] Started GET /api/lb-check for 10.1.1.81:45140 [martini] Completed 200 OK in 1.000304ms [martini] Started GET /api/raft-health for 10.1.1.81:45154 [martini] Completed 200 OK in 876.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.844916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.021005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.39681ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.849116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 968.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.241009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.499815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 7.12713ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.120309ms [martini] Started GET /api/raft-follower-health-report/f1435adc/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 924.104µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.587415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.075904ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.017708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.080313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 884.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.965108ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.292414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 934.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.031009ms [martini] Started GET /api/lb-check for 10.1.1.81:45280 [martini] Completed 200 OK in 955.704µs [martini] Started GET /api/raft-health for 10.1.1.81:45304 [martini] Completed 200 OK in 803.204µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.642916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 863.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.34371ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.340415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.201405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.49461ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.092618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.584407ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.47661ms [martini] Started GET /api/raft-follower-health-report/82993f22/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 805.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.452115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29461ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.283109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.278218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.308006ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.006909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.326814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.346906ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.789312ms [martini] Started GET /api/lb-check for 10.1.1.81:45434 [martini] Completed 200 OK in 714.303µs [martini] Started GET /api/raft-health for 10.1.1.81:45446 [martini] Completed 200 OK in 847.804µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.894421ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 867.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.985709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.898021ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.781812ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.279036ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.146018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.131105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.228518ms 2018-11-29 05:19:47 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/0aed365b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 774.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.527615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 922.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.218509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.286214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.029305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.824208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.146613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 944.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19601ms [martini] Started GET /api/lb-check for 10.1.1.81:45572 [martini] Completed 200 OK in 3.323714ms [martini] Started GET /api/raft-health for 10.1.1.81:45588 [martini] Completed 200 OK in 712.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.866417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.105704ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.032408ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.293014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 772.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29171ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.334814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 837.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.125309ms [martini] Started GET /api/raft-follower-health-report/4434a146/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 845.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.538623ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 964.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.082609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.636116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 829.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.885108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.633215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.194706ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.966108ms [martini] Started GET /api/lb-check for 10.1.1.81:45720 [martini] Completed 200 OK in 956.204µs [martini] Started GET /api/raft-health for 10.1.1.81:45730 [martini] Completed 200 OK in 855.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.176613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 928.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.043209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.536745ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 875.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.981608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.642824ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 983.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.027909ms [martini] Started GET /api/raft-follower-health-report/e536b10e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 821.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.281518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.001804ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.539411ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.779925ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.260005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.824812ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.911547ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 884.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.43741ms [martini] Started GET /api/lb-check for 10.1.1.81:45856 [martini] Completed 200 OK in 725.703µs [martini] Started GET /api/raft-health for 10.1.1.81:45882 [martini] Completed 200 OK in 691.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.582716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 944.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.122309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.499615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 854.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22401ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.135414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 866.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.425611ms 2018-11-29 05:20:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 05:20:17 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 05:20:17 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/563f9421/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 643.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.078717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.030005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.914908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.078522ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 927.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.910308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.595015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.011304ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22031ms [martini] Started GET /api/lb-check for 10.1.1.81:46020 [martini] Completed 200 OK in 1.020105ms [martini] Started GET /api/raft-health for 10.1.1.81:46038 [martini] Completed 200 OK in 899.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.704416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.168305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28871ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.577815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 813.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.290614ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.282014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 798.703µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.729107ms [martini] Started GET /api/raft-follower-health-report/96e41f10/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 903.904µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.622815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 862.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.587516ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.099914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 743.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.073209ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.275914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 935.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.873108ms [martini] Started GET /api/lb-check for 10.1.1.81:46164 [martini] Completed 200 OK in 613.303µs [martini] Started GET /api/raft-health for 10.1.1.81:46174 [martini] Completed 200 OK in 861.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.653316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.174905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.124909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.491515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.026904ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.804908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.000713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 5.781225ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.983408ms [martini] Started GET /api/raft-follower-health-report/39dcdba9/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 718.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.697116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.160805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.976908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.562141ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 944.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.163409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.088522ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.103004ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.158709ms [martini] Started GET /api/lb-check for 10.1.1.81:46298 [martini] Completed 200 OK in 791.404µs [martini] Started GET /api/raft-health for 10.1.1.81:46310 [martini] Completed 200 OK in 2.867713ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.543416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 944.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.053309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.516915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.033005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.951108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.105313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 921.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.124509ms [martini] Started GET /api/raft-follower-health-report/c6190f0a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 644.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.878425ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.021805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.087209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.732916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 895.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.127909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.325314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.060405ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.066309ms [martini] Started GET /api/lb-check for 10.1.1.81:46440 [martini] Completed 200 OK in 891.104µs [martini] Started GET /api/raft-health for 10.1.1.81:46472 [martini] Completed 200 OK in 672.503µs 2018-11-29 05:20:53 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.398919ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.097605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.038809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.635516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.104005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.991209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.086613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 936.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.822308ms [martini] Started GET /api/raft-follower-health-report/73082ad8/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.095005ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.753716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.027404ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.105009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.316514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 846.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.907108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.617815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.168805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.024708ms [martini] Started GET /api/lb-check for 10.1.1.81:46602 [martini] Completed 200 OK in 853.104µs [martini] Started GET /api/raft-health for 10.1.1.81:46614 [martini] Completed 200 OK in 855.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.578615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 983.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.975109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.280814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 819.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.59702ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.428014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.081905ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.029109ms [martini] Started GET /api/raft-follower-health-report/6f589874/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 840.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.468715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 973.505µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.153009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.607429ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.973308ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.911908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.527615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 797.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.792508ms [martini] Started GET /api/lb-check for 10.1.1.81:46742 [martini] Completed 200 OK in 654.703µs [martini] Started GET /api/raft-health for 10.1.1.81:46758 [martini] Completed 200 OK in 792.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.089317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.140105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.716816ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.383715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 901.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.123209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.306114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 858.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.016708ms 2018-11-29 05:21:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 05:21:17 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/3da0e992/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 717.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.911225ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.657307ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.120348ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.189714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.663512ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.146809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.088413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 710.903µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.678608ms [martini] Started GET /api/lb-check for 10.1.1.81:46896 [martini] Completed 200 OK in 662.303µs [martini] Started GET /api/raft-health for 10.1.1.81:46926 [martini] Completed 200 OK in 1.012904ms 2018-11-29 05:21:23 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.223313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.632007ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.874608ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.508715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 983.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.906708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.185913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 855.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.124522ms [martini] Started GET /api/raft-follower-health-report/87248f59/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 990.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.907717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.026904ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.804408ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.712616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 933.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.963612ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.271114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.014304ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.168309ms [martini] Started GET /api/lb-check for 10.1.1.81:47040 [martini] Completed 200 OK in 788.604µs [martini] Started GET /api/raft-health for 10.1.1.81:47066 [martini] Completed 200 OK in 981.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.592615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.060204ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.163509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.368514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 981.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.597212ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.492519ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.118505ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.995609ms [martini] Started GET /api/raft-follower-health-report/6a22e3da/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 724.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.818316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 913.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.909025ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.936422ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.246505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.857508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.054813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.191005ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.585428ms [martini] Started GET /api/lb-check for 10.1.1.81:47194 [martini] Completed 200 OK in 823.204µs [martini] Started GET /api/raft-health for 10.1.1.81:47204 [martini] Completed 200 OK in 766.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.729216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.090809ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.055809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.627215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.093609ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.025413ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.056113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 872.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20691ms [martini] Started GET /api/raft-follower-health-report/3402df2f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 830.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.088318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.100605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.127209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.612415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 942.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.983209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.422315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.015505ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23741ms [martini] Started GET /api/lb-check for 10.1.1.81:47330 [martini] Completed 200 OK in 1.008504ms [martini] Started GET /api/raft-health for 10.1.1.81:47346 [martini] Completed 200 OK in 752.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.206522ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.255905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.549111ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.580119ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.147705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.015709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.313927ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 810.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.929608ms [martini] Started GET /api/raft-follower-health-report/c8f92229/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 2.113309ms 2018-11-29 05:21:59 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.553515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 941.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.094809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.912116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 917.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.36061ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.400614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.099904ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.601511ms [martini] Started GET /api/lb-check for 10.1.1.81:47482 [martini] Completed 200 OK in 687.103µs [martini] Started GET /api/raft-health for 10.1.1.81:47512 [martini] Completed 200 OK in 647.102µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.475715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 911.403µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.199013ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.717525ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 793.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.949408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.031417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.111204ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.668411ms [martini] Started GET /api/raft-follower-health-report/969a47e5/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 859.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.756516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 837.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.084009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.713416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.111505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.513232ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 14.144761ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 978.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.024509ms [martini] Started GET /api/lb-check for 10.1.1.81:47636 [martini] Completed 200 OK in 866.904µs [martini] Started GET /api/raft-health for 10.1.1.81:47646 [martini] Completed 200 OK in 731.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.638815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 932.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26461ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.264514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 868.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.33601ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.244514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 926.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.879808ms 2018-11-29 05:22:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/cdd6ee40/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 845.804µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.627416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.089805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22841ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.858216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.124505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.970008ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.955417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 924.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.372811ms [martini] Started GET /api/lb-check for 10.1.1.81:47784 [martini] Completed 200 OK in 709.303µs [martini] Started GET /api/raft-health for 10.1.1.81:47800 [martini] Completed 200 OK in 1.703407ms 2018-11-29 05:22:23 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 05:22:23 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.640716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 893.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.052309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.346414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 887.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.981009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.395714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 983.305µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.868308ms [martini] Started GET /api/raft-follower-health-report/a08b9293/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 697.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.155318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.967317ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.42451ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.252714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 885.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.908108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.417615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.248905ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.109909ms [martini] Started GET /api/lb-check for 10.1.1.81:47930 [martini] Completed 200 OK in 1.232405ms [martini] Started GET /api/raft-health for 10.1.1.81:47944 [martini] Completed 200 OK in 732.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.368715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 917.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.937608ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.197313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.060005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.010609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.363344ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 764.703µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.866208ms [martini] Started GET /api/raft-follower-health-report/c4ea76b8/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 844.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.678416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 941.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.951808ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.257219ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.095504ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.610011ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.501223ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.155405ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.143409ms [martini] Started GET /api/lb-check for 10.1.1.81:48070 [martini] Completed 200 OK in 2.152209ms [martini] Started GET /api/raft-health for 10.1.1.81:48096 [martini] Completed 200 OK in 834.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.144018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 979.905µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.119209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.346314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 837.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.721807ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.052813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 805.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.019408ms [martini] Started GET /api/raft-follower-health-report/0b3b5896/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.358006ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.707516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.010604ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.192209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.287114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 869.703µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.835408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.293714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.087805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.886109ms [martini] Started GET /api/lb-check for 10.1.1.81:48224 [martini] Completed 200 OK in 903.003µs [martini] Started GET /api/raft-health for 10.1.1.81:48240 [martini] Completed 200 OK in 678.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.625416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.051404ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.021117ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.799716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 831.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.895908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.418015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 836.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.897408ms [martini] Started GET /api/raft-follower-health-report/27d13baf/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 804.003µs 2018-11-29 05:22:59 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.947317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 944.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.37441ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.368914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 837.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.103609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.353219ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.361506ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.874508ms [martini] Started GET /api/lb-check for 10.1.1.81:48364 [martini] Completed 200 OK in 670.703µs [martini] Started GET /api/raft-health for 10.1.1.81:48382 [martini] Completed 200 OK in 683.503µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.515715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 970.905µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.14011ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.837417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.056904ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.140809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.203118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.513811ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.258009ms [martini] Started GET /api/raft-follower-health-report/927116b7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 728.904µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.817116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 917.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.15721ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.979817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 897.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.903008ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.904547ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29861ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.928008ms [martini] Started GET /api/lb-check for 10.1.1.81:48504 [martini] Completed 200 OK in 592.102µs [martini] Started GET /api/raft-health for 10.1.1.81:48514 [martini] Completed 200 OK in 893.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.413023ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.490806ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.941109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.352015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 876.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.884408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.143713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 835.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.816308ms 2018-11-29 05:23:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/bda8f8fc/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 767.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.797717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 971.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.830912ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.382414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.39121ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.992409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.286014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.225505ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.932908ms [martini] Started GET /api/lb-check for 10.1.1.81:48650 [martini] Completed 200 OK in 849.804µs [martini] Started GET /api/raft-health for 10.1.1.81:48680 [martini] Completed 200 OK in 857.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.139518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.009904ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21901ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.482315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 891.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.140409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.264414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 980.205µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.085922ms [martini] Started GET /api/raft-follower-health-report/8d354762/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 790.104µs 2018-11-29 05:23:29 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 05:23:29 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.384615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 987.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.012209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.608816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 976.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.948009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.350315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 879.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.154509ms [martini] Started GET /api/lb-check for 10.1.1.81:48798 [martini] Completed 200 OK in 633.203µs [martini] Started GET /api/raft-health for 10.1.1.81:48810 [martini] Completed 200 OK in 624.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.470014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.004105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.033309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.607024ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.196605ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.102209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.417736ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 923.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.962908ms [martini] Started GET /api/raft-follower-health-report/a343ed42/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 697.703µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.360614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.315418ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.589211ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.173717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.331405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.137009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.362332ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.672507ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.092209ms [martini] Started GET /api/lb-check for 10.1.1.81:48942 [martini] Completed 200 OK in 748.204µs [martini] Started GET /api/raft-health for 10.1.1.81:48952 [martini] Completed 200 OK in 735.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.605215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 900.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.910709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.143414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 776.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.237222ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.068713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 909.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.895608ms [martini] Started GET /api/raft-follower-health-report/f48a3bbe/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 793.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.410815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 955.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.888908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.472214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 818.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.897408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.953013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 851.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.711716ms [martini] Started GET /api/lb-check for 10.1.1.81:49074 [martini] Completed 200 OK in 792.804µs [martini] Started GET /api/raft-health for 10.1.1.81:49098 [martini] Completed 200 OK in 725.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.656015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.263306ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21341ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.630516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 983.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.049009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.017212ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 830.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.947608ms [martini] Started GET /api/raft-follower-health-report/466569c6/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 691.503µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.072817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.089904ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.190309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.200414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 841.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27841ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.508515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.094504ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.088809ms [martini] Started GET /api/lb-check for 10.1.1.81:49214 [martini] Completed 200 OK in 855.903µs [martini] Started GET /api/raft-health for 10.1.1.81:49238 [martini] Completed 200 OK in 769.404µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.467414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 891.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.041139ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.724416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.057005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.025709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.577441ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 858.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.50401ms 2018-11-29 05:24:05 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/ef2ee4b9/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 794.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.553715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 926.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.300109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.61292ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 846.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.405919ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.24944ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.447315ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.008213ms [martini] Started GET /api/lb-check for 10.1.1.81:49366 [martini] Completed 200 OK in 888.604µs [martini] Started GET /api/raft-health for 10.1.1.81:49378 [martini] Completed 200 OK in 720.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.492015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 929.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.064309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.195114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 961.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.269709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.978412ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 986.705µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.939708ms 2018-11-29 05:24:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/f2083ba7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 847.404µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.571016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 960.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.048909ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.272114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 941.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.35251ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.197414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 933.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.812008ms [martini] Started GET /api/lb-check for 10.1.1.81:49512 [martini] Completed 200 OK in 755.304µs [martini] Started GET /api/raft-health for 10.1.1.81:49526 [martini] Completed 200 OK in 846.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.742416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.018905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.150909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.379215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 995.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.975608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.801916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 753.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.007509ms [martini] Started GET /api/raft-follower-health-report/b3de54bf/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 633.903µs 2018-11-29 05:24:29 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.68442ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.284209ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.414911ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.703016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 831.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.957309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.231014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 763.503µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29951ms [martini] Started GET /api/lb-check for 10.1.1.81:49644 [martini] Completed 200 OK in 661.803µs [martini] Started GET /api/raft-health for 10.1.1.81:49668 [martini] Completed 200 OK in 814.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.665115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 961.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.59642ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.565837ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 685.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.080909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 23.4212ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.399906ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.061925ms 2018-11-29 05:24:35 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/bbea2bf4/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 764.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.930917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 803.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26401ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.524432ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 928.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.954709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.323023ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.084604ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.048909ms [martini] Started GET /api/lb-check for 10.1.1.81:49788 [martini] Completed 200 OK in 2.641311ms [martini] Started GET /api/raft-health for 10.1.1.81:49808 [martini] Completed 200 OK in 742.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.575519ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 850.603µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.437611ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.270214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 881.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.102209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.219913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 863.103µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.075609ms [martini] Started GET /api/raft-follower-health-report/4d2e148d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.178005ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.595715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 947.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.931708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.234213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 916.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.083809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.263814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 821.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.926912ms [martini] Started GET /api/lb-check for 10.1.1.81:49930 [martini] Completed 200 OK in 773.003µs [martini] Started GET /api/raft-health for 10.1.1.81:49946 [martini] Completed 200 OK in 694.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.198622ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.157806ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.398223ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.589919ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 881.205µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.195012ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.871115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 920.105µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.034511ms [martini] Started GET /api/raft-follower-health-report/abca9ebd/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 721.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.76892ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 740.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.271412ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.382317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 946.905µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.307512ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.722724ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.277607ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.432113ms [martini] Started GET /api/lb-check for 10.1.1.81:50070 [martini] Completed 200 OK in 611.103µs [martini] Started GET /api/raft-health for 10.1.1.81:50082 [martini] Completed 200 OK in 874.304µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.69602ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 852.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.97321ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.993616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 805.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.823809ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.728519ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 929.305µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.997011ms 2018-11-29 05:25:05 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/8bd6126e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 860.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.82582ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 822.805µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.043911ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.378022ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.217706ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.512319ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 13.088069ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 903.105µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.092511ms [martini] Started GET /api/lb-check for 10.1.1.81:50204 [martini] Completed 200 OK in 912.904µs [martini] Started GET /api/raft-health for 10.1.1.81:50230 [martini] Completed 200 OK in 675.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.923531ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.250006ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.110411ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.279317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 870.405µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.81921ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.073817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 896.905µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.90241ms 2018-11-29 05:25:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/2f3aad8b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 957.105µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.625719ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 982.805µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.364512ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.356717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.036811ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.93371ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.368618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 826.605µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.885909ms [martini] Started GET /api/lb-check for 10.1.1.81:50362 [martini] Completed 200 OK in 841.604µs [martini] Started GET /api/raft-health for 10.1.1.81:50380 [martini] Completed 200 OK in 911.905µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.729919ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 858.705µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.088611ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.166817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 812.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.99321ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.475318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.031106ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.458513ms [martini] Started GET /api/raft-follower-health-report/05f94352/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 865.005µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.388617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 894.405µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.02991ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.305617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 798.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.110711ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.343318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 749.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.85771ms [martini] Started GET /api/lb-check for 10.1.1.81:50498 [martini] Completed 200 OK in 672.203µs [martini] Started GET /api/raft-health for 10.1.1.81:50510 [martini] Completed 200 OK in 893.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.562818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 941.605µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.083511ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.293627ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 927.805µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.91391ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.332023ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 875.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.137311ms 2018-11-29 05:25:35 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/94942763/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 802.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.433718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.119506ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.988131ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.70272ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 888.705µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.88111ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.658335ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.164106ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.90171ms [martini] Started GET /api/lb-check for 10.1.1.81:50640 [martini] Completed 200 OK in 650.903µs [martini] Started GET /api/raft-health for 10.1.1.81:50650 [martini] Completed 200 OK in 717.203µs 2018-11-29 05:25:41 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.671719ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.006106ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.097811ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.353717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.436513ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.835809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.367317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 833.405µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.84831ms [martini] Started GET /api/raft-follower-health-report/9901c180/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 783.205µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.408817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 872.405µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.99971ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.550019ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 800.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.93901ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.231117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 841.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.969421ms [martini] Started GET /api/lb-check for 10.1.1.81:50772 [martini] Completed 200 OK in 896.005µs [martini] Started GET /api/raft-health for 10.1.1.81:50800 [martini] Completed 200 OK in 1.635109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.423818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 952.305µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.382312ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.201616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 732.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.817609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.566219ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 842.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.94231ms [martini] Started GET /api/raft-follower-health-report/4e762e12/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 812.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.625719ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 958.505µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.159412ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.602119ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 924.205µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.05171ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.193517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 770.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.091511ms [martini] Started GET /api/lb-check for 10.1.1.81:50928 [martini] Completed 200 OK in 688.704µs [martini] Started GET /api/raft-health for 10.1.1.81:50942 [martini] Completed 200 OK in 700.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.464218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.401913ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.975652ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.046542ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 835.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.887809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.465623ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 938.505µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.03991ms [martini] Started GET /api/raft-follower-health-report/facc2735/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 2.866915ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.409922ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 948.005µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.175111ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.293222ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 869.205µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.05311ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 15.844481ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.069205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.275712ms [martini] Started GET /api/lb-check for 10.1.1.81:51068 [martini] Completed 200 OK in 840.904µs [martini] Started GET /api/raft-health for 10.1.1.81:51078 [martini] Completed 200 OK in 749.004µs 2018-11-29 05:26:11 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.79692ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.187607ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.246711ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.174216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 970.705µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.782709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.312617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 934.505µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.89081ms 2018-11-29 05:26:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/0a15ce19/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 732.903µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.88062ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.002905ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.92131ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.332317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 924.405µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.02081ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.159316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 937.505µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.97511ms [martini] Started GET /api/lb-check for 10.1.1.81:51212 [martini] Completed 200 OK in 842.304µs [martini] Started GET /api/raft-health for 10.1.1.81:51228 [martini] Completed 200 OK in 806.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.757919ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 993.705µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.212512ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.504018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 915.405µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.936809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.173017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 748.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.762709ms [martini] Started GET /api/raft-follower-health-report/74ba839d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 858.704µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.650018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.105706ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.84602ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.775419ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 845.305µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.006211ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.598918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 792.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.167811ms [martini] Started GET /api/lb-check for 10.1.1.81:51348 [martini] Completed 200 OK in 633.803µs [martini] Started GET /api/raft-health for 10.1.1.81:51376 [martini] Completed 200 OK in 720.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.315917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.102805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.212411ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.568938ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.142806ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.07321ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.016516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 8.709245ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.914509ms [martini] Started GET /api/raft-follower-health-report/250d3b34/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 683.704µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.924525ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.012205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.505313ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.195817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 932.905µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.389513ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.279017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.602508ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.06091ms [martini] Started GET /api/lb-check for 10.1.1.81:51504 [martini] Completed 200 OK in 797.104µs [martini] Started GET /api/raft-health for 10.1.1.81:51514 [martini] Completed 200 OK in 5.110626ms 2018-11-29 05:26:41 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.614019ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 937.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.93461ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.246517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 921.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.95991ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.357117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 839.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.02261ms 2018-11-29 05:26:47 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/a677b6e9/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.044405ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.976821ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 787.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.294622ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.211816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 864.205µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.610613ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.301717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 798.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.97001ms [martini] Started GET /api/lb-check for 10.1.1.81:51634 [martini] Completed 200 OK in 797.204µs [martini] Started GET /api/raft-health for 10.1.1.81:51648 [martini] Completed 200 OK in 810.004µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.724419ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 872.005µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.285922ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.220516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 922.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.391112ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.210116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 837.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.99181ms [martini] Started GET /api/raft-follower-health-report/0299c461/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 659.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.457117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.095006ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.232811ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.801019ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.097705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.00741ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.302722ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.750414ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.08111ms [martini] Started GET /api/lb-check for 10.1.1.81:51776 [martini] Completed 200 OK in 1.100906ms [martini] Started GET /api/raft-health for 10.1.1.81:51800 [martini] Completed 200 OK in 626.803µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.154121ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 914.805µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.02381ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.05453ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.813809ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.654914ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.620023ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.056505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.98841ms [martini] Started GET /api/raft-follower-health-report/ef11a205/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 923.605µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.545717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.122906ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.144011ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.85993ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.210506ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.04641ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.465248ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 971.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.06091ms [martini] Started GET /api/lb-check for 10.1.1.81:51916 [martini] Completed 200 OK in 1.061305ms [martini] Started GET /api/raft-health for 10.1.1.81:51940 [martini] Completed 200 OK in 809.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.388432ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.328607ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.525913ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.615718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 994.605µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.915709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.557818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 877.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.98991ms 2018-11-29 05:27:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 05:27:17 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/7bd860d7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 804.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.84912ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 929.005µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.12151ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.553318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.303511ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.95291ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.289717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 970.905µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.743914ms [martini] Started GET /api/lb-check for 10.1.1.81:52076 [martini] Completed 200 OK in 831.604µs [martini] Started GET /api/raft-health for 10.1.1.81:52090 [martini] Completed 200 OK in 801.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.716719ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 898.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.01741ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.523718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 908.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.10071ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.194616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.781509ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.850524ms [martini] Started GET /api/raft-follower-health-report/25c01de5/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 758.404µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.452318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 986.505µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.14511ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.382117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.000305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.98501ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.153215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 833.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.762809ms [martini] Started GET /api/lb-check for 10.1.1.81:52210 [martini] Completed 200 OK in 680.603µs [martini] Started GET /api/raft-health for 10.1.1.81:52222 [martini] Completed 200 OK in 699.603µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.11512ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.083906ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.234011ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.560522ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.045705ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.84481ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.97672ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 959.605µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.88461ms [martini] Started GET /api/raft-follower-health-report/1cdf272b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 876.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.481417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.152706ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.593728ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.117426ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 917.505µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.895709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.137521ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.104705ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.220711ms [martini] Started GET /api/lb-check for 10.1.1.81:52350 [martini] Completed 200 OK in 851.604µs [martini] Started GET /api/raft-health for 10.1.1.81:52376 [martini] Completed 200 OK in 622.503µs 2018-11-29 05:27:41 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.247022ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 947.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.513713ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.292117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.422312ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.281411ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.975615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 796.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.861509ms [martini] Started GET /api/raft-follower-health-report/623f3cdd/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 773.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.571018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.011505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.97011ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.457617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 950.405µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.97601ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.050415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 957.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.193321ms [martini] Started GET /api/lb-check for 10.1.1.81:52500 [martini] Completed 200 OK in 773.604µs [martini] Started GET /api/raft-health for 10.1.1.81:52518 [martini] Completed 200 OK in 848.604µs 2018-11-29 05:27:53 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.683618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.069205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.644814ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.649518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.208006ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.917509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.039815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 769.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.343212ms [martini] Started GET /api/raft-follower-health-report/c0f13e2f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 841.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.868024ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.262706ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.440912ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.522918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 821.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.947109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.982315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 764.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.01251ms [martini] Started GET /api/lb-check for 10.1.1.81:52644 [martini] Completed 200 OK in 884.504µs [martini] Started GET /api/raft-health for 10.1.1.81:52654 [martini] Completed 200 OK in 720.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.90812ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 882.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.425617ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.91983ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.372407ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.225911ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.408616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.060905ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.06441ms [martini] Started GET /api/raft-follower-health-report/11279f01/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.183206ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.654318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 996.205µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.184511ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.670639ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.726908ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.487912ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 14.928174ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.04201ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.134011ms [martini] Started GET /api/lb-check for 10.1.1.81:52782 [martini] Completed 200 OK in 815.104µs [martini] Started GET /api/raft-health for 10.1.1.81:52792 [martini] Completed 200 OK in 936.805µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.592818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.209106ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.191411ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.579618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 781.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.03231ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.999115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 854.605µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.555913ms 2018-11-29 05:28:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 05:28:17 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/d2f467e9/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 999.305µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.450918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.164806ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.06301ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.533618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 906.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.890609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.192516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 784.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.88171ms [martini] Started GET /api/lb-check for 10.1.1.81:52926 [martini] Completed 200 OK in 870.905µs [martini] Started GET /api/raft-health for 10.1.1.81:52954 [martini] Completed 200 OK in 742.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.434717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.238106ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.948809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.532118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 933.305µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.11061ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.980115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 746.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.94431ms [martini] Started GET /api/raft-follower-health-report/4458092e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 872.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.07692ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 887.505µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.435717ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.504317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 766.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.03391ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.154916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 886.805µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.859409ms [martini] Started GET /api/lb-check for 10.1.1.81:53074 [martini] Completed 200 OK in 772.904µs [martini] Started GET /api/raft-health for 10.1.1.81:53084 [martini] Completed 200 OK in 685.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.94152ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 961.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.157511ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.435942ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.115906ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.229911ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.090925ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 5.979429ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.697413ms [martini] Started GET /api/raft-follower-health-report/0e7df5d1/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 750.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.662028ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.142006ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.267811ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.10825ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.092106ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.22334ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.423622ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.020805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.235511ms [martini] Started GET /api/lb-check for 10.1.1.81:53212 [martini] Completed 200 OK in 1.298907ms [martini] Started GET /api/raft-health for 10.1.1.81:53222 [martini] Completed 200 OK in 4.602523ms 2018-11-29 05:28:41 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.657018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 919.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.15541ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.504317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 952.305µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.05871ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.382217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.086706ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.97221ms [martini] Started GET /api/raft-follower-health-report/fa1f0d3a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.935309ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.715119ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 957.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.224911ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.803618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 956.305µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.06741ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.071415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 932.905µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.96891ms [martini] Started GET /api/lb-check for 10.1.1.81:53342 [martini] Completed 200 OK in 756.204µs [martini] Started GET /api/raft-health for 10.1.1.81:53358 [martini] Completed 200 OK in 768.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.655218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 888.005µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.010515ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.296316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 777.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.03391ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.885514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 933.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.848609ms [martini] Started GET /api/raft-follower-health-report/487b2a5a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.90811ms 2018-11-29 05:28:59 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.460127ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.433407ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.774714ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.385517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 930.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.918009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.878124ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.04411ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.902509ms [martini] Started GET /api/lb-check for 10.1.1.81:53486 [martini] Completed 200 OK in 684.803µs [martini] Started GET /api/raft-health for 10.1.1.81:53512 [martini] Completed 200 OK in 858.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.619517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 943.705µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.283611ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.673218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.282206ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.318017ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.806519ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.016905ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.712319ms [martini] Started GET /api/raft-follower-health-report/fa7fe34d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 714.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.713619ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.117806ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.126211ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.659823ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 919.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.309612ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.18445ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.032105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.133011ms [martini] Started GET /api/lb-check for 10.1.1.81:53640 [martini] Completed 200 OK in 1.267506ms [martini] Started GET /api/raft-health for 10.1.1.81:53656 [martini] Completed 200 OK in 972.005µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.530227ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.148905ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.04441ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.009415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 877.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.854109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.265016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 677.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.692108ms 2018-11-29 05:29:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/fac59c7c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 886.705µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.918019ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.091705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.177111ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.346716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.451712ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.256321ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.665418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 977.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.04621ms [martini] Started GET /api/lb-check for 10.1.1.81:53794 [martini] Completed 200 OK in 628.803µs [martini] Started GET /api/raft-health for 10.1.1.81:53808 [martini] Completed 200 OK in 696.404µs 2018-11-29 05:29:23 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.955419ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.011805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.293312ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.385517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 937.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.881714ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.871219ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 985.305µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.610627ms [martini] Started GET /api/raft-follower-health-report/0f1b0df1/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 802.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.462417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.037205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.142311ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.453817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.061105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.96921ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.229715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.141505ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.742509ms [martini] Started GET /api/lb-check for 10.1.1.81:53938 [martini] Completed 200 OK in 711.103µs [martini] Started GET /api/raft-health for 10.1.1.81:53950 [martini] Completed 200 OK in 698.904µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.501918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 930.505µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.656013ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.386731ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 945.705µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.292712ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.489917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.196506ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.321711ms [martini] Started GET /api/raft-follower-health-report/7a2ac82a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 934.505µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.10162ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.563013ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.067315ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.065315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 852.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.00531ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.27764ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 933.505µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.91061ms [martini] Started GET /api/lb-check for 10.1.1.81:54072 [martini] Completed 200 OK in 746.304µs [martini] Started GET /api/raft-health for 10.1.1.81:54100 [martini] Completed 200 OK in 1.090405ms 2018-11-29 05:29:41 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.964919ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.360707ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.782614ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.399717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.148705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.957715ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.901414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 871.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.632608ms [martini] Started GET /api/raft-follower-health-report/f8a788bc/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 842.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.708518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 979.205µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.969609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.328321ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 922.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.535513ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.943815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 783.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.637818ms [martini] Started GET /api/lb-check for 10.1.1.81:54228 [martini] Completed 200 OK in 902.505µs [martini] Started GET /api/raft-health for 10.1.1.81:54244 [martini] Completed 200 OK in 695.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.765119ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.053905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.329712ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.681418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.447007ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.14241ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.321317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 860.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.00541ms [martini] Started GET /api/raft-follower-health-report/20c2fb53/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 872.804µs 2018-11-29 05:29:59 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.611617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 916.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.228211ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.616822ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.560207ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.06722ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.056625ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.152905ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.11981ms [martini] Started GET /api/lb-check for 10.1.1.81:54380 [martini] Completed 200 OK in 868.005µs [martini] Started GET /api/raft-health for 10.1.1.81:54394 [martini] Completed 200 OK in 723.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.919719ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.231406ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.529237ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.097439ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 779.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.11681ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.026624ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 980.205µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.04511ms [martini] Started GET /api/raft-follower-health-report/e467c53f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 835.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.452922ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.038305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.559617ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.612617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 878.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.718118ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.607017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.009105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.05481ms [martini] Started GET /api/lb-check for 10.1.1.81:54516 [martini] Completed 200 OK in 678.604µs [martini] Started GET /api/raft-health for 10.1.1.81:54526 [martini] Completed 200 OK in 906.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.834319ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.086905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.603912ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.192121ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 852.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16881ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.872519ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 843.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.874909ms 2018-11-29 05:30:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/af4c0161/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 750.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.895719ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.343307ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.440811ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.17662ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 997.405µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.06181ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.056919ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 861.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.939109ms [martini] Started GET /api/lb-check for 10.1.1.81:54668 [martini] Completed 200 OK in 621.203µs [martini] Started GET /api/raft-health for 10.1.1.81:54698 [martini] Completed 200 OK in 810.304µs 2018-11-29 05:30:23 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.749818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 889.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.242716ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.02512ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.100705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.925109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.461917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 823.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.832508ms [martini] Started GET /api/raft-follower-health-report/f16b9ab5/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 775.404µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.591017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 8.638442ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.266211ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.107615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.076905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.11121ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.265415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 804.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.831509ms [martini] Started GET /api/lb-check for 10.1.1.81:54824 [martini] Completed 200 OK in 687.803µs [martini] Started GET /api/raft-health for 10.1.1.81:54836 [martini] Completed 200 OK in 763.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.307121ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.172406ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.900814ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.290026ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.611613ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.929514ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.241216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 901.805µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.06831ms [martini] Started GET /api/raft-follower-health-report/05de46ad/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 938.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.594317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.082505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.986209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.31222ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 986.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.08681ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.707023ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.040305ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.146116ms [martini] Started GET /api/lb-check for 10.1.1.81:54962 [martini] Completed 200 OK in 5.166425ms [martini] Started GET /api/raft-health for 10.1.1.81:54974 [martini] Completed 200 OK in 862.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.925119ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.074206ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.641212ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.626518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.360007ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.00981ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.557517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.317406ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.162811ms 2018-11-29 05:30:47 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/abb4bb3b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 806.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.489417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 986.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.770314ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.713518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.242006ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.10101ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.095515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 855.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.03981ms [martini] Started GET /api/lb-check for 10.1.1.81:55104 [martini] Completed 200 OK in 833.504µs [martini] Started GET /api/raft-health for 10.1.1.81:55132 [martini] Completed 200 OK in 833.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.668227ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 990.205µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.280611ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.11932ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.066005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.464412ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.762818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.053005ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.177511ms [martini] Started GET /api/raft-follower-health-report/1d0afb09/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 866.105µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.692418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.174206ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.07651ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.424816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 898.305µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.28824ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.194815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 723.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16761ms [martini] Started GET /api/lb-check for 10.1.1.81:55250 [martini] Completed 200 OK in 765.604µs [martini] Started GET /api/raft-health for 10.1.1.81:55276 [martini] Completed 200 OK in 814.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.575918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 870.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.038909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.433917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.279006ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.10771ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.094024ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 908.405µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.798118ms 2018-11-29 05:31:05 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/0e050938/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 846.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.490317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 888.205µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.914109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.952028ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 938.005µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.979419ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.403017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.079406ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.225511ms [martini] Started GET /api/lb-check for 10.1.1.81:55406 [martini] Completed 200 OK in 897.404µs [martini] Started GET /api/raft-health for 10.1.1.81:55418 [martini] Completed 200 OK in 920.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.936919ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.224106ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.405512ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.160815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 916.105µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.189211ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.365316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 893.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.08291ms 2018-11-29 05:31:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/fea5f874/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 956.305µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.779118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.334306ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.943609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.261115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 868.805µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.14951ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.031414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 984.105µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.382411ms [martini] Started GET /api/lb-check for 10.1.1.81:55564 [martini] Completed 200 OK in 826.804µs [martini] Started GET /api/raft-health for 10.1.1.81:55580 [martini] Completed 200 OK in 804.004µs 2018-11-29 05:31:23 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.861819ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.048605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.169011ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.208815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.04772ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.411011ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.018315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 811.903µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.848909ms [martini] Started GET /api/raft-follower-health-report/b2a489b5/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 643.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.543217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.048005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.06821ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.870019ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 869.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.10161ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.281416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 947.405µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.110715ms [martini] Started GET /api/lb-check for 10.1.1.81:55702 [martini] Completed 200 OK in 682.003µs [martini] Started GET /api/raft-health for 10.1.1.81:55728 [martini] Completed 200 OK in 807.604µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.631317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 928.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.97651ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.339326ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.249706ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.11731ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.738242ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 982.205µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.93731ms [martini] Started GET /api/raft-follower-health-report/ba0d9c32/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.020805ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.775519ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.085605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.361511ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.066729ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.598907ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.958209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.505217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.103705ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.286311ms [martini] Started GET /api/lb-check for 10.1.1.81:55854 [martini] Completed 200 OK in 808.104µs [martini] Started GET /api/raft-health for 10.1.1.81:55866 [martini] Completed 200 OK in 777.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.591218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 866.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.023529ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.264815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 880.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.810808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.192816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 988.005µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.246211ms [martini] Started GET /api/raft-follower-health-report/19480207/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 762.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.029119ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 904.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.987909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.455217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.051205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.351516ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.25982ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 919.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.97551ms [martini] Started GET /api/lb-check for 10.1.1.81:55998 [martini] Completed 200 OK in 690.103µs [martini] Started GET /api/raft-health for 10.1.1.81:56014 [martini] Completed 200 OK in 704.604µs 2018-11-29 05:31:53 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.961319ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 995.705µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.07721ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.106914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 838.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.07061ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.977014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 891.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.07471ms [martini] Started GET /api/raft-follower-health-report/df16ac09/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 869.004µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.22382ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 987.705µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.264711ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.664327ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 824.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.96661ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.275115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 916.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.354211ms [martini] Started GET /api/lb-check for 10.1.1.81:56142 [martini] Completed 200 OK in 583.103µs [martini] Started GET /api/raft-health for 10.1.1.81:56154 [martini] Completed 200 OK in 861.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.023919ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.072505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.224011ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.648717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 843.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.968109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.278416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 952.705µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.97861ms [martini] Started GET /api/raft-follower-health-report/681f4ecf/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 813.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.584817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 980.505µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.224534ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.275515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 890.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.07501ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.281121ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.233806ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.893009ms [martini] Started GET /api/lb-check for 10.1.1.81:56282 [martini] Completed 200 OK in 752.204µs [martini] Started GET /api/raft-health for 10.1.1.81:56306 [martini] Completed 200 OK in 875.804µs 2018-11-29 05:32:11 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.864318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 960.905µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.798013ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.657418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 872.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.903809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.584345ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.095105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.958909ms 2018-11-29 05:32:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/b5f6d3f2/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 724.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.810018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.000405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.408212ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.336216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.001905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.97361ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.993515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 880.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.892709ms [martini] Started GET /api/lb-check for 10.1.1.81:56444 [martini] Completed 200 OK in 2.765313ms [martini] Started GET /api/raft-health for 10.1.1.81:56460 [martini] Completed 200 OK in 745.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.026119ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 907.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.417812ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.359516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 985.105µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.897309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.964114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 812.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.764208ms [martini] Started GET /api/raft-follower-health-report/d810b810/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 669.403µs 2018-11-29 05:32:29 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.757118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 823.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.00491ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.312015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 855.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.124315ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.909214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 875.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.724508ms [martini] Started GET /api/lb-check for 10.1.1.81:56584 [martini] Completed 200 OK in 637.103µs [martini] Started GET /api/raft-health for 10.1.1.81:56594 [martini] Completed 200 OK in 717.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.612617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.013005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.14641ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 12.198958ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 902.805µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.972509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.737137ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 888.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.000509ms [martini] Started GET /api/raft-follower-health-report/d14167cf/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 860.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.706517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.806323ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.03491ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.648327ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 991.805µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18391ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.960447ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.696008ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.798608ms [martini] Started GET /api/lb-check for 10.1.1.81:56720 [martini] Completed 200 OK in 902.604µs [martini] Started GET /api/raft-health for 10.1.1.81:56730 [martini] Completed 200 OK in 829.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.507616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.086305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.916109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.868019ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 992.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.739708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.233615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 994.505µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.858309ms [martini] Started GET /api/raft-follower-health-report/c2708ff5/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 824.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.368621ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.016604ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.319811ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.866918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 954.905µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.06201ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.375816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 834.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.988809ms [martini] Started GET /api/lb-check for 10.1.1.81:56858 [martini] Completed 200 OK in 780.603µs [martini] Started GET /api/raft-health for 10.1.1.81:56890 [martini] Completed 200 OK in 938.005µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.038619ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.186706ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.935209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.459017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 874.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.982109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.464917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 989.105µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.997309ms [martini] Started GET /api/raft-follower-health-report/a0f0d4ee/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 724.504µs 2018-11-29 05:32:59 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.276916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.117506ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.920919ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.469021ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 940.205µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.002409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.970914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 831.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.844709ms [martini] Started GET /api/lb-check for 10.1.1.81:57020 [martini] Completed 200 OK in 811.003µs [martini] Started GET /api/raft-health for 10.1.1.81:57032 [martini] Completed 200 OK in 774.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.450216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 818.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.001309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.046529ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.036314ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.206011ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.240615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.956314ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.258711ms [martini] Started GET /api/raft-follower-health-report/fd8f6ddf/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 811.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.689018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.412307ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.401712ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.790818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.017805ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.310411ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.492616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.428507ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.155911ms [martini] Started GET /api/lb-check for 10.1.1.81:57158 [martini] Completed 200 OK in 958.205µs [martini] Started GET /api/raft-health for 10.1.1.81:57170 [martini] Completed 200 OK in 797.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.826018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 878.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.09281ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.370716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 830.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.739008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.183314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 842.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.10981ms 2018-11-29 05:33:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 05:33:17 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/00e659f1/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 851.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.799232ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 844.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.283911ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.407316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 841.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.298111ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.563117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 879.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.17201ms [martini] Started GET /api/lb-check for 10.1.1.81:57308 [martini] Completed 200 OK in 883.004µs [martini] Started GET /api/raft-health for 10.1.1.81:57334 [martini] Completed 200 OK in 703.804µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.544717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 918.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.265911ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.983019ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 872.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.92111ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.498317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.140905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.910709ms [martini] Started GET /api/raft-follower-health-report/14b1a5f1/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 935.805µs 2018-11-29 05:33:29 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.886623ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 957.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.960109ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.783118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 840.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.465211ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.590516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.866314ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.833813ms [martini] Started GET /api/lb-check for 10.1.1.81:57444 [martini] Completed 200 OK in 813.003µs [martini] Started GET /api/raft-health for 10.1.1.81:57470 [martini] Completed 200 OK in 762.403µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.684517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.001904ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.935309ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.402916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 852.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.850409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.143524ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 793.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.519912ms [martini] Started GET /api/raft-follower-health-report/7bceb20a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 4.43382ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.453416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 885.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.227511ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.272824ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 821.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.09391ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.346415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 804.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.04961ms [martini] Started GET /api/lb-check for 10.1.1.81:57596 [martini] Completed 200 OK in 819.604µs [martini] Started GET /api/raft-health for 10.1.1.81:57606 [martini] Completed 200 OK in 847.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.616017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21041ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.997809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.196715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 870.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.912709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.190915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 951.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.809509ms [martini] Started GET /api/raft-follower-health-report/f113874f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 912.204µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.13382ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 954.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.338511ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.267115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.002505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.720118ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.362516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 811.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.14611ms [martini] Started GET /api/lb-check for 10.1.1.81:57730 [martini] Completed 200 OK in 833.604µs [martini] Started GET /api/raft-health for 10.1.1.81:57746 [martini] Completed 200 OK in 863.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.854518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 823.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18371ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.513616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 970.405µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.779813ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.245915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 877.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19271ms [martini] Started GET /api/raft-follower-health-report/1c70daf4/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 731.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.740717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 871.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.11101ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.301415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.492307ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.802509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.987114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 911.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.02051ms [martini] Started GET /api/lb-check for 10.1.1.81:57878 [martini] Completed 200 OK in 665.503µs [martini] Started GET /api/raft-health for 10.1.1.81:57906 [martini] Completed 200 OK in 851.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.605617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 975.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.11001ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.302925ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 886.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.01851ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.022023ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.215105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19561ms 2018-11-29 05:34:05 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/30ffd27b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 846.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.932719ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 923.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.095314ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.367925ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.027505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.410311ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.189315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 959.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.258111ms [martini] Started GET /api/lb-check for 10.1.1.81:58024 [martini] Completed 200 OK in 617.203µs [martini] Started GET /api/raft-health for 10.1.1.81:58042 [martini] Completed 200 OK in 828.004µs 2018/11/29 05:34:11 [INFO] raft: Starting snapshot up to 438016 2018/11/29 05:34:11 [INFO] snapshot: Creating new snapshot at /var/lib/orchestrator/snapshots/9352-438016-1543469651742.tmp 2018/11/29 05:34:11 [INFO] snapshot: reaping snapshot /var/lib/orchestrator/snapshots/9352-433199-1543443081049 2018/11/29 05:34:11 [INFO] raft: Compacting logs from 427362 to 427776 2018/11/29 05:34:11 [INFO] raft: Snapshot to 438016 complete [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.618316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.074405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.840608ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.073215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.607613ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.08041ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.988314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 967.505µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.708508ms 2018-11-29 05:34:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 05:34:17 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/bbd24eee/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 845.904µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.773317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.041005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.04761ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.303916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 913.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.862008ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.951414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 837.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.346615ms [martini] Started GET /api/lb-check for 10.1.1.81:58182 [martini] Completed 200 OK in 791.004µs [martini] Started GET /api/raft-health for 10.1.1.81:58196 [martini] Completed 200 OK in 803.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.43222ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.004705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.038809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.452016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 926.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.979709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.096814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 763.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.899609ms [martini] Started GET /api/raft-follower-health-report/a641d9e8/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 867.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.611722ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.676608ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.325929ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.967819ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.293006ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.652413ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.781227ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.688517ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.300111ms [martini] Started GET /api/lb-check for 10.1.1.81:58320 [martini] Completed 200 OK in 651.003µs [martini] Started GET /api/raft-health for 10.1.1.81:58332 [martini] Completed 200 OK in 781.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.847318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 904.805µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.443616ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.674422ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 915.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.932209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.155914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 849.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.05381ms 2018-11-29 05:34:35 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/196813d4/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 794.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.722418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 925.105µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.10631ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.37843ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 805.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.531221ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 12.488558ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.12201ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.00021ms [martini] Started GET /api/lb-check for 10.1.1.81:58464 [martini] Completed 200 OK in 763.704µs [martini] Started GET /api/raft-health for 10.1.1.81:58490 [martini] Completed 200 OK in 762.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.850418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 906.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.08621ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.504817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 937.705µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.839408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.969914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 979.305µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.99991ms [martini] Started GET /api/raft-follower-health-report/3848ad88/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 820.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.521717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.121105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.17411ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.616217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.865608ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.001714ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.565316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.381206ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.778718ms [martini] Started GET /api/lb-check for 10.1.1.81:58614 [martini] Completed 200 OK in 711.804µs [martini] Started GET /api/raft-health for 10.1.1.81:58630 [martini] Completed 200 OK in 864.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.640317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.023204ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.968509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.648017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.033805ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20441ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.901814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 795.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.257211ms [martini] Started GET /api/raft-follower-health-report/346ead2f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.009505ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.493825ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 874.705µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.329339ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.469016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 890.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.01591ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.070814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 986.005µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.434711ms [martini] Started GET /api/lb-check for 10.1.1.81:58762 [martini] Completed 200 OK in 742.703µs [martini] Started GET /api/raft-health for 10.1.1.81:58772 [martini] Completed 200 OK in 665.903µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.919018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.005805ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.05781ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.44192ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 807.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26821ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.821623ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 8.205538ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.09671ms 2018-11-29 05:35:05 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/e7883463/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 988.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.753318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 992.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.36642ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.493148ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.195305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.307511ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.368716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 974.405µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.07441ms [martini] Started GET /api/lb-check for 10.1.1.81:58902 [martini] Completed 200 OK in 869.504µs [martini] Started GET /api/raft-health for 10.1.1.81:58914 [martini] Completed 200 OK in 5.088624ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.582716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 879.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.240311ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.452816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.000705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.897108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.321916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 898.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.011009ms 2018-11-29 05:35:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/3459ae2c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 9.097542ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.767818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 985.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.091309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.598117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 872.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.14851ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.889718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 826.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.246511ms [martini] Started GET /api/lb-check for 10.1.1.81:59052 [martini] Completed 200 OK in 994.005µs [martini] Started GET /api/raft-health for 10.1.1.81:59086 [martini] Completed 200 OK in 714.403µs 2018-11-29 05:35:23 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.564816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 934.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.855418ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.200415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 963.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.811909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.293716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 985.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.979009ms [martini] Started GET /api/raft-follower-health-report/7b1041cb/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 755.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.655322ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 929.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.039209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.731422ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.152405ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.469111ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.406839ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.191106ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.941623ms [martini] Started GET /api/lb-check for 10.1.1.81:59208 [martini] Completed 200 OK in 695.003µs [martini] Started GET /api/raft-health for 10.1.1.81:59218 [martini] Completed 200 OK in 724.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.890518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 999.705µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.409011ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.868823ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.613807ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.040209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.58624ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.167806ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18231ms [martini] Started GET /api/raft-follower-health-report/90f29a13/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.126605ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.591917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 962.405µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.047609ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.208414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 805.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.351011ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.289716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 866.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.232411ms [martini] Started GET /api/lb-check for 10.1.1.81:59346 [martini] Completed 200 OK in 683.103µs [martini] Started GET /api/raft-health for 10.1.1.81:59356 [martini] Completed 200 OK in 897.704µs 2018-11-29 05:35:41 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.532325ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 935.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.941309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.247115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 849.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.951509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.226015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 911.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.017509ms [martini] Started GET /api/raft-follower-health-report/cb74d2da/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 831.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.765818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.094205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.393711ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.563416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.570612ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.068209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.188414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 968.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.06651ms [martini] Started GET /api/lb-check for 10.1.1.81:59480 [martini] Completed 200 OK in 865.704µs [martini] Started GET /api/raft-health for 10.1.1.81:59498 [martini] Completed 200 OK in 1.237305ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.790018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 902.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26841ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.100114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 934.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.958509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.967814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 970.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.967127ms [martini] Started GET /api/raft-follower-health-report/7725c6d6/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 778.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.480917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.280006ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.17311ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.390316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 924.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.897009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.221915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 878.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.927209ms [martini] Started GET /api/lb-check for 10.1.1.81:59628 [martini] Completed 200 OK in 694.603µs [martini] Started GET /api/raft-health for 10.1.1.81:59654 [martini] Completed 200 OK in 911.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.116319ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 946.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.382711ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.435116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 726.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.02251ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.399316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.023205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.17941ms [martini] Started GET /api/raft-follower-health-report/653aff43/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 795.704µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.789118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 5.906727ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.050214ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.569326ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 890.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.738008ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.643922ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 993.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.902809ms [martini] Started GET /api/lb-check for 10.1.1.81:59782 [martini] Completed 200 OK in 558.102µs [martini] Started GET /api/raft-health for 10.1.1.81:59794 [martini] Completed 200 OK in 982.404µs 2018-11-29 05:36:11 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.463315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 939.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.296611ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.676417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 721.003µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.75934ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.426716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.599708ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.210111ms 2018-11-29 05:36:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/32bab996/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 768.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.528717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 986.905µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.06621ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.084414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 810.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.752508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.004313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 933.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.687917ms [martini] Started GET /api/lb-check for 10.1.1.81:59928 [martini] Completed 200 OK in 708.004µs [martini] Started GET /api/raft-health for 10.1.1.81:59944 [martini] Completed 200 OK in 844.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.584517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 921.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.35351ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.238515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.171705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.913609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.973414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 830.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.970409ms [martini] Started GET /api/raft-follower-health-report/74945715/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 821.403µs 2018-11-29 05:36:29 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.375825ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.545307ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.076409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.17152ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 935.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23711ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.470516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.000604ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.736017ms [martini] Started GET /api/lb-check for 10.1.1.81:60072 [martini] Completed 200 OK in 801.104µs [martini] Started GET /api/raft-health for 10.1.1.81:60100 [martini] Completed 200 OK in 648.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.643817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 924.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.732526ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.713817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 905.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.01911ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.775622ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.078605ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.02371ms [martini] Started GET /api/raft-follower-health-report/7383ffbc/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 842.004µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.478339ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 925.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.033309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.879623ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.145706ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.421225ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.140819ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 843.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.977109ms [martini] Started GET /api/lb-check for 10.1.1.81:60214 [martini] Completed 200 OK in 660.003µs [martini] Started GET /api/raft-health for 10.1.1.81:60238 [martini] Completed 200 OK in 852.904µs 2018-11-29 05:36:41 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.459916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.032005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.874108ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.215915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 710.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.808308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.955014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 906.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.886209ms [martini] Started GET /api/raft-follower-health-report/e7d30fa2/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 824.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.733035ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.083205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18241ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.266615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 829.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.03671ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.394615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.006105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.981609ms [martini] Started GET /api/lb-check for 10.1.1.81:60360 [martini] Completed 200 OK in 728.803µs [martini] Started GET /api/raft-health for 10.1.1.81:60376 [martini] Completed 200 OK in 715.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.072319ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.036305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.818109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.025214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.232905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.381111ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.916318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.358606ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.849009ms [martini] Started GET /api/raft-follower-health-report/7afa1820/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 928.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.471921ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.742313ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.932218ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.649917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 810.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.606112ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.477925ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.070205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.585612ms [martini] Started GET /api/lb-check for 10.1.1.81:60510 [martini] Completed 200 OK in 867.404µs [martini] Started GET /api/raft-health for 10.1.1.81:60522 [martini] Completed 200 OK in 744.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.917818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.162206ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.10351ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.396325ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 990.305µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.640812ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.316652ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 950.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.963009ms [martini] Started GET /api/raft-follower-health-report/3590e260/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 703.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.879818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 932.205µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.341311ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.954936ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 899.305µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.832008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.912218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 945.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.132919ms [martini] Started GET /api/lb-check for 10.1.1.81:60650 [martini] Completed 200 OK in 2.20271ms [martini] Started GET /api/raft-health for 10.1.1.81:60676 [martini] Completed 200 OK in 817.303µs 2018-11-29 05:37:11 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.678922ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 890.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.962309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.255215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 784.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.778608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.642217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 800.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.991209ms 2018-11-29 05:37:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/8d32d17e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 2.669912ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.310915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.005805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.539412ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.323915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 951.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.03551ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.202114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.383706ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.12321ms [martini] Started GET /api/lb-check for 10.1.1.81:60804 [martini] Completed 200 OK in 961.504µs [martini] Started GET /api/raft-health for 10.1.1.81:60826 [martini] Completed 200 OK in 740.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.057519ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 921.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.44462ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.934537ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 910.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16331ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.419016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 840.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.129909ms [martini] Started GET /api/raft-follower-health-report/ce1ddbf0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 729.003µs 2018-11-29 05:37:29 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.483925ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.188805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.413015ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.489539ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 884.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.129318ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.361352ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.005205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29231ms [martini] Started GET /api/lb-check for 10.1.1.81:60954 [martini] Completed 200 OK in 739.903µs [martini] Started GET /api/raft-health for 10.1.1.81:60972 [martini] Completed 200 OK in 709.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.809527ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 751.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.10101ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.360243ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.331406ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23291ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.399816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 923.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.089209ms [martini] Started GET /api/raft-follower-health-report/9c3194de/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 695.003µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.955518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.216205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.113514ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.451434ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 880.605µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.053709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.33762ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.320906ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.345111ms [martini] Started GET /api/lb-check for 10.1.1.81:32870 [martini] Completed 200 OK in 906.904µs [martini] Started GET /api/raft-health for 10.1.1.81:32880 [martini] Completed 200 OK in 816.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.058146ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 978.105µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.13901ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.333015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 788.003µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19931ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.769417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.028205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.945009ms 2018-11-29 05:37:47 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/61ff9964/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 905.804µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.134219ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 936.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.308111ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.754421ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.328506ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.794608ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.284415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 897.605µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.914209ms [martini] Started GET /api/lb-check for 10.1.1.81:33004 [martini] Completed 200 OK in 1.191606ms [martini] Started GET /api/raft-health for 10.1.1.81:33034 [martini] Completed 200 OK in 873.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.590616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.019605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.967109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.311915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 786.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18531ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.242314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.723513ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16371ms [martini] Started GET /api/raft-follower-health-report/62f42431/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.027305ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.668817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 918.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.32371ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.078314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.037004ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.152209ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.447216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 946.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.11561ms [martini] Started GET /api/lb-check for 10.1.1.81:33166 [martini] Completed 200 OK in 629.402µs [martini] Started GET /api/raft-health for 10.1.1.81:33180 [martini] Completed 200 OK in 1.032505ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.457316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 921.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.986209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.474016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 853.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.017209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.811418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.048005ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.022109ms [martini] Started GET /api/raft-follower-health-report/bf64ba34/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 654.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.049918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.919814ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.54302ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.446316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 820.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.983209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.316824ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 940.505µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28221ms [martini] Started GET /api/lb-check for 10.1.1.81:33304 [martini] Completed 200 OK in 839.904µs [martini] Started GET /api/raft-health for 10.1.1.81:33316 [martini] Completed 200 OK in 723.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.823018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.005205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.905009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.781417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 806.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.392325ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.084514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 965.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.08871ms 2018-11-29 05:38:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 05:38:17 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/e8600e34/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.269106ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.143419ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 889.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.265911ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.129914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 788.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.936109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.537916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 812.203µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.382815ms [martini] Started GET /api/lb-check for 10.1.1.81:33450 [martini] Completed 200 OK in 653.603µs [martini] Started GET /api/raft-health for 10.1.1.81:33464 [martini] Completed 200 OK in 1.183005ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.952132ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.067104ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.488411ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.539416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 938.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.871009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.923813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 912.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.881908ms [martini] Started GET /api/raft-follower-health-report/5d7e5d30/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 737.304µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.388747ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.446111ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.435824ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.297815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.086005ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.087009ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.302715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 970.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.016309ms [martini] Started GET /api/lb-check for 10.1.1.81:33596 [martini] Completed 200 OK in 741.303µs [martini] Started GET /api/raft-health for 10.1.1.81:33622 [martini] Completed 200 OK in 843.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.424715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 890.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.059432ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.076432ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 959.105µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.953909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.357915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.508221ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.549912ms 2018-11-29 05:38:35 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/51961f3c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 780.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.597125ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.186705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.451616ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.365924ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.042805ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.883209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 12.015655ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.518907ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.08591ms [martini] Started GET /api/lb-check for 10.1.1.81:33748 [martini] Completed 200 OK in 631.803µs [martini] Started GET /api/raft-health for 10.1.1.81:33758 [martini] Completed 200 OK in 1.102405ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.629517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.132006ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.106009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.409116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 856.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.879309ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.125814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.028005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20951ms [martini] Started GET /api/raft-follower-health-report/c07ba3f1/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 835.104µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.803918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.133705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23711ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.140033ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 819.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.302711ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.306715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.013905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.111609ms [martini] Started GET /api/lb-check for 10.1.1.81:33884 [martini] Completed 200 OK in 818.604µs [martini] Started GET /api/raft-health for 10.1.1.81:33900 [martini] Completed 200 OK in 1.353006ms 2018-11-29 05:38:53 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.714817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.148005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.315411ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.212915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.044104ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.02641ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.319515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 893.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.834008ms [martini] Started GET /api/raft-follower-health-report/653b0d0f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 829.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.674417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.160305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.837613ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 26.080519ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.30171ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.938909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.306215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 955.405µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.306711ms [martini] Started GET /api/lb-check for 10.1.1.81:34034 [martini] Completed 200 OK in 835.104µs [martini] Started GET /api/raft-health for 10.1.1.81:34044 [martini] Completed 200 OK in 937.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.543616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 978.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.798313ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.996636ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 970.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22111ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.80104ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.192405ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.413111ms [martini] Started GET /api/raft-follower-health-report/56f5b1b9/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 723.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.335715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.381406ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.307111ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.214319ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 882.605µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.295311ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.167633ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.220806ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.461712ms [martini] Started GET /api/lb-check for 10.1.1.81:34168 [martini] Completed 200 OK in 818.104µs [martini] Started GET /api/raft-health for 10.1.1.81:34196 [martini] Completed 200 OK in 683.003µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.38792ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.095605ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.599612ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.249015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.027405ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.967909ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.598417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 815.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.07451ms 2018-11-29 05:39:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 05:39:17 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/2bfdf95d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 718.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.758931ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.244606ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.629116ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.074318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 930.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.753608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.047214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 849.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.900509ms [martini] Started GET /api/lb-check for 10.1.1.81:34336 [martini] Completed 200 OK in 761.403µs [martini] Started GET /api/raft-health for 10.1.1.81:34350 [martini] Completed 200 OK in 799.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.243215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 975.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.038709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 12.095355ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.084305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.877309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.143514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.000204ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.939209ms [martini] Started GET /api/raft-follower-health-report/0faafe12/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 693.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.849318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.302806ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.732926ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.987932ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 815.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.018809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.935422ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 803.203µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.954609ms [martini] Started GET /api/lb-check for 10.1.1.81:34480 [martini] Completed 200 OK in 650.303µs [martini] Started GET /api/raft-health for 10.1.1.81:34492 [martini] Completed 200 OK in 783.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.687817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.116705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.085709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.327115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 795.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.913208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.707839ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.589608ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.022109ms [martini] Started GET /api/raft-follower-health-report/390a5cc1/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 818.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.006018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 966.805µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.867708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.547316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.542207ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.395611ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.39582ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 929.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.022309ms [martini] Started GET /api/lb-check for 10.1.1.81:34622 [martini] Completed 200 OK in 811.304µs [martini] Started GET /api/raft-health for 10.1.1.81:34646 [martini] Completed 200 OK in 1.556907ms 2018-11-29 05:39:41 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.78334ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.035204ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.045009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.124714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 968.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.969209ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.208615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.025705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.044709ms [martini] Started GET /api/raft-follower-health-report/644edee6/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.064805ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.363519ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.118005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.097314ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.888227ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.165105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.842109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.066914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.021905ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.858008ms [martini] Started GET /api/lb-check for 10.1.1.81:34756 [martini] Completed 200 OK in 871.704µs [martini] Started GET /api/raft-health for 10.1.1.81:34784 [martini] Completed 200 OK in 841.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.791917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 918.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.512211ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.281515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.016305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.002709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.260715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.43532ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.920309ms [martini] Started GET /api/raft-follower-health-report/416b1bd1/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 782.504µs 2018-11-29 05:39:59 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.665317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.307506ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.528716ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.758931ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.188405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.783812ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.560616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 894.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.928508ms [martini] Started GET /api/lb-check for 10.1.1.81:34930 [martini] Completed 200 OK in 789.804µs [martini] Started GET /api/raft-health for 10.1.1.81:34942 [martini] Completed 200 OK in 2.27851ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.510216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 953.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.947009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.405015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 877.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.925509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.481116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 857.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.06471ms [martini] Started GET /api/raft-follower-health-report/7f1d7379/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 785.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.012518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.633212ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.171814ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.934023ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 998.905µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.152409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.115523ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.386907ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.523712ms [martini] Started GET /api/lb-check for 10.1.1.81:35074 [martini] Completed 200 OK in 691.903µs [martini] Started GET /api/raft-health for 10.1.1.81:35086 [martini] Completed 200 OK in 692.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.797317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.201805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.606212ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.271814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.482916ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.026113ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.646116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.192406ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16011ms 2018-11-29 05:40:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/9b8f9be2/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 928.405µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.654817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.226005ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.04791ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.680017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 848.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.779612ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.222715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 975.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.098314ms [martini] Started GET /api/lb-check for 10.1.1.81:35228 [martini] Completed 200 OK in 929.304µs [martini] Started GET /api/raft-health for 10.1.1.81:35258 [martini] Completed 200 OK in 823.404µs 2018-11-29 05:40:23 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.685617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.228706ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.032409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.181514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 971.905µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.652512ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.841517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.110705ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.976508ms [martini] Started GET /api/raft-follower-health-report/1e14292f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 760.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.649726ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.073805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.078514ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.797122ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.212906ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.017413ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.614016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.298206ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.805413ms [martini] Started GET /api/lb-check for 10.1.1.81:35378 [martini] Completed 200 OK in 747.103µs [martini] Started GET /api/raft-health for 10.1.1.81:35396 [martini] Completed 200 OK in 696.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.775217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.277105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.604616ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.812022ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 964.205µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.24971ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.635821ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.040505ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.389311ms [martini] Started GET /api/raft-follower-health-report/bebbe924/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 834.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.778917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.044405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.187515ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.879722ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 953.205µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.863909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.979127ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.224006ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.185909ms [martini] Started GET /api/lb-check for 10.1.1.81:35526 [martini] Completed 200 OK in 894.804µs [martini] Started GET /api/raft-health for 10.1.1.81:35538 [martini] Completed 200 OK in 879.704µs 2018-11-29 05:40:41 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.139918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 889.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.394911ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.715621ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 817.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.169109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.324215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 851.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.005209ms [martini] Started GET /api/raft-follower-health-report/70e6a344/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.470907ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.932918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 954.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.815522ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.760117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.193905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.923608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.482216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.000805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.03251ms [martini] Started GET /api/lb-check for 10.1.1.81:35656 [martini] Completed 200 OK in 918.104µs [martini] Started GET /api/raft-health for 10.1.1.81:35670 [martini] Completed 200 OK in 681.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.775817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.034905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.137209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.370915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 875.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.17081ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.069118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 989.005µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.829512ms [martini] Started GET /api/raft-follower-health-report/6c6981dd/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 814.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.011018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 977.905µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.984445ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.005422ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.075105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.121909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.863913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 773.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.900008ms [martini] Started GET /api/lb-check for 10.1.1.81:35808 [martini] Completed 200 OK in 823.904µs [martini] Started GET /api/raft-health for 10.1.1.81:35836 [martini] Completed 200 OK in 711.203µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.468515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.012104ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.033409ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.257319ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 905.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.15921ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.011932ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.850413ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22781ms 2018-11-29 05:41:05 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/1a643e28/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 774.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.486816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 842.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.035218ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.866917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.506006ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25501ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.238615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.963109ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.14691ms [martini] Started GET /api/lb-check for 10.1.1.81:35960 [martini] Completed 200 OK in 813.904µs [martini] Started GET /api/raft-health for 10.1.1.81:35970 [martini] Completed 200 OK in 887.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.624221ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.061705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18971ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.806117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 968.705µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.33011ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.317524ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 793.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.845408ms 2018-11-29 05:41:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/918e8b1e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 892.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.880722ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.035514ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.909117ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.614316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 883.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.925909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.276715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 877.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20671ms [martini] Started GET /api/lb-check for 10.1.1.81:36106 [martini] Completed 200 OK in 665.203µs [martini] Started GET /api/raft-health for 10.1.1.81:36122 [martini] Completed 200 OK in 805.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.35832ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 895.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.002609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.482915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.737312ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.753813ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.762031ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 791.203µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.758308ms [martini] Started GET /api/raft-follower-health-report/f629436f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.033504ms 2018-11-29 05:41:29 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.160546ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.247405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.570911ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.983513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 840.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.907108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.920313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 890.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.369829ms [martini] Started GET /api/lb-check for 10.1.1.81:36256 [martini] Completed 200 OK in 729.603µs [martini] Started GET /api/raft-health for 10.1.1.81:36268 [martini] Completed 200 OK in 1.235706ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.53652ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 924.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.461111ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.873031ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 789.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.897309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.20355ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.012604ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.017709ms [martini] Started GET /api/raft-follower-health-report/1feb05e5/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.151405ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.646917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 839.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.821817ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.733626ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 986.605µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.971309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.705348ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.12161ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.732617ms [martini] Started GET /api/lb-check for 10.1.1.81:36392 [martini] Completed 200 OK in 985.605µs [martini] Started GET /api/raft-health for 10.1.1.81:36418 [martini] Completed 200 OK in 679.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.974918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.162605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.057018ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.55252ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 876.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.841908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.115114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 809.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18361ms 2018-11-29 05:41:47 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/a3b60c9d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 671.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.403116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.008204ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.366516ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.973518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 994.305µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.827209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.053823ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.587607ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.067909ms [martini] Started GET /api/lb-check for 10.1.1.81:36540 [martini] Completed 200 OK in 745.603µs [martini] Started GET /api/raft-health for 10.1.1.81:36558 [martini] Completed 200 OK in 710.403µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.470216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.006105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.037609ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.174714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 749.103µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.024609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.249815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 881.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.742508ms [martini] Started GET /api/raft-follower-health-report/e30b98b2/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.163306ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.927717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.409311ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.699912ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.342824ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.191205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22841ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.824517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 868.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.018709ms [martini] Started GET /api/lb-check for 10.1.1.81:36690 [martini] Completed 200 OK in 939.204µs [martini] Started GET /api/raft-health for 10.1.1.81:36702 [martini] Completed 200 OK in 1.053605ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.275429ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.072605ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.033809ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.777917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 971.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.678712ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.650816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.096005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.076809ms 2018-11-29 05:42:05 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/54f09f57/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 845.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.993818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.835113ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28751ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.719517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.230019ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.992509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.054923ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.087009ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.990508ms [martini] Started GET /api/lb-check for 10.1.1.81:36830 [martini] Completed 200 OK in 966.405µs [martini] Started GET /api/raft-health for 10.1.1.81:36842 [martini] Completed 200 OK in 730.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.952817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.078305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.972009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.134715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 994.105µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.554912ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.113314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 847.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.147314ms 2018-11-29 05:42:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/b3fa3c42/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 973.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.659516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.876713ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.628212ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.199619ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 962.905µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.893909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.256815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 999.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.040309ms [martini] Started GET /api/lb-check for 10.1.1.81:36982 [martini] Completed 200 OK in 720.704µs [martini] Started GET /api/raft-health for 10.1.1.81:37012 [martini] Completed 200 OK in 876.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.952418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.332506ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.907409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.260415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 859.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.761208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.050714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.001605ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.090509ms [martini] Started GET /api/raft-follower-health-report/8635cb89/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 903.804µs 2018-11-29 05:42:29 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.400346ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.599612ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.948518ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.973022ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.237105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.907508ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.329015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.009004ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.957209ms [martini] Started GET /api/lb-check for 10.1.1.81:37138 [martini] Completed 200 OK in 1.854708ms [martini] Started GET /api/raft-health for 10.1.1.81:37148 [martini] Completed 200 OK in 730.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.306015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 920.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.039609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.565525ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 872.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.883627ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.398215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.001204ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21171ms [martini] Started GET /api/raft-follower-health-report/6ce01518/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 901.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.424516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.412011ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.493911ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.736821ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.145705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.012209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.749121ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.057505ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.350315ms [martini] Started GET /api/lb-check for 10.1.1.81:37280 [martini] Completed 200 OK in 725.203µs [martini] Started GET /api/raft-health for 10.1.1.81:37292 [martini] Completed 200 OK in 890.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.022127ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 856.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29251ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.810218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.038805ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.989308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.208515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 772.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.755508ms [martini] Started GET /api/raft-follower-health-report/d238ca0a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.044305ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.544725ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.141605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25031ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.649316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 973.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.12641ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.345415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 951.605µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.069109ms [martini] Started GET /api/lb-check for 10.1.1.81:37414 [martini] Completed 200 OK in 981.004µs [martini] Started GET /api/raft-health for 10.1.1.81:37442 [martini] Completed 200 OK in 604.402µs 2018-11-29 05:42:53 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.672335ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.491506ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.984009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.379515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 941.705µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.010109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.978214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.029705ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.990709ms [martini] Started GET /api/raft-follower-health-report/503e9092/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 752.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.438625ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 879.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.604211ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.994222ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 958.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.946927ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.314415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 963.705µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23071ms [martini] Started GET /api/lb-check for 10.1.1.81:37556 [martini] Completed 200 OK in 726.304µs [martini] Started GET /api/raft-health for 10.1.1.81:37582 [martini] Completed 200 OK in 684.604µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.635016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 941.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.051309ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.300128ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 866.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.049309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.643821ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.140506ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.124119ms [martini] Started GET /api/raft-follower-health-report/447b4ba3/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 896.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.434825ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.684708ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.24361ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.987227ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.029405ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.977209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.318115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 852.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.043509ms [martini] Started GET /api/lb-check for 10.1.1.81:37714 [martini] Completed 200 OK in 621.903µs [martini] Started GET /api/raft-health for 10.1.1.81:37726 [martini] Completed 200 OK in 1.010904ms 2018-11-29 05:43:11 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.491716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.024805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.844908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.000027ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.012005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.791112ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.290215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 929.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.945109ms 2018-11-29 05:43:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/f2b60050/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 927.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.161633ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.472706ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.273915ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.605816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 822.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.794808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.178414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 850.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.958509ms [martini] Started GET /api/lb-check for 10.1.1.81:37866 [martini] Completed 200 OK in 804.604µs [martini] Started GET /api/raft-health for 10.1.1.81:37884 [martini] Completed 200 OK in 679.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.595816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.068305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.734217ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.663317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 815.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.574725ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.361115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 992.405µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.128009ms [martini] Started GET /api/raft-follower-health-report/eff936c5/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 816.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.184528ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.552207ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.089527ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.257315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 992.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.008809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.949213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 921.005µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.525234ms [martini] Started GET /api/lb-check for 10.1.1.81:38008 [martini] Completed 200 OK in 629.203µs [martini] Started GET /api/raft-health for 10.1.1.81:38034 [martini] Completed 200 OK in 714.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.548316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 940.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.924109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.055118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 957.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.438511ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.47752ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.135805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25951ms 2018-11-29 05:43:35 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/62594516/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 763.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.579229ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.194306ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.606512ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.567316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 955.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.987708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.283915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 888.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.482712ms [martini] Started GET /api/lb-check for 10.1.1.81:38166 [martini] Completed 200 OK in 694.203µs [martini] Started GET /api/raft-health for 10.1.1.81:38176 [martini] Completed 200 OK in 709.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.572325ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.117805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.71233ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.531316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 978.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.427311ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.158514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.513006ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.065209ms [martini] Started GET /api/raft-follower-health-report/f82a0275/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 757.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.367324ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.196905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.504111ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.191314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 881.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.310815ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.61082ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 914.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.798908ms [martini] Started GET /api/lb-check for 10.1.1.81:38296 [martini] Completed 200 OK in 962.004µs [martini] Started GET /api/raft-health for 10.1.1.81:38312 [martini] Completed 200 OK in 659.103µs 2018-11-29 05:43:53 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.63622ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.016405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.969208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.473916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.148805ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.066709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.202414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 910.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.085609ms [martini] Started GET /api/raft-follower-health-report/da0f533e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.012204ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.241432ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.585907ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.342811ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.647916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 944.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.831308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.268015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 822.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.953009ms [martini] Started GET /api/lb-check for 10.1.1.81:38436 [martini] Completed 200 OK in 840.803µs [martini] Started GET /api/raft-health for 10.1.1.81:38450 [martini] Completed 200 OK in 800.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.564816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 881.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.14881ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.574029ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 956.305µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.819408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.128414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 909.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.079709ms [martini] Started GET /api/raft-follower-health-report/59b3d9d0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 925.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.709721ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.685707ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.740349ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.359624ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.044104ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.017309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.344424ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 960.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.449515ms [martini] Started GET /api/lb-check for 10.1.1.81:38580 [martini] Completed 200 OK in 914.605µs [martini] Started GET /api/raft-health for 10.1.1.81:38608 [martini] Completed 200 OK in 901.604µs 2018-11-29 05:44:11 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.944718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.015505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.723312ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.995326ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 820.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.961414ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.081114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.050204ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.824208ms 2018-11-29 05:44:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/ff0f2196/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 692.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.287324ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.821712ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.068609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.715617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 890.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.875708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.287314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 779.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.046409ms [martini] Started GET /api/lb-check for 10.1.1.81:38742 [martini] Completed 200 OK in 2.443511ms [martini] Started GET /api/raft-health for 10.1.1.81:38762 [martini] Completed 200 OK in 860.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.732517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 990.805µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.941509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.435015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 921.705µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.172123ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.115114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.025904ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.976909ms [martini] Started GET /api/raft-follower-health-report/f87a703d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 686.703µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.322824ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.024505ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.034013ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.968518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 966.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.430311ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.48222ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 921.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.999909ms [martini] Started GET /api/lb-check for 10.1.1.81:38882 [martini] Completed 200 OK in 779.604µs [martini] Started GET /api/raft-health for 10.1.1.81:38898 [martini] Completed 200 OK in 876.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.819022ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 985.805µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.811512ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 16.618175ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.873908ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.13321ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.941217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 933.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.887208ms 2018-11-29 05:44:35 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/993b260b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 752.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.290946ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 888.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31501ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.754517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 836.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.037209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.818639ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.068019ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.258719ms [martini] Started GET /api/lb-check for 10.1.1.81:39022 [martini] Completed 200 OK in 633.603µs [martini] Started GET /api/raft-health for 10.1.1.81:39036 [martini] Completed 200 OK in 655.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.765117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.150905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.923008ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.704817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.668607ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.149009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.329615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 973.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19301ms [martini] Started GET /api/raft-follower-health-report/7e354f2a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 814.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.618734ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.152705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.875109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.214318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.638511ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.079209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.209914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 964.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.961308ms [martini] Started GET /api/lb-check for 10.1.1.81:39158 [martini] Completed 200 OK in 779.204µs [martini] Started GET /api/raft-health for 10.1.1.81:39192 [martini] Completed 200 OK in 758.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.791217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.246906ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.370111ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.481715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 886.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.03201ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.220114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 892.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.054709ms [martini] Started GET /api/raft-follower-health-report/543ee61e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 868.204µs 2018-11-29 05:44:59 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.40102ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 950.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.616225ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.170219ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 990.105µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.977709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.001413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 939.505µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23651ms [martini] Started GET /api/lb-check for 10.1.1.81:39310 [martini] Completed 200 OK in 685.403µs [martini] Started GET /api/raft-health for 10.1.1.81:39328 [martini] Completed 200 OK in 779.304µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.094619ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.099105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.30241ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.266737ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.426506ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.06421ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.461024ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.645712ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.070809ms [martini] Started GET /api/raft-follower-health-report/bf69b0be/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 772.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.389624ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.302406ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.886913ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.695116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.220105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.079009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.846431ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.768408ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.106618ms [martini] Started GET /api/lb-check for 10.1.1.81:39452 [martini] Completed 200 OK in 682.303µs [martini] Started GET /api/raft-health for 10.1.1.81:39468 [martini] Completed 200 OK in 931.404µs 2018-11-29 05:45:11 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.120518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.048305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.13781ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.153514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 809.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.10411ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.500916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.061104ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.934808ms 2018-11-29 05:45:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/2fd2f719/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 777.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.848335ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 947.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.395211ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.319515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 931.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.909809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.193914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 952.905µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.115709ms [martini] Started GET /api/lb-check for 10.1.1.81:39602 [martini] Completed 200 OK in 811.003µs [martini] Started GET /api/raft-health for 10.1.1.81:39622 [martini] Completed 200 OK in 886.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.516015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 966.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.072509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.753517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.114105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.201009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.973713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 808.703µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.922308ms [martini] Started GET /api/raft-follower-health-report/db2dc204/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 922.004µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.926931ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 984.805µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.04621ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.723421ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.058604ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.973908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.663716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.49512ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.199619ms [martini] Started GET /api/lb-check for 10.1.1.81:39740 [martini] Completed 200 OK in 764.204µs [martini] Started GET /api/raft-health for 10.1.1.81:39770 [martini] Completed 200 OK in 727.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.883017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.101305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.602212ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.283528ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 864.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.988209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.772917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 772.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.24811ms [martini] Started GET /api/raft-follower-health-report/d123b52c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 2.925413ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.235019ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.706608ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.439211ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.362951ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.973518ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.720312ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.526216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 978.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.024709ms [martini] Started GET /api/lb-check for 10.1.1.81:39906 [martini] Completed 200 OK in 738.004µs [martini] Started GET /api/raft-health for 10.1.1.81:39924 [martini] Completed 200 OK in 1.061905ms 2018-11-29 05:45:41 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.907217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 982.505µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 13.011758ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.032014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 897.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.918909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.451115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 753.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.209109ms [martini] Started GET /api/raft-follower-health-report/b76ad868/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 839.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.582221ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.092605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.353211ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.565416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 857.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.991709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.315428ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 909.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.13711ms [martini] Started GET /api/lb-check for 10.1.1.81:40052 [martini] Completed 200 OK in 910.604µs [martini] Started GET /api/raft-health for 10.1.1.81:40072 [martini] Completed 200 OK in 835.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.419819ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 941.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.892308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.301615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 916.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.951709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.252914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 960.005µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.864808ms [martini] Started GET /api/raft-follower-health-report/16d3ac15/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 787.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.250619ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.118805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.39001ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.610816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.083805ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.06491ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.197514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 957.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.018509ms [martini] Started GET /api/lb-check for 10.1.1.81:40200 [martini] Completed 200 OK in 781.103µs [martini] Started GET /api/raft-health for 10.1.1.81:40230 [martini] Completed 200 OK in 1.104905ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.458515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.083105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.038609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.401315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 879.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.160809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.918118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 965.605µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23241ms 2018-11-29 05:46:05 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/46ef658d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 895.804µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.920922ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.333406ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.49022ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.242423ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.076405ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18771ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.545038ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 826.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.686607ms [martini] Started GET /api/lb-check for 10.1.1.81:40358 [martini] Completed 200 OK in 642.303µs [martini] Started GET /api/raft-health for 10.1.1.81:40388 [martini] Completed 200 OK in 701.003µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.059618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 977.305µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.24191ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.011917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 902.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.991623ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.336715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 973.805µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.934809ms 2018-11-29 05:46:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 05:46:17 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/37980a1d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 670.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.275537ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.003004ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25991ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.527716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.679207ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.05271ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.153814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 886.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.322811ms [martini] Started GET /api/lb-check for 10.1.1.81:40522 [martini] Completed 200 OK in 2.668212ms [martini] Started GET /api/raft-health for 10.1.1.81:40542 [martini] Completed 200 OK in 681.303µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.668616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.260705ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.969209ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.205514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 842.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.882513ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.508316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 871.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.814308ms [martini] Started GET /api/raft-follower-health-report/f4583870/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 754.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.584539ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.144405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.395311ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.292914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 923.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.17931ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.231414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.000405ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.12011ms [martini] Started GET /api/lb-check for 10.1.1.81:40660 [martini] Completed 200 OK in 795.604µs [martini] Started GET /api/raft-health for 10.1.1.81:40674 [martini] Completed 200 OK in 775.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.695917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.315605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.882813ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.614352ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.035705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.056109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.464224ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 990.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.503811ms [martini] Started GET /api/raft-follower-health-report/e42eb601/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 723.804µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.118918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.890808ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.294411ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.382719ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.053105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23721ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.216641ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.632408ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.060209ms [martini] Started GET /api/lb-check for 10.1.1.81:40806 [martini] Completed 200 OK in 675.203µs [martini] Started GET /api/raft-health for 10.1.1.81:40836 [martini] Completed 200 OK in 751.003µs 2018-11-29 05:46:41 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.164532ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 917.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.12001ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.724317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 845.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.883009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.132014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 943.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.895209ms [martini] Started GET /api/raft-follower-health-report/b055c1d7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 675.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.597616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.038405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.767413ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.243914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.033104ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.822308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.206014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 963.005µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.191109ms [martini] Started GET /api/lb-check for 10.1.1.81:40954 [martini] Completed 200 OK in 973.604µs [martini] Started GET /api/raft-health for 10.1.1.81:40974 [martini] Completed 200 OK in 913.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.608616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.365206ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.826012ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.222814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 872.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22661ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.309915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 969.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.087209ms [martini] Started GET /api/raft-follower-health-report/b3d40f62/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 944.704µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.001718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.263306ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.358937ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.140523ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 940.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.945609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.592216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 920.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.918308ms [martini] Started GET /api/lb-check for 10.1.1.81:41094 [martini] Completed 200 OK in 662.003µs [martini] Started GET /api/raft-health for 10.1.1.81:41112 [martini] Completed 200 OK in 893.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.669516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.156505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21911ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.681916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 888.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.13031ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.040332ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.085118ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.755913ms 2018-11-29 05:47:05 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/71ed3043/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.041905ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.092322ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 964.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.101214ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.857526ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.031205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.001108ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.485125ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 5.137423ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.155609ms [martini] Started GET /api/lb-check for 10.1.1.81:41238 [martini] Completed 200 OK in 867.804µs [martini] Started GET /api/raft-health for 10.1.1.81:41252 [martini] Completed 200 OK in 834.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.472629ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.038405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.280019ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.912618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.004905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.130409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.356437ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 816.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.618007ms 2018-11-29 05:47:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 05:47:17 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/4415aa56/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 903.604µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.484629ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.029014ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.086009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.088613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 752.203µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.088509ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.751016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 890.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.811308ms [martini] Started GET /api/lb-check for 10.1.1.81:41390 [martini] Completed 200 OK in 589.303µs [martini] Started GET /api/raft-health for 10.1.1.81:41424 [martini] Completed 200 OK in 798.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.935317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.270506ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.096409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.992817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.391307ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.917708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.281314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 849.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.793108ms [martini] Started GET /api/raft-follower-health-report/f5d7c272/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 653.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.094627ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.102105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.33881ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.385315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.035605ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.720808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.070613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.761717ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.936709ms [martini] Started GET /api/lb-check for 10.1.1.81:41544 [martini] Completed 200 OK in 681.603µs [martini] Started GET /api/raft-health for 10.1.1.81:41558 [martini] Completed 200 OK in 628.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.467715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 920.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.971709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.821521ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 856.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.973309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.43652ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 974.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.091309ms [martini] Started GET /api/raft-follower-health-report/5581fc78/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 939.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.910618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 960.005µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.153709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.154823ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.051105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.869109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.951917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.085805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.795208ms [martini] Started GET /api/lb-check for 10.1.1.81:41688 [martini] Completed 200 OK in 1.158505ms [martini] Started GET /api/raft-health for 10.1.1.81:41702 [martini] Completed 200 OK in 2.44851ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.130823ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.552707ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.023809ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.185514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 790.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.001209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.764417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 926.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.027109ms 2018-11-29 05:47:47 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/f15bfa19/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.090605ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.234619ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 920.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.966909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.420015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 852.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.965527ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.188814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 896.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.934809ms [martini] Started GET /api/lb-check for 10.1.1.81:41824 [martini] Completed 200 OK in 661.203µs [martini] Started GET /api/raft-health for 10.1.1.81:41844 [martini] Completed 200 OK in 709.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.397119ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.046605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.397611ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.291614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 874.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.043109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.215815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.085204ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.867508ms [martini] Started GET /api/raft-follower-health-report/fc268fef/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 912.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.648116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.082404ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.579011ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.454516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 916.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.921608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.152714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 927.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.06841ms [martini] Started GET /api/lb-check for 10.1.1.81:41966 [martini] Completed 200 OK in 852.804µs [martini] Started GET /api/raft-health for 10.1.1.81:41998 [martini] Completed 200 OK in 762.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.102018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 909.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.971009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.949722ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.042604ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.092609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.804626ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.116505ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.741012ms [martini] Started GET /api/raft-follower-health-report/68e63bb6/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 762.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.567425ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.819608ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.733339ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 15.893871ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 977.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.15931ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.297336ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.829322ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.398115ms [martini] Started GET /api/lb-check for 10.1.1.81:42122 [martini] Completed 200 OK in 1.075105ms [martini] Started GET /api/raft-health for 10.1.1.81:42138 [martini] Completed 200 OK in 802.803µs 2018-11-29 05:48:11 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.852617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 977.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.122509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.529316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.054904ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.492916ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.635716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 912.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.923509ms 2018-11-29 05:48:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 05:48:17 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/092d04cb/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 739.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.940417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 891.403µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.004013ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.904817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 876.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.025909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.092314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 876.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.886608ms [martini] Started GET /api/lb-check for 10.1.1.81:42274 [martini] Completed 200 OK in 2.717712ms [martini] Started GET /api/raft-health for 10.1.1.81:42294 [martini] Completed 200 OK in 797.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.862217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.020705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.15691ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.380915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.000205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.977408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.027714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 820.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.064709ms [martini] Started GET /api/raft-follower-health-report/08d8083b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 867.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.508625ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.387206ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.197009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.520516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.002004ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18891ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.221015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 976.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.018209ms [martini] Started GET /api/lb-check for 10.1.1.81:42416 [martini] Completed 200 OK in 730.004µs [martini] Started GET /api/raft-health for 10.1.1.81:42432 [martini] Completed 200 OK in 901.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.321314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 872.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.770108ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 13.132858ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.200605ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22621ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.266623ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.340906ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.650012ms [martini] Started GET /api/raft-follower-health-report/3f73a05c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 761.703µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.522916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 894.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.15321ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.192414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 873.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.898409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.584916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.233119ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.693216ms [martini] Started GET /api/lb-check for 10.1.1.81:42560 [martini] Completed 200 OK in 706.803µs [martini] Started GET /api/raft-health for 10.1.1.81:42594 [martini] Completed 200 OK in 1.050705ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.786817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.091305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26081ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.262615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 981.905µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.13501ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.617217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 871.103µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.927609ms [martini] Started GET /api/raft-follower-health-report/fad8f3de/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 693.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.980418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 939.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.908713ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.200114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 909.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.830308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.563315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 864.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.991509ms [martini] Started GET /api/lb-check for 10.1.1.81:42720 [martini] Completed 200 OK in 783.403µs [martini] Started GET /api/raft-health for 10.1.1.81:42740 [martini] Completed 200 OK in 810.903µs 2018-11-29 05:48:53 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.784026ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21671ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.997309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.481315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 887.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.818508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.006713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 840.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.841108ms [martini] Started GET /api/raft-follower-health-report/f6517a59/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 703.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.528315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 872.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.24941ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.243215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 840.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.399428ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.224615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 842.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.939609ms [martini] Started GET /api/lb-check for 10.1.1.81:42862 [martini] Completed 200 OK in 764.803µs [martini] Started GET /api/raft-health for 10.1.1.81:42878 [martini] Completed 200 OK in 856.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.766817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.098505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.291011ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.73153ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 876.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.999909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.472315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 787.803µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.475411ms [martini] Started GET /api/raft-follower-health-report/62ebdfec/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 793.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.433215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.185205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.053909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.685443ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.059605ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.224309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.449746ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 972.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.934809ms [martini] Started GET /api/lb-check for 10.1.1.81:42998 [martini] Completed 200 OK in 615.502µs [martini] Started GET /api/raft-health for 10.1.1.81:43030 [martini] Completed 200 OK in 894.404µs 2018-11-29 05:49:11 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.554015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 940.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.09591ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.288315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.231005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.451638ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.258414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 932.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.893908ms 2018-11-29 05:49:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/f9ec46b6/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.229905ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.016118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.260419ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29471ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.622816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 879.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.014608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.528515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 985.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.09401ms [martini] Started GET /api/lb-check for 10.1.1.81:43158 [martini] Completed 200 OK in 912.305µs [martini] Started GET /api/raft-health for 10.1.1.81:43190 [martini] Completed 200 OK in 686.503µs 2018-11-29 05:49:23 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.836917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.183405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19721ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.362415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.238206ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.368524ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.055514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 956.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.142709ms [martini] Started GET /api/raft-follower-health-report/f40a6a39/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 759.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.32502ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 862.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.12951ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.902617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 850.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.36111ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.958013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.012805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.003249ms [martini] Started GET /api/lb-check for 10.1.1.81:43314 [martini] Completed 200 OK in 1.052905ms [martini] Started GET /api/raft-health for 10.1.1.81:43328 [martini] Completed 200 OK in 921.804µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.541433ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 932.705µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.150909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.340124ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.388206ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.800408ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.42112ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 954.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.494011ms [martini] Started GET /api/raft-follower-health-report/3078a99c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 914.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.310615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.160405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.977209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.500024ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.063705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.052709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.333415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 869.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.993309ms [martini] Started GET /api/lb-check for 10.1.1.81:43456 [martini] Completed 200 OK in 740.903µs [martini] Started GET /api/raft-health for 10.1.1.81:43472 [martini] Completed 200 OK in 783.003µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.453024ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.616707ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.716417ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.338419ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 982.405µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.36521ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.164514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 840.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.764408ms [martini] Started GET /api/raft-follower-health-report/824bab0c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 754.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.868222ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 846.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31731ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.034913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 970.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.048809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.652925ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.477406ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.807108ms [martini] Started GET /api/lb-check for 10.1.1.81:43600 [martini] Completed 200 OK in 886.704µs [martini] Started GET /api/raft-health for 10.1.1.81:43632 [martini] Completed 200 OK in 629.203µs 2018-11-29 05:49:53 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.026118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.055805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.517411ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.335615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 740.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.06371ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.437615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 985.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.948908ms [martini] Started GET /api/raft-follower-health-report/12afd3f0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 843.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.585216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 756.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.019209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.064518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 970.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.025809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.750516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 912.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.824608ms [martini] Started GET /api/lb-check for 10.1.1.81:43762 [martini] Completed 200 OK in 665.903µs [martini] Started GET /api/raft-health for 10.1.1.81:43776 [martini] Completed 200 OK in 987.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.562551ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.157205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.102036ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.75553ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.184206ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.108509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.391728ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.632107ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.998609ms [martini] Started GET /api/raft-follower-health-report/2d974946/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 834.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.589516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 890.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21211ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.308219ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.842517ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.835708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.179714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 827.903µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.992613ms [martini] Started GET /api/lb-check for 10.1.1.81:43904 [martini] Completed 200 OK in 685.403µs [martini] Started GET /api/raft-health for 10.1.1.81:43918 [martini] Completed 200 OK in 1.076805ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.891118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.101605ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.12911ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.143614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.084205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.939109ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.390415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.160509ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.833708ms 2018-11-29 05:50:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 05:50:17 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/77756501/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 851.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.523215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 888.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21701ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.660616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 954.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.001409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.070913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.222406ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.863408ms [martini] Started GET /api/lb-check for 10.1.1.81:44056 [martini] Completed 200 OK in 785.903µs [martini] Started GET /api/raft-health for 10.1.1.81:44074 [martini] Completed 200 OK in 828.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.666617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.132505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.157009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.217614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 852.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.599412ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.889213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 791.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28041ms [martini] Started GET /api/raft-follower-health-report/a3198715/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 815.204µs 2018-11-29 05:50:29 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 14.868366ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.054109ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.988113ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.41682ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 856.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.854008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.012114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.539007ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.917008ms [martini] Started GET /api/lb-check for 10.1.1.81:44200 [martini] Completed 200 OK in 686.203µs [martini] Started GET /api/raft-health for 10.1.1.81:44228 [martini] Completed 200 OK in 678.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.510016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.127305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20481ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.942644ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.257205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.351711ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.569229ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 844.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.906009ms [martini] Started GET /api/raft-follower-health-report/92600492/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 696.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.499415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.043705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.979408ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.127527ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.355706ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.33421ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.670116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.215506ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.659925ms [martini] Started GET /api/lb-check for 10.1.1.81:44350 [martini] Completed 200 OK in 848.604µs [martini] Started GET /api/raft-health for 10.1.1.81:44366 [martini] Completed 200 OK in 1.021504ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.64742ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.120905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.33651ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.503615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 989.905µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.099509ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.116714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 863.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.000009ms [martini] Started GET /api/raft-follower-health-report/d83a1c78/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 706.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.427715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.364206ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29931ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.313119ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.020205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.643112ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.459216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.035705ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.394911ms [martini] Started GET /api/lb-check for 10.1.1.81:44494 [martini] Completed 200 OK in 771.803µs [martini] Started GET /api/raft-health for 10.1.1.81:44512 [martini] Completed 200 OK in 814.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.505738ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.145605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.610411ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.55982ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 836.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.976809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.650716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 909.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.989109ms [martini] Started GET /api/raft-follower-health-report/fdc4d90d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.019005ms 2018-11-29 05:50:59 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.966318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 904.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.047309ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.53762ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 6.185828ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.30001ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.793217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 772.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.053509ms [martini] Started GET /api/lb-check for 10.1.1.81:44644 [martini] Completed 200 OK in 631.303µs [martini] Started GET /api/raft-health for 10.1.1.81:44658 [martini] Completed 200 OK in 912.605µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.679416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 808.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.156009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.157814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 820.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.938409ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.908926ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 885.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.083831ms [martini] Started GET /api/raft-follower-health-report/20de8e0e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 983.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.350615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 904.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.017809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.070023ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.126805ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31341ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.992918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.015505ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.262614ms [martini] Started GET /api/lb-check for 10.1.1.81:44780 [martini] Completed 200 OK in 790.903µs [martini] Started GET /api/raft-health for 10.1.1.81:44810 [martini] Completed 200 OK in 889.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.44662ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 843.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.461411ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.268915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 897.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25901ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.429316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 740.703µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.958109ms 2018-11-29 05:51:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/9f6b1210/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 816.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.132723ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.592707ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.046509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.009113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 890.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.907209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.706517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 946.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23231ms [martini] Started GET /api/lb-check for 10.1.1.81:44956 [martini] Completed 200 OK in 740.003µs [martini] Started GET /api/raft-health for 10.1.1.81:44974 [martini] Completed 200 OK in 1.436306ms 2018-11-29 05:51:23 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.324524ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.291406ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.026009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.376715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.775713ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.120413ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.961917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.391306ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.843313ms [martini] Started GET /api/raft-follower-health-report/cbd4ba41/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 650.503µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.566016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 822.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.060209ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.130014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.155105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.034114ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.871317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.027104ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.443038ms [martini] Started GET /api/lb-check for 10.1.1.81:45098 [martini] Completed 200 OK in 790.503µs [martini] Started GET /api/raft-health for 10.1.1.81:45114 [martini] Completed 200 OK in 802.803µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.801017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.108405ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31751ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.242319ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 799.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.211109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.992336ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 979.005µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.139009ms 2018-11-29 05:51:35 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/d998307c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 889.404µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.711616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.076504ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.001809ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.394319ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 891.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.941609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.404028ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 969.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.987309ms [martini] Started GET /api/lb-check for 10.1.1.81:45246 [martini] Completed 200 OK in 753.504µs [martini] Started GET /api/raft-health for 10.1.1.81:45262 [martini] Completed 200 OK in 1.014304ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.183818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.979408ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.295023ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.305323ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 744.703µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.870608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.952913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 915.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.893609ms [martini] Started GET /api/raft-follower-health-report/b7c4769e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 684.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.391323ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.050105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18421ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.133814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 853.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.103909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.072018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 964.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.872508ms [martini] Started GET /api/lb-check for 10.1.1.81:45382 [martini] Completed 200 OK in 643.903µs [martini] Started GET /api/raft-health for 10.1.1.81:45416 [martini] Completed 200 OK in 734.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.665016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 826.603µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18431ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.191214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.027504ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.102909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.123514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 790.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.070509ms [martini] Started GET /api/raft-follower-health-report/4405cc52/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 742.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.714017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.089805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.041609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.219814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.087105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.016808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.933613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 923.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.922208ms [martini] Started GET /api/lb-check for 10.1.1.81:45542 [martini] Completed 200 OK in 940.804µs [martini] Started GET /api/raft-health for 10.1.1.81:45560 [martini] Completed 200 OK in 650.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.352637ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 923.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.806312ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.959744ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.581807ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.115909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.948421ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 888.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.040509ms 2018-11-29 05:52:05 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/d8de856a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 742.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.432216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 990.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.963609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 21.929397ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.281905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.14501ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.767721ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.087405ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.180314ms [martini] Started GET /api/lb-check for 10.1.1.81:45682 [martini] Completed 200 OK in 628.203µs [martini] Started GET /api/raft-health for 10.1.1.81:45696 [martini] Completed 200 OK in 881.104µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.50022ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 984.805µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.167509ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.752234ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.056105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.010309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.591429ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 7.980435ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.235323ms 2018-11-29 05:52:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/07c8cab4/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 891.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.473415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.069205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.887508ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.411615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 984.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.075309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.024913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 943.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.801208ms [martini] Started GET /api/lb-check for 10.1.1.81:45832 [martini] Completed 200 OK in 844.504µs [martini] Started GET /api/raft-health for 10.1.1.81:45868 [martini] Completed 200 OK in 2.990713ms 2018-11-29 05:52:23 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.807517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 994.505µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.151718ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.474115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 943.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.000009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.273814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 871.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.013909ms [martini] Started GET /api/raft-follower-health-report/d93e2359/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 820.403µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.658743ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.877117ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.185909ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.447515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 927.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.931409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.897517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.025205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28181ms [martini] Started GET /api/lb-check for 10.1.1.81:45976 [martini] Completed 200 OK in 772.903µs [martini] Started GET /api/raft-health for 10.1.1.81:46008 [martini] Completed 200 OK in 780.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.896218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.002605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.005709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.502415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 811.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.203518ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.957813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 876.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.997809ms 2018-11-29 05:52:35 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/da6773d8/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 702.403µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.631116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 928.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.945008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.713921ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 746.803µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.027809ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.041644ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.107105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.078009ms [martini] Started GET /api/lb-check for 10.1.1.81:46132 [martini] Completed 200 OK in 1.037904ms [martini] Started GET /api/raft-health for 10.1.1.81:46148 [martini] Completed 200 OK in 892.804µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.030418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 980.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.108409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.428115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.087405ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.283611ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.265814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 836.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.538916ms [martini] Started GET /api/raft-follower-health-report/4849d879/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.028704ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.47682ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 910.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25981ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.235714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 970.505µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.900408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.953813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 947.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.040609ms [martini] Started GET /api/lb-check for 10.1.1.81:46270 [martini] Completed 200 OK in 737.004µs [martini] Started GET /api/raft-health for 10.1.1.81:46290 [martini] Completed 200 OK in 857.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.494016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.048705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.228214ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.51802ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 951.505µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.972008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.991713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 910.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.658121ms [martini] Started GET /api/raft-follower-health-report/27741b14/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 900.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.576416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.183406ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.076309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.377415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 956.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.168009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.847421ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.544907ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.846308ms [martini] Started GET /api/lb-check for 10.1.1.81:46414 [martini] Completed 200 OK in 994.304µs [martini] Started GET /api/raft-health for 10.1.1.81:46446 [martini] Completed 200 OK in 853.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.816517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 976.005µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.982909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.465816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.225205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.011313ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.958722ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.131405ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.817012ms [martini] Started GET /api/raft-follower-health-report/9edaef8f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 755.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.383724ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.343706ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.965313ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.552415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.221506ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.043009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.082222ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.166005ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.176309ms [martini] Started GET /api/lb-check for 10.1.1.81:46568 [martini] Completed 200 OK in 853.804µs [martini] Started GET /api/raft-health for 10.1.1.81:46582 [martini] Completed 200 OK in 1.044405ms 2018-11-29 05:53:11 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.83493ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.007109ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.033709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.208714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 895.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.667711ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.350123ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.287705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.980713ms 2018-11-29 05:53:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/d534dd3f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 846.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.457715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.002404ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.073809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.247415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.847712ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.458411ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.921913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 870.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.888308ms [martini] Started GET /api/lb-check for 10.1.1.81:46716 [martini] Completed 200 OK in 575.603µs [martini] Started GET /api/raft-health for 10.1.1.81:46736 [martini] Completed 200 OK in 665.003µs 2018-11-29 05:53:23 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.639116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 843.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.065109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.952317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 959.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.786308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.059713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.556107ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.370511ms [martini] Started GET /api/raft-follower-health-report/cf80ad85/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.069905ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.203119ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.108605ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.33551ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.153514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.359206ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.846413ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.67512ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 939.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.052809ms [martini] Started GET /api/lb-check for 10.1.1.81:46862 [martini] Completed 200 OK in 755.004µs [martini] Started GET /api/raft-health for 10.1.1.81:46880 [martini] Completed 200 OK in 692.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.560916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.083005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.587111ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.966426ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 939.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18321ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.382614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 793.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.963209ms 2018-11-29 05:53:35 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/cd178702/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 845.304µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.812117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.195206ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.665734ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.487016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.001404ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.911313ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.544351ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 884.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.953009ms [martini] Started GET /api/lb-check for 10.1.1.81:47004 [martini] Completed 200 OK in 839.203µs [martini] Started GET /api/raft-health for 10.1.1.81:47032 [martini] Completed 200 OK in 800.803µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.034918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.818108ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.125409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.252914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.254606ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.814439ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.308015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 886.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.24041ms [martini] Started GET /api/raft-follower-health-report/5953739e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.875108ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.160718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 991.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.015409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.457815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 986.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.32521ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.453215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.162405ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.386915ms [martini] Started GET /api/lb-check for 10.1.1.81:47156 [martini] Completed 200 OK in 586.503µs [martini] Started GET /api/raft-health for 10.1.1.81:47176 [martini] Completed 200 OK in 694.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.529415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.115205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.164909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.438416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.001005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.133709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.240314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 975.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.041409ms [martini] Started GET /api/raft-follower-health-report/b3e93c4f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 793.703µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.008518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.145505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.065909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.376015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.017505ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.854808ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.988713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 942.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.088809ms [martini] Started GET /api/lb-check for 10.1.1.81:47308 [martini] Completed 200 OK in 674.103µs [martini] Started GET /api/raft-health for 10.1.1.81:47324 [martini] Completed 200 OK in 725.203µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.997918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 955.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.648625ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.502215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 832.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.43471ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.757321ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22761ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.054309ms [martini] Started GET /api/raft-follower-health-report/d202b74c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 890.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.581116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.275306ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.30651ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.911521ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.658307ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.571216ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.194823ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.599116ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.971309ms [martini] Started GET /api/lb-check for 10.1.1.81:47448 [martini] Completed 200 OK in 790.804µs [martini] Started GET /api/raft-health for 10.1.1.81:47464 [martini] Completed 200 OK in 764.103µs 2018-11-29 05:54:11 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.816017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.231205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.986309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.409515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 982.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.33311ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.050313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 889.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.014714ms 2018-11-29 05:54:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/490db9f9/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 750.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.542816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 807.203µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.099609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.045213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 900.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.975209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.996114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 818.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.963008ms [martini] Started GET /api/lb-check for 10.1.1.81:47610 [martini] Completed 200 OK in 643.203µs [martini] Started GET /api/raft-health for 10.1.1.81:47646 [martini] Completed 200 OK in 654.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.645716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.004705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.900508ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.333715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 874.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.848508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.187414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 779.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27721ms [martini] Started GET /api/raft-follower-health-report/90314820/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 802.504µs 2018-11-29 05:54:29 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.557224ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.088605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.865843ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.655717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 861.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.965209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.064714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.101505ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.946908ms [martini] Started GET /api/lb-check for 10.1.1.81:47768 [martini] Completed 200 OK in 666.403µs [martini] Started GET /api/raft-health for 10.1.1.81:47782 [martini] Completed 200 OK in 859.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.358815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.016305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.007909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.277224ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 970.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.081609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 12.206854ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 877.703µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27491ms [martini] Started GET /api/raft-follower-health-report/86e2538f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 672.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.542716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.031704ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.950309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.612124ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.001304ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.455411ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.369232ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.160105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.730516ms [martini] Started GET /api/lb-check for 10.1.1.81:47904 [martini] Completed 200 OK in 1.024005ms [martini] Started GET /api/raft-health for 10.1.1.81:47920 [martini] Completed 200 OK in 675.003µs 2018-11-29 05:54:41 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.522815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 907.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.956009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.309815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 913.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.050809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.146214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 763.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.002209ms [martini] Started GET /api/raft-follower-health-report/19f268af/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.183606ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.558515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 929.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.333919ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.147814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 843.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.859208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.134514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 970.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.965109ms [martini] Started GET /api/lb-check for 10.1.1.81:48040 [martini] Completed 200 OK in 877.704µs [martini] Started GET /api/raft-health for 10.1.1.81:48062 [martini] Completed 200 OK in 719.103µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.584016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 835.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.871317ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.199114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 911.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.902708ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.900812ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 993.705µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.152909ms [martini] Started GET /api/raft-follower-health-report/27fc5dd3/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 745.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.667316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 897.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.070909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.817017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 908.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.113609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.165122ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 789.203µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.068409ms [martini] Started GET /api/lb-check for 10.1.1.81:48184 [martini] Completed 200 OK in 756.304µs [martini] Started GET /api/raft-health for 10.1.1.81:48212 [martini] Completed 200 OK in 699.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.036018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 997.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.108009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.546916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.310805ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.853812ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.391919ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 865.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.885408ms [martini] Started GET /api/raft-follower-health-report/0ff1846f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.418007ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.461015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 865.703µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.898709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.276519ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.508407ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.34461ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 12.007553ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.583107ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.847713ms [martini] Started GET /api/lb-check for 10.1.1.81:48338 [martini] Completed 200 OK in 697.703µs [martini] Started GET /api/raft-health for 10.1.1.81:48352 [martini] Completed 200 OK in 737.004µs 2018-11-29 05:55:11 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.674225ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.365414ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.966909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.132713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.026905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.006109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.382615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 839.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.886408ms 2018-11-29 05:55:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/4459be2c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 775.404µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.386715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 984.505µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22391ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.060414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28771ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.290411ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.022513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 832.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.015909ms [martini] Started GET /api/lb-check for 10.1.1.81:48486 [martini] Completed 200 OK in 819.704µs [martini] Started GET /api/raft-health for 10.1.1.81:48506 [martini] Completed 200 OK in 712.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.38422ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.227105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.079909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.416115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 946.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.35851ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.344215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 905.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.917539ms [martini] Started GET /api/raft-follower-health-report/ddcc9117/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 969.204µs 2018-11-29 05:55:29 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.698825ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.185405ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.167909ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.291515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 983.405µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.613512ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.272014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 981.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.025309ms [martini] Started GET /api/lb-check for 10.1.1.81:48634 [martini] Completed 200 OK in 651.903µs [martini] Started GET /api/raft-health for 10.1.1.81:48666 [martini] Completed 200 OK in 965.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.016418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.190806ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.104109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.609816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.020805ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31381ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.61272ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 914.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.995108ms [martini] Started GET /api/raft-follower-health-report/6d196130/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 745.503µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.666616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.036008ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.621311ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.369615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 929.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.135909ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.528625ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.140205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.035209ms [martini] Started GET /api/lb-check for 10.1.1.81:48778 [martini] Completed 200 OK in 727.003µs [martini] Started GET /api/raft-health for 10.1.1.81:48808 [martini] Completed 200 OK in 746.203µs 2018-11-29 05:55:41 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.143323ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.635507ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.988909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.189314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.067704ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.375515ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.883217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 782.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.872108ms [martini] Started GET /api/raft-follower-health-report/381cf42a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 797.303µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.035118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.002604ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.316311ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.450715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.070505ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.41571ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.386114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.009005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.614716ms [martini] Started GET /api/lb-check for 10.1.1.81:48926 [martini] Completed 200 OK in 906.804µs [martini] Started GET /api/raft-health for 10.1.1.81:48946 [martini] Completed 200 OK in 751.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.506316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 879.703µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26481ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.330515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.620907ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.38171ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.545616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.409906ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26771ms [martini] Started GET /api/raft-follower-health-report/48ed80d8/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.619808ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.726716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.048305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.967809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.712616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.080004ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.068409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.327414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 939.205µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.117009ms [martini] Started GET /api/lb-check for 10.1.1.81:49074 [martini] Completed 200 OK in 785.703µs [martini] Started GET /api/raft-health for 10.1.1.81:49092 [martini] Completed 200 OK in 638.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.275815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 745.903µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.607624ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.653916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 919.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.376811ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.106641ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 943.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20621ms [martini] Started GET /api/raft-follower-health-report/ec74f800/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 852.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.389315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 983.405µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.109609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.325914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.943308ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.522616ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.155018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.801712ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.605415ms [martini] Started GET /api/lb-check for 10.1.1.81:49210 [martini] Completed 200 OK in 661.203µs [martini] Started GET /api/raft-health for 10.1.1.81:49240 [martini] Completed 200 OK in 770.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.611816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 874.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.142409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.122814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 806.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.746108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.892913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 747.803µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.808008ms 2018-11-29 05:56:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 05:56:17 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/4f0b78db/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 663.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.864617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 798.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.158209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.111113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 949.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.989609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.943413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 912.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.887318ms [martini] Started GET /api/lb-check for 10.1.1.81:49374 [martini] Completed 200 OK in 685.303µs [martini] Started GET /api/raft-health for 10.1.1.81:49394 [martini] Completed 200 OK in 838.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.654716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 897.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.925108ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.034514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 853.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.940808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.295615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.045105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.975808ms [martini] Started GET /api/raft-follower-health-report/d427b48e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 742.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.350315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.663112ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.51782ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.472615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 762.003µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.121809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.234419ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.229005ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31021ms [martini] Started GET /api/lb-check for 10.1.1.81:49516 [martini] Completed 200 OK in 720.403µs [martini] Started GET /api/raft-health for 10.1.1.81:49532 [martini] Completed 200 OK in 727.604µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.599316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.105605ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.040609ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.286719ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.369606ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.159409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.330642ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.023704ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.888008ms 2018-11-29 05:56:35 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/a3c776a0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 690.303µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.587715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 816.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.007309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.423215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.034104ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.435011ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.233823ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.132505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.966709ms [martini] Started GET /api/lb-check for 10.1.1.81:49658 [martini] Completed 200 OK in 674.503µs [martini] Started GET /api/raft-health for 10.1.1.81:49672 [martini] Completed 200 OK in 880.104µs 2018-11-29 05:56:41 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.326215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 988.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.816708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.788017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 851.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.969509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.294214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 916.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.007809ms [martini] Started GET /api/raft-follower-health-report/9da3e542/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 2.515011ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.503916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.143505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.095409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.228614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 957.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.085609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.314315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 838.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.769808ms [martini] Started GET /api/lb-check for 10.1.1.81:49790 [martini] Completed 200 OK in 791.703µs [martini] Started GET /api/raft-health for 10.1.1.81:49824 [martini] Completed 200 OK in 660.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 15.121066ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 938.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.139518ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.731421ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 917.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.042209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.831717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 868.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.539611ms [martini] Started GET /api/raft-follower-health-report/5fe7a933/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 896.204µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.53042ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.005605ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.43661ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.315314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 936.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.501811ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.239723ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.025105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.049309ms [martini] Started GET /api/lb-check for 10.1.1.81:49950 [martini] Completed 200 OK in 833.603µs [martini] Started GET /api/raft-health for 10.1.1.81:49964 [martini] Completed 200 OK in 988.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.787617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.011805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.43061ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.383224ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 830.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.875608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.871313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 904.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.800608ms [martini] Started GET /api/raft-follower-health-report/cddcf4c5/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 673.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.454315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.039504ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.056309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.310619ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.103105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20991ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.46432ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.433506ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.39151ms [martini] Started GET /api/lb-check for 10.1.1.81:50084 [martini] Completed 200 OK in 960.204µs [martini] Started GET /api/raft-health for 10.1.1.81:50100 [martini] Completed 200 OK in 778.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.809926ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.128005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.892909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.899317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.052904ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.617512ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.949013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 790.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.650212ms 2018-11-29 05:57:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 05:57:17 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/91914683/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 644.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.436815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 885.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23011ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.149114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.846308ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.045909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.057117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.113805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25881ms [martini] Started GET /api/lb-check for 10.1.1.81:50234 [martini] Completed 200 OK in 820.503µs [martini] Started GET /api/raft-health for 10.1.1.81:50254 [martini] Completed 200 OK in 750.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.486516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.131205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20811ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.684516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.150105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.08201ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.203114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.317506ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.952209ms [martini] Started GET /api/raft-follower-health-report/e5b2298a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.097404ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.273719ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.168305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.959309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.804817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 919.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.006009ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.278419ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 964.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.127809ms [martini] Started GET /api/lb-check for 10.1.1.81:50380 [martini] Completed 200 OK in 796.404µs [martini] Started GET /api/raft-health for 10.1.1.81:50408 [martini] Completed 200 OK in 1.093404ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.536215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 842.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.121209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.093814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 879.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.334815ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.53982ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.082305ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26601ms [martini] Started GET /api/raft-follower-health-report/414f527d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 924.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.451216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.498511ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.603711ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.626416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.322406ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.999522ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.305519ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 808.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.916308ms [martini] Started GET /api/lb-check for 10.1.1.81:50534 [martini] Completed 200 OK in 714.003µs [martini] Started GET /api/raft-health for 10.1.1.81:50548 [martini] Completed 200 OK in 717.403µs 2018-11-29 05:57:41 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.599515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 882.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.026009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.173214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.836908ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.148118ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.347415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 768.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.989908ms 2018-11-29 05:57:47 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/9c65418c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 676.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.559016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 863.103µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.095709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.350615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 755.703µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.692712ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.011613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.157705ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.106509ms [martini] Started GET /api/lb-check for 10.1.1.81:50672 [martini] Completed 200 OK in 2.23691ms [martini] Started GET /api/raft-health for 10.1.1.81:50690 [martini] Completed 200 OK in 773.103µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.58052ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.052105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.971809ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.321215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 832.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.001609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.748716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 813.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.948608ms [martini] Started GET /api/raft-follower-health-report/26d0d61b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 594.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.754516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 947.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23211ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.901017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 971.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.076509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.293315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 897.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.798912ms [martini] Started GET /api/lb-check for 10.1.1.81:50818 [martini] Completed 200 OK in 804.504µs [martini] Started GET /api/raft-health for 10.1.1.81:50844 [martini] Completed 200 OK in 671.903µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.589516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.537207ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.33201ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.688316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 991.805µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.121109ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.918731ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.085605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.30471ms [martini] Started GET /api/raft-follower-health-report/048e5991/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 679.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.700316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.003804ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.066409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.195622ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.080305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.979509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.692447ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.079905ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.605716ms [martini] Started GET /api/lb-check for 10.1.1.81:50958 [martini] Completed 200 OK in 878.404µs [martini] Started GET /api/raft-health for 10.1.1.81:50982 [martini] Completed 200 OK in 1.028604ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.723617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.204105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.38891ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.257814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 879.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.906808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.106413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 867.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.022609ms 2018-11-29 05:58:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 05:58:17 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/7cc1d812/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 742.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.490015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 956.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22251ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.332714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 863.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.069309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.286715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 775.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.211509ms [martini] Started GET /api/lb-check for 10.1.1.81:51128 [martini] Completed 200 OK in 820.404µs [martini] Started GET /api/raft-health for 10.1.1.81:51144 [martini] Completed 200 OK in 627.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.865817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.185105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.100909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.387115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 973.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.842608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.324715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 895.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.838508ms [martini] Started GET /api/raft-follower-health-report/34c249d6/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 685.103µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.385815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.325405ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.712725ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.767825ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.016004ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.979609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.913118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.001504ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25711ms [martini] Started GET /api/lb-check for 10.1.1.81:51286 [martini] Completed 200 OK in 691.103µs [martini] Started GET /api/raft-health for 10.1.1.81:51298 [martini] Completed 200 OK in 842.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.694516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 854.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.092009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.285119ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 776.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.917909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.63992ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 6.83973ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.876908ms [martini] Started GET /api/raft-follower-health-report/a432dcc3/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 923.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.599216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 824.203µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.108809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.476916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 791.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.40941ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.039623ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.489407ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.987813ms [martini] Started GET /api/lb-check for 10.1.1.81:51438 [martini] Completed 200 OK in 847.304µs [martini] Started GET /api/raft-health for 10.1.1.81:51464 [martini] Completed 200 OK in 4.840722ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.767217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.471706ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.862208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.210115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 877.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.040309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.601242ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 966.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.949009ms 2018-11-29 05:58:47 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 05:58:47 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/c8435acb/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.750108ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.917617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 966.305µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.146309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.200914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 824.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.141609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.434815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 959.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.063309ms [martini] Started GET /api/lb-check for 10.1.1.81:51586 [martini] Completed 200 OK in 724.303µs [martini] Started GET /api/raft-health for 10.1.1.81:51602 [martini] Completed 200 OK in 816.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.350314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.006105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.508515ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.031718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 984.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.34711ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.744916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 867.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.927809ms [martini] Started GET /api/raft-follower-health-report/a81caf4b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 824.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.726717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 857.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.831208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.834326ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.195018ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.003709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.535438ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 839.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.147309ms [martini] Started GET /api/lb-check for 10.1.1.81:51730 [martini] Completed 200 OK in 671.703µs [martini] Started GET /api/raft-health for 10.1.1.81:51742 [martini] Completed 200 OK in 869.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.416616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 956.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.258409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.811225ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.474009ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.377913ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.398013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 879.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.965807ms [martini] Started GET /api/raft-follower-health-report/7c336062/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 734.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.479313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.470106ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.165208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.596814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.674906ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.171208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.470817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 6.803625ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.49131ms [martini] Started GET /api/lb-check for 10.1.1.81:51872 [martini] Completed 200 OK in 734.303µs [martini] Started GET /api/raft-health for 10.1.1.81:51882 [martini] Completed 200 OK in 829.303µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.155419ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 961.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.727014ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.378312ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 822.903µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.177808ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.313512ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 945.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.919307ms 2018-11-29 05:59:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/545ab89b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 866.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.547113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 962.303µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.000107ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.310712ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.62391ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.061707ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.450313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.512809ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.454209ms [martini] Started GET /api/lb-check for 10.1.1.81:52030 [martini] Completed 200 OK in 687.802µs [martini] Started GET /api/raft-health for 10.1.1.81:52058 [martini] Completed 200 OK in 890.704µs 2018-11-29 05:59:23 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.489013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 984.503µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.999707ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.183412ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 864.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.823414ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.083415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.017604ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.135619ms [martini] Started GET /api/raft-follower-health-report/cdd3eba8/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 806.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.662717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 860.803µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.862007ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.965515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.105104ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.59911ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.829714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.018603ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.744206ms [martini] Started GET /api/lb-check for 10.1.1.81:52208 [martini] Completed 200 OK in 742.102µs [martini] Started GET /api/raft-health for 10.1.1.81:52220 [martini] Completed 200 OK in 800.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.401512ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.001608ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.135808ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.324319ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 934.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.184708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.214512ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.060104ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.992107ms [martini] Started GET /api/raft-follower-health-report/a7cdd88c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 698.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.987615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.415509ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.192808ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.052534ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.044104ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.165008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 17.921967ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.770414ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.382135ms [martini] Started GET /api/lb-check for 10.1.1.81:52346 [martini] Completed 200 OK in 654.702µs [martini] Started GET /api/raft-health for 10.1.1.81:52360 [martini] Completed 200 OK in 691.602µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.634814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 833.803µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.944307ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.371512ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.860507ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.143111ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.235212ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 809.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.172308ms [martini] Started GET /api/raft-follower-health-report/47feaa27/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 742.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.545114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 886.103µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.105108ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.626713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 764.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.007408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.404813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 814.903µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.208308ms [martini] Started GET /api/lb-check for 10.1.1.81:52482 [martini] Completed 200 OK in 2.52541ms [martini] Started GET /api/raft-health for 10.1.1.81:52496 [martini] Completed 200 OK in 694.202µs 2018-11-29 05:59:53 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 05:59:53 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.695114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 918.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.248409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.194312ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 999.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.294809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.407012ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 857.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.177708ms [martini] Started GET /api/raft-follower-health-report/fb6b79fc/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 862.403µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.621713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.048208ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.59591ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.283912ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 897.303µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.966307ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.355813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 869.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.007308ms [martini] Started GET /api/lb-check for 10.1.1.81:52634 [martini] Completed 200 OK in 701.203µs [martini] Started GET /api/raft-health for 10.1.1.81:52660 [martini] Completed 200 OK in 901.503µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.654614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 972.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.901607ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.071919ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.170504ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.914108ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.960218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.000604ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.180708ms [martini] Started GET /api/raft-follower-health-report/1f6e02c8/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 831.103µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.111015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.094904ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.055708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.389116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 984.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.176708ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.400912ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.61651ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.410409ms [martini] Started GET /api/lb-check for 10.1.1.81:52786 [martini] Completed 200 OK in 653.302µs [martini] Started GET /api/raft-health for 10.1.1.81:52800 [martini] Completed 200 OK in 645.702µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.053615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.014104ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.172008ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.125711ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 816.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.791307ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.343612ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.564706ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.048208ms 2018-11-29 06:00:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/aae72876/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 777.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.549414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 984.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.213209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.682514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 978.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.128308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.984311ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 912.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.153108ms [martini] Started GET /api/lb-check for 10.1.1.81:52954 [martini] Completed 200 OK in 814.503µs [martini] Started GET /api/raft-health for 10.1.1.81:52970 [martini] Completed 200 OK in 755.903µs 2018-11-29 06:00:23 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.89233ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 929.703µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.153408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.634614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 897.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.042108ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.385413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 836.803µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.030808ms [martini] Started GET /api/raft-follower-health-report/b07dc52b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.357805ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.830818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 855.203µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.56421ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.527728ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 5.928222ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.898507ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.995211ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.031004ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.932108ms [martini] Started GET /api/lb-check for 10.1.1.81:53098 [martini] Completed 200 OK in 748.403µs [martini] Started GET /api/raft-health for 10.1.1.81:53110 [martini] Completed 200 OK in 676.202µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.836815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 972.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.847507ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.172315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.79491ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.155908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.761618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.008904ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.20392ms [martini] Started GET /api/raft-follower-health-report/c8b6221f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 852.903µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.061115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 933.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.988008ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.528417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 999.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.094408ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.659817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 5.13632ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.460909ms [martini] Started GET /api/lb-check for 10.1.1.81:53246 [martini] Completed 200 OK in 626.603µs [martini] Started GET /api/raft-health for 10.1.1.81:53270 [martini] Completed 200 OK in 684.103µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.920815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 881.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.914407ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.181612ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.013904ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.833107ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.191312ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 806.903µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.797407ms [martini] Started GET /api/raft-follower-health-report/256014a7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 816.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.085823ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.818811ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.369609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.553714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 906.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.095208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.885415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 911.703µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.954607ms [martini] Started GET /api/lb-check for 10.1.1.81:53400 [martini] Completed 200 OK in 926.203µs [martini] Started GET /api/raft-health for 10.1.1.81:53416 [martini] Completed 200 OK in 827.403µs 2018-11-29 06:00:53 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 06:00:53 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.692214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 926.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.921408ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.266513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.892511ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.678414ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.042211ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 842.803µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.701006ms [martini] Started GET /api/raft-follower-health-report/2f6b8409/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 715.403µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.815514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.115304ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.567609ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.132312ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 946.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.849907ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.592313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 848.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.556417ms [martini] Started GET /api/lb-check for 10.1.1.81:53558 [martini] Completed 200 OK in 3.391213ms [martini] Started GET /api/raft-health for 10.1.1.81:53570 [martini] Completed 200 OK in 861.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.564114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.575909ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.308525ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.375912ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 937.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.051108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.877923ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.020904ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.160608ms [martini] Started GET /api/raft-follower-health-report/096b00d8/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 791.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.454713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.010504ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.099308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.869315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 976.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.047507ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.642229ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 809.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.002708ms [martini] Started GET /api/lb-check for 10.1.1.81:53704 [martini] Completed 200 OK in 690.503µs [martini] Started GET /api/raft-health for 10.1.1.81:53730 [martini] Completed 200 OK in 764.903µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.992615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 960.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.759922ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.002911ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 846.503µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.961808ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.186013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.043004ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.239409ms 2018-11-29 06:01:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/11d3d437/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.242405ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.996016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 855.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.012307ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.153112ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 844.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.767334ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.368613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 803.603µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.261708ms [martini] Started GET /api/lb-check for 10.1.1.81:53860 [martini] Completed 200 OK in 800.403µs [martini] Started GET /api/raft-health for 10.1.1.81:53894 [martini] Completed 200 OK in 801.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.851914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 906.003µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.072608ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.698814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 860.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.443809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.969311ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.164305ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.989408ms [martini] Started GET /api/raft-follower-health-report/fae0d749/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 741.703µs 2018-11-29 06:01:29 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.913215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 773.003µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.933007ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.345412ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 923.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.070408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.056212ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 675.503µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.022908ms [martini] Started GET /api/lb-check for 10.1.1.81:54026 [martini] Completed 200 OK in 3.987415ms [martini] Started GET /api/raft-health for 10.1.1.81:54042 [martini] Completed 200 OK in 898.604µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.332913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 745.602µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.869008ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.369217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.891407ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.152208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.562122ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.108205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.951308ms [martini] Started GET /api/raft-follower-health-report/b0367726/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 846.103µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.551821ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.997508ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.204108ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.989611ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 874.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.327709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.787534ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.200404ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.602414ms [martini] Started GET /api/lb-check for 10.1.1.81:54182 [martini] Completed 200 OK in 638.003µs [martini] Started GET /api/raft-health for 10.1.1.81:54194 [martini] Completed 200 OK in 823.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.195013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 877.703µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.123508ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.314913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.091004ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.974908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.034611ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 755.503µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.800107ms [martini] Started GET /api/raft-follower-health-report/8c4e0b09/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 930.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.024815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.082004ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.131108ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.497814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 995.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.406909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.144212ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 908.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.369016ms [martini] Started GET /api/lb-check for 10.1.1.81:54326 [martini] Completed 200 OK in 778.703µs [martini] Started GET /api/raft-health for 10.1.1.81:54356 [martini] Completed 200 OK in 968.404µs 2018-11-29 06:01:53 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 06:01:53 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.338913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 938.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.014708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.138012ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 970.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.853607ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.024012ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 962.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.927207ms [martini] Started GET /api/raft-follower-health-report/e3546bea/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 727.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.743615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.340005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.251509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.429313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 878.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.151808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.189713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 813.503µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.845107ms [martini] Started GET /api/lb-check for 10.1.1.81:54492 [martini] Completed 200 OK in 763.603µs [martini] Started GET /api/raft-health for 10.1.1.81:54508 [martini] Completed 200 OK in 836.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.285313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.076904ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.187124ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.452121ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.344905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.838311ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.540917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 949.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.423409ms [martini] Started GET /api/raft-follower-health-report/246905e6/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 696.103µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.015716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.056804ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.097108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.393013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 902.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.129028ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.384313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 918.803µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.916411ms [martini] Started GET /api/lb-check for 10.1.1.81:54638 [martini] Completed 200 OK in 743.303µs [martini] Started GET /api/raft-health for 10.1.1.81:54650 [martini] Completed 200 OK in 926.403µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.761715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 891.703µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.992408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.306013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.017904ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.59051ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.292712ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 860.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.162909ms 2018-11-29 06:02:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/e2e780f0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 948.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.118316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 958.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.021708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.451414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.072104ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.078808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.296213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 937.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.078508ms [martini] Started GET /api/lb-check for 10.1.1.81:54794 [martini] Completed 200 OK in 908.403µs [martini] Started GET /api/raft-health for 10.1.1.81:54810 [martini] Completed 200 OK in 973.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.166316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 974.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.062108ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.320413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.017804ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.930707ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.189613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 779.703µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.909208ms [martini] Started GET /api/raft-follower-health-report/ffc443d3/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 799.703µs 2018-11-29 06:02:29 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.387413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.65751ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.969423ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.471333ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.999219ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.921508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.209817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 847.803µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.330513ms [martini] Started GET /api/lb-check for 10.1.1.81:54940 [martini] Completed 200 OK in 682.803µs [martini] Started GET /api/raft-health for 10.1.1.81:54964 [martini] Completed 200 OK in 1.075705ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.730614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 950.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.070808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.927315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.050504ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.771011ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.42284ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 949.503µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.739307ms [martini] Started GET /api/raft-follower-health-report/6b32eb18/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 868.104µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.339313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.041904ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.032108ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.871427ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.119305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.052908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.392236ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.153904ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.200109ms [martini] Started GET /api/lb-check for 10.1.1.81:55104 [martini] Completed 200 OK in 1.019604ms [martini] Started GET /api/raft-health for 10.1.1.81:55116 [martini] Completed 200 OK in 852.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.248013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.001604ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.900808ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.265413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 872.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.699507ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.229312ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 908.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.990507ms [martini] Started GET /api/raft-follower-health-report/bc801771/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 2.269309ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.413414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.072904ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.098608ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.285412ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 997.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.149408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.362613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.162604ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.146209ms [martini] Started GET /api/lb-check for 10.1.1.81:55242 [martini] Completed 200 OK in 721.302µs [martini] Started GET /api/raft-health for 10.1.1.81:55258 [martini] Completed 200 OK in 714.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.462318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.021804ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.814415ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.205912ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 888.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.108408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.332213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 987.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.084708ms [martini] Started GET /api/raft-follower-health-report/e76b5dff/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 723.302µs 2018-11-29 06:02:59 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 06:02:59 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.673814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.130904ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.923011ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.574614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 830.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.952708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.19962ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.116516ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.985508ms [martini] Started GET /api/lb-check for 10.1.1.81:55390 [martini] Completed 200 OK in 613.803µs [martini] Started GET /api/raft-health for 10.1.1.81:55404 [martini] Completed 200 OK in 897.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.722615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 965.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.123808ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.495221ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 838.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.168009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.876219ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.003804ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.109808ms [martini] Started GET /api/raft-follower-health-report/8ac268b3/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 696.303µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.675514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 775.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.115308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.851519ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.182405ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.027112ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.388913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 824.803µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.946708ms [martini] Started GET /api/lb-check for 10.1.1.81:55544 [martini] Completed 200 OK in 669.102µs [martini] Started GET /api/raft-health for 10.1.1.81:55570 [martini] Completed 200 OK in 835.503µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.264024ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.915012ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.309409ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.117612ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 823.103µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.945807ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.906219ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.173704ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.095608ms 2018-11-29 06:03:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/d661c83f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 595.502µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.353213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 840.803µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.199208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.746815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.361809ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.55751ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.377413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 814.103µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.099608ms [martini] Started GET /api/lb-check for 10.1.1.81:55714 [martini] Completed 200 OK in 683.803µs [martini] Started GET /api/raft-health for 10.1.1.81:55728 [martini] Completed 200 OK in 790.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.990415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 991.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.312709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.484614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 939.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.199309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.283713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 986.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.686318ms [martini] Started GET /api/raft-follower-health-report/14dcfa26/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 779.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.119512ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.087104ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.807707ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.755715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 753.003µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.943008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.409114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 889.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.332709ms [martini] Started GET /api/lb-check for 10.1.1.81:55858 [martini] Completed 200 OK in 1.374305ms [martini] Started GET /api/raft-health for 10.1.1.81:55868 [martini] Completed 200 OK in 825.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.498718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.049112ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.139513ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.164117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.007304ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.650811ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.898715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 971.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.307809ms 2018-11-29 06:03:35 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/9975540d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 924.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.680215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.194905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.308309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.424313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 833.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.893307ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.896516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.162604ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.828711ms [martini] Started GET /api/lb-check for 10.1.1.81:56012 [martini] Completed 200 OK in 707.902µs [martini] Started GET /api/raft-health for 10.1.1.81:56024 [martini] Completed 200 OK in 781.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.851015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.238405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.236709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.272112ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 875.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.971532ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.367413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 951.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.961008ms [martini] Started GET /api/raft-follower-health-report/1eed6f16/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 845.403µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.916415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 966.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.114708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.875715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.392205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.995412ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.508813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.163404ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.446413ms [martini] Started GET /api/lb-check for 10.1.1.81:56158 [martini] Completed 200 OK in 826.803µs [martini] Started GET /api/raft-health for 10.1.1.81:56188 [martini] Completed 200 OK in 729.602µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.765615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.035104ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.103608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.908811ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 824.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.940608ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.174213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 843.003µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.137008ms [martini] Started GET /api/raft-follower-health-report/08ca7d40/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 867.803µs 2018-11-29 06:03:59 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 06:03:59 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.712015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 961.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.957708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.427613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 990.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.122409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.107513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 894.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.140208ms [martini] Started GET /api/lb-check for 10.1.1.81:56324 [martini] Completed 200 OK in 865.403µs [martini] Started GET /api/raft-health for 10.1.1.81:56340 [martini] Completed 200 OK in 913.104µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.728815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 883.703µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.519617ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.826623ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.009204ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.54111ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.695715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.077504ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.885707ms [martini] Started GET /api/raft-follower-health-report/9f7ecf0e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 859.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.876615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 990.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.781111ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.845819ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.069304ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.963908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 16.115864ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 806.703µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.65841ms [martini] Started GET /api/lb-check for 10.1.1.81:56472 [martini] Completed 200 OK in 860.204µs [martini] Started GET /api/raft-health for 10.1.1.81:56482 [martini] Completed 200 OK in 808.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.331213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 998.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.093308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.124912ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.185705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.956507ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.105113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 982.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.089109ms 2018-11-29 06:04:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/10b68bef/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 826.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.703014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.000804ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.290109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.804415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.371705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.937407ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.362813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.002804ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.964508ms [martini] Started GET /api/lb-check for 10.1.1.81:56628 [martini] Completed 200 OK in 667.303µs [martini] Started GET /api/raft-health for 10.1.1.81:56658 [martini] Completed 200 OK in 840.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.324217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.138105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.086508ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.644114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 926.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.34421ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.917411ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 940.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.896907ms [martini] Started GET /api/raft-follower-health-report/d8343241/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 683.702µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.484513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 866.203µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.742215ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.622238ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 797.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.542218ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.71381ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 772.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.078508ms [martini] Started GET /api/lb-check for 10.1.1.81:56776 [martini] Completed 200 OK in 941.803µs [martini] Started GET /api/raft-health for 10.1.1.81:56800 [martini] Completed 200 OK in 857.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.794215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.095805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.964508ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.429818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 989.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.941208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.423922ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.410718ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.462813ms [martini] Started GET /api/raft-follower-health-report/479e3190/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 870.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.174217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.089204ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.884208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.12442ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 916.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.959407ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.841115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 912.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.041112ms [martini] Started GET /api/lb-check for 10.1.1.81:56944 [martini] Completed 200 OK in 853.704µs [martini] Started GET /api/raft-health for 10.1.1.81:56954 [martini] Completed 200 OK in 967.903µs 2018-11-29 06:04:41 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.669015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 788.203µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.131108ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.207713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 898.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.860208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.291413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.048504ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.783708ms [martini] Started GET /api/raft-follower-health-report/f7384cd9/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 682.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.676215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.59581ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.084212ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.590515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 894.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.117808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.313513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 872.203µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.903408ms [martini] Started GET /api/lb-check for 10.1.1.81:57086 [martini] Completed 200 OK in 700.103µs [martini] Started GET /api/raft-health for 10.1.1.81:57102 [martini] Completed 200 OK in 741.902µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.140417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 975.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.955108ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.087312ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.063809ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.155808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.258613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 770.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.729007ms [martini] Started GET /api/raft-follower-health-report/53c82664/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 816.103µs 2018-11-29 06:04:59 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 06:04:59 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.829815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.081404ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.46861ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.219513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 933.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.001608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.025512ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.145405ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.383614ms [martini] Started GET /api/lb-check for 10.1.1.81:57234 [martini] Completed 200 OK in 641.702µs [martini] Started GET /api/raft-health for 10.1.1.81:57262 [martini] Completed 200 OK in 838.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.427614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.246805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.942107ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.036716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 744.003µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.140909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.598118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.000904ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.965408ms [martini] Started GET /api/raft-follower-health-report/00f572f3/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 712.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.572514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.059804ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.968907ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.600414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.051104ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.783111ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 19.092876ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 990.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.014608ms [martini] Started GET /api/lb-check for 10.1.1.81:57398 [martini] Completed 200 OK in 630.402µs [martini] Started GET /api/raft-health for 10.1.1.81:57410 [martini] Completed 200 OK in 679.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.678815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.202405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.424514ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.882315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 760.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.054908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.119812ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 941.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.022908ms 2018-11-29 06:05:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/203ed58a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 880.603µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.099217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 973.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.102308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.049113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 785.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.121809ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.10002ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.036004ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.974708ms [martini] Started GET /api/lb-check for 10.1.1.81:57554 [martini] Completed 200 OK in 746.103µs [martini] Started GET /api/raft-health for 10.1.1.81:57570 [martini] Completed 200 OK in 601.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.830516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.045604ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.161908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.817316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 898.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.106208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.282113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.028004ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.112408ms [martini] Started GET /api/raft-follower-health-report/d3d0c6ed/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 923.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.461118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.741406ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.858908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.461914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.037304ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.289009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.421914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.254909ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.41911ms [martini] Started GET /api/lb-check for 10.1.1.81:57704 [martini] Completed 200 OK in 763.103µs [martini] Started GET /api/raft-health for 10.1.1.81:57714 [martini] Completed 200 OK in 772.804µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.214533ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 853.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.085508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.96542ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 969.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.48581ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.596014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 926.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.190808ms [martini] Started GET /api/raft-follower-health-report/3d8ca97c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.474506ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.425614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.024704ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.137409ms [martini] Started GET /api/lb-check for 10.1.1.81:57852 [martini] Completed 200 OK in 2.286609ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.431017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 913.803µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.45531ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.774015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.302906ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.107209ms [martini] Started GET /api/raft-health for 10.1.1.81:57878 [martini] Completed 200 OK in 880.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.753115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 794.203µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.214809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.684915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 849.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.510211ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.06752ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.159913ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.34361ms 2018-11-29 06:05:47 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/0ab02708/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.042304ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.009217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.162105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.441209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.421714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.142105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.020812ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.906012ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.027404ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.818715ms [martini] Started GET /api/lb-check for 10.1.1.81:58010 [martini] Completed 200 OK in 788.403µs [martini] Started GET /api/raft-health for 10.1.1.81:58026 [martini] Completed 200 OK in 2.090908ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.752915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.135005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.057908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.166913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 857.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.832708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.996928ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 994.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.086309ms [martini] Started GET /api/raft-follower-health-report/963acb17/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.260705ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.13512ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.116204ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.125509ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.262313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 849.003µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.163009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.283114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 986.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.967107ms [martini] Started GET /api/lb-check for 10.1.1.81:58164 [martini] Completed 200 OK in 907.304µs [martini] Started GET /api/raft-health for 10.1.1.81:58176 [martini] Completed 200 OK in 829.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.805215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.051504ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.216509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.057616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 822.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.597823ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.150316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.006004ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.001908ms 2018-11-29 06:06:05 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 06:06:05 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/0aea85ab/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 801.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.540615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.130604ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.973108ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.170424ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 922.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.807311ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.153816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.175909ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 19.019876ms [martini] Started GET /api/lb-check for 10.1.1.81:58314 [martini] Completed 200 OK in 606.102µs [martini] Started GET /api/raft-health for 10.1.1.81:58326 [martini] Completed 200 OK in 935.404µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.765715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 849.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.040908ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.326913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 877.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.970208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.141412ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 806.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.849308ms 2018-11-29 06:06:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/5e90a3d1/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 821.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.97732ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 900.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.997708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.412514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 944.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.008108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.118013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 864.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.144608ms [martini] Started GET /api/lb-check for 10.1.1.81:58466 [martini] Completed 200 OK in 952.004µs [martini] Started GET /api/raft-health for 10.1.1.81:58500 [martini] Completed 200 OK in 754.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.692519ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.967108ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.269109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.475014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 982.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.667406ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.970612ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 742.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.393509ms [martini] Started GET /api/raft-follower-health-report/65537fcd/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 673.403µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.327134ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 994.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.235909ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.390414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.324406ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.430446ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.999116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.297805ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.692315ms [martini] Started GET /api/lb-check for 10.1.1.81:58626 [martini] Completed 200 OK in 838.903µs [martini] Started GET /api/raft-health for 10.1.1.81:58638 [martini] Completed 200 OK in 921.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.650615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.082904ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.912508ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.470819ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.241405ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.827007ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.179013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 921.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.321809ms [martini] Started GET /api/raft-follower-health-report/26541f55/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 883.204µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.483214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 949.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.969208ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.791323ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 7.176329ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.636811ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.077332ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 997.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29411ms [martini] Started GET /api/lb-check for 10.1.1.81:58774 [martini] Completed 200 OK in 1.042804ms [martini] Started GET /api/raft-health for 10.1.1.81:58790 [martini] Completed 200 OK in 678.302µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.893916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 970.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.856607ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.266113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 814.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.860308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.296013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 834.803µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.050208ms [martini] Started GET /api/raft-follower-health-report/587aaabc/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 880.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.800715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 962.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.667723ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.151113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 809.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.951708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.028412ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 971.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.855808ms [martini] Started GET /api/lb-check for 10.1.1.81:58920 [martini] Completed 200 OK in 740.503µs [martini] Started GET /api/raft-health for 10.1.1.81:58936 [martini] Completed 200 OK in 828.903µs 2018-11-29 06:06:53 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.701015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.136605ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.086508ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.111013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.408405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.083713ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.352314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.380006ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.131108ms [martini] Started GET /api/raft-follower-health-report/7133c023/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 729.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.518714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.053804ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.702111ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.253618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 879.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.255409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.238513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 855.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.871908ms [martini] Started GET /api/lb-check for 10.1.1.81:59070 [martini] Completed 200 OK in 3.216113ms [martini] Started GET /api/raft-health for 10.1.1.81:59098 [martini] Completed 200 OK in 613.302µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.579915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 863.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.069808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.434414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.446506ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.704411ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.169021ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.075504ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.165409ms 2018-11-29 06:07:05 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 06:07:05 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/4aac84da/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 841.603µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.639922ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.50721ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.030308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.286522ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.004404ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.157209ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.682315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 855.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.872408ms [martini] Started GET /api/lb-check for 10.1.1.81:59224 [martini] Completed 200 OK in 625.103µs [martini] Started GET /api/raft-health for 10.1.1.81:59240 [martini] Completed 200 OK in 981.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.676615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.063805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.049708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.560614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 5.427122ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.005008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.025817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.213405ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.884108ms 2018-11-29 06:07:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/c3a99ff5/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 885.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.833415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.169505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.947008ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.145012ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 761.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.938108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.114421ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 881.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.955208ms [martini] Started GET /api/lb-check for 10.1.1.81:59380 [martini] Completed 200 OK in 861.503µs [martini] Started GET /api/raft-health for 10.1.1.81:59394 [martini] Completed 200 OK in 635.102µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.335918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.195305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.079809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.351714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 933.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.084329ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.478114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 945.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.213809ms [martini] Started GET /api/raft-follower-health-report/0a58df45/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 761.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.407418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.355006ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.166209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.120016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 911.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.053709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.690615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.041205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.581511ms [martini] Started GET /api/lb-check for 10.1.1.81:59524 [martini] Completed 200 OK in 857.804µs [martini] Started GET /api/raft-health for 10.1.1.81:59550 [martini] Completed 200 OK in 773.603µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.05472ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.032808ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.287309ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.915016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 862.103µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.824307ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.124021ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.096004ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.913608ms [martini] Started GET /api/raft-follower-health-report/0ecbe95b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 654.002µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.692215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 946.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.075409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.504522ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.913508ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.920012ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.174017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 968.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.390126ms [martini] Started GET /api/lb-check for 10.1.1.81:59668 [martini] Completed 200 OK in 890.003µs [martini] Started GET /api/raft-health for 10.1.1.81:59696 [martini] Completed 200 OK in 976.004µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.711615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.211105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.987808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.372114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 772.503µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.990809ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.984412ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 761.603µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.861116ms [martini] Started GET /api/raft-follower-health-report/c008e909/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 772.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.768816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 871.303µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.595511ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.482014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 796.003µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.805608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.113813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 948.703µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.888808ms [martini] Started GET /api/lb-check for 10.1.1.81:59830 [martini] Completed 200 OK in 778.804µs [martini] Started GET /api/raft-health for 10.1.1.81:59846 [martini] Completed 200 OK in 1.059404ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.253418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 904.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.34171ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.229114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 955.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.815407ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.111013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 770.503µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.42511ms [martini] Started GET /api/raft-follower-health-report/3defd7ad/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 780.903µs 2018-11-29 06:07:59 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.646015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.057904ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.021225ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.285814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 923.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.007208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.342213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 898.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.790208ms [martini] Started GET /api/lb-check for 10.1.1.81:59974 [martini] Completed 200 OK in 641.802µs [martini] Started GET /api/raft-health for 10.1.1.81:59986 [martini] Completed 200 OK in 2.54191ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.584114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 753.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.165609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.31973ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 987.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.184109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 18.190675ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.204105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.960808ms [martini] Started GET /api/raft-follower-health-report/822beb9e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 687.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.747516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.003905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.045608ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.413322ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.033304ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.051709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.298514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 815.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.070508ms [martini] Started GET /api/lb-check for 10.1.1.81:60118 [martini] Completed 200 OK in 2.024008ms [martini] Started GET /api/raft-health for 10.1.1.81:60142 [martini] Completed 200 OK in 777.204µs 2018-11-29 06:08:11 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 06:08:11 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.723615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 992.405µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.000009ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.103413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 789.003µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.795107ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.364014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.236605ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.022709ms 2018-11-29 06:08:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/3750de34/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 2.42961ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.790316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.141105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.150009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.293713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 776.003µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.097709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.988512ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 839.503µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.127808ms [martini] Started GET /api/lb-check for 10.1.1.81:60286 [martini] Completed 200 OK in 682.203µs [martini] Started GET /api/raft-health for 10.1.1.81:60302 [martini] Completed 200 OK in 634.202µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.685615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.010204ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.736428ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.544615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.200105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.222509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.401413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.078004ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.900408ms [martini] Started GET /api/raft-follower-health-report/0aa16e3d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 829.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.384318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.422806ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.005513ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.407318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.102905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.991808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.986924ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 912.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.103909ms [martini] Started GET /api/lb-check for 10.1.1.81:60442 [martini] Completed 200 OK in 823.003µs [martini] Started GET /api/raft-health for 10.1.1.81:60458 [martini] Completed 200 OK in 830.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.795216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.054104ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.052609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.74802ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 906.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.000308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.018121ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 884.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.376818ms [martini] Started GET /api/raft-follower-health-report/c18bee95/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 786.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.524914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.178205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.110308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.523423ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 776.003µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.096408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.325622ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.518911ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.635315ms [martini] Started GET /api/lb-check for 10.1.1.81:60592 [martini] Completed 200 OK in 686.603µs [martini] Started GET /api/raft-health for 10.1.1.81:60608 [martini] Completed 200 OK in 889.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.949729ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 914.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.025708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.071813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 793.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.821107ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.067712ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 844.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.887708ms [martini] Started GET /api/raft-follower-health-report/b9a181e5/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 759.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.166013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 831.903µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.783312ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.176213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 865.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.39881ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.193613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 859.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.848007ms [martini] Started GET /api/lb-check for 10.1.1.81:60746 [martini] Completed 200 OK in 644.602µs [martini] Started GET /api/raft-health for 10.1.1.81:60774 [martini] Completed 200 OK in 759.003µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.101721ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 965.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.140609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.846012ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 949.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.924208ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.340114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.115909ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.067808ms [martini] Started GET /api/raft-follower-health-report/cb5d1fd0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.192305ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.640419ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 973.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.001908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.320914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 962.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.975108ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.131913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 814.403µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.067909ms [martini] Started GET /api/lb-check for 10.1.1.81:60914 [martini] Completed 200 OK in 921.004µs [martini] Started GET /api/raft-health for 10.1.1.81:60926 [martini] Completed 200 OK in 907.304µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.802116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.015005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.43731ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.019613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.002309ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.918607ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.342818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.056204ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.851908ms 2018-11-29 06:09:05 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/27821035/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.678707ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.600714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.044708ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.42681ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.605223ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.170205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.752407ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.018716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 870.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.988708ms [martini] Started GET /api/lb-check for 10.1.1.81:32828 [martini] Completed 200 OK in 701.003µs [martini] Started GET /api/raft-health for 10.1.1.81:32840 [martini] Completed 200 OK in 852.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.180513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.218705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.874408ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.323514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.067609ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.176421ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.945412ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 732.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.018509ms 2018-11-29 06:09:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 06:09:17 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 06:09:17 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/9333619b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 786.703µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.851816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 848.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.47651ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.226713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.006804ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.036408ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.533915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 867.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.884012ms [martini] Started GET /api/lb-check for 10.1.1.81:32990 [martini] Completed 200 OK in 810.903µs [martini] Started GET /api/raft-health for 10.1.1.81:33004 [martini] Completed 200 OK in 816.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.675615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.304406ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.319609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.186118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 890.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.223409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.512015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.062504ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.996209ms [martini] Started GET /api/raft-follower-health-report/57becf63/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 896.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.171725ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.114905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.687912ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.386618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.047904ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.890508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.558115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.042604ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.636824ms [martini] Started GET /api/lb-check for 10.1.1.81:33140 [martini] Completed 200 OK in 812.803µs [martini] Started GET /api/raft-health for 10.1.1.81:33166 [martini] Completed 200 OK in 816.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.630815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.042704ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.209426ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.148413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 771.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.073608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.301614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 940.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.738707ms [martini] Started GET /api/raft-follower-health-report/31c1b262/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 707.002µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.715315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.071904ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.248009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.169014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.243818ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.240434ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 14.008057ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.439406ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.021212ms [martini] Started GET /api/lb-check for 10.1.1.81:33318 [martini] Completed 200 OK in 646.403µs [martini] Started GET /api/raft-health for 10.1.1.81:33330 [martini] Completed 200 OK in 645.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.583715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 944.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.38101ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.062713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 838.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.856207ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.066412ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 948.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.282809ms [martini] Started GET /api/raft-follower-health-report/bf9a1365/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 680.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.172517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 891.103µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.37731ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.266213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 995.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.806408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.042612ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 874.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.898308ms [martini] Started GET /api/lb-check for 10.1.1.81:33466 [martini] Completed 200 OK in 675.303µs [martini] Started GET /api/raft-health for 10.1.1.81:33486 [martini] Completed 200 OK in 630.002µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.651315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 978.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.086809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.588623ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 947.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.859208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.156013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.240806ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.958409ms [martini] Started GET /api/raft-follower-health-report/db7f8667/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 908.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.701815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.579011ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.604411ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.367614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 924.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.895508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.128413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 885.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.007909ms [martini] Started GET /api/lb-check for 10.1.1.81:33624 [martini] Completed 200 OK in 768.704µs [martini] Started GET /api/raft-health for 10.1.1.81:33636 [martini] Completed 200 OK in 827.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.613715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.105104ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.925308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.421514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 771.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.202626ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.235113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 813.803µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.984208ms 2018-11-29 06:10:05 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/9a4c86b7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 713.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.937516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.284705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.34871ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.292443ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.895916ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.988108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.871516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.026304ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29761ms [martini] Started GET /api/lb-check for 10.1.1.81:33782 [martini] Completed 200 OK in 1.264305ms [martini] Started GET /api/raft-health for 10.1.1.81:33808 [martini] Completed 200 OK in 744.904µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.864816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.097104ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.58701ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.911412ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 989.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.934308ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.637115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.024504ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.314609ms 2018-11-29 06:10:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 06:10:17 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/e11c2088/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 2.322409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.623415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 981.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.049008ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.423514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.098705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.994208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.185413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.032805ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.979009ms [martini] Started GET /api/lb-check for 10.1.1.81:33950 [martini] Completed 200 OK in 907.704µs [martini] Started GET /api/raft-health for 10.1.1.81:33966 [martini] Completed 200 OK in 750.104µs 2018-11-29 06:10:23 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.706016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.188905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.278214ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.021917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.410106ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.082209ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.400414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 861.803µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.983609ms [martini] Started GET /api/raft-follower-health-report/a132de80/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 843.704µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.500818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.014204ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.002008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.551715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 996.505µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.42561ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.790336ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.248106ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.025716ms [martini] Started GET /api/lb-check for 10.1.1.81:34094 [martini] Completed 200 OK in 629.303µs [martini] Started GET /api/raft-health for 10.1.1.81:34108 [martini] Completed 200 OK in 748.003µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.665215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.645015ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.909408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.975312ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 815.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.883907ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.397518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 844.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.982808ms [martini] Started GET /api/raft-follower-health-report/e89d1b6a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 918.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.465915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.107205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.885108ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.167446ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.44071ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.832328ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.273535ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 801.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.941408ms [martini] Started GET /api/lb-check for 10.1.1.81:34246 [martini] Completed 200 OK in 607.203µs [martini] Started GET /api/raft-health for 10.1.1.81:34272 [martini] Completed 200 OK in 893.804µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.150421ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.49381ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28771ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.544528ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 962.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.764107ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.192014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 884.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.863508ms [martini] Started GET /api/raft-follower-health-report/c56b3172/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 667.802µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.897416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 836.003µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.252809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.804616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.919008ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28731ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.075313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 946.103µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.989308ms [martini] Started GET /api/lb-check for 10.1.1.81:34404 [martini] Completed 200 OK in 710.403µs [martini] Started GET /api/raft-health for 10.1.1.81:34436 [martini] Completed 200 OK in 731.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.717116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 894.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.068708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.338413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 908.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.957708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.497414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.009005ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.300622ms [martini] Started GET /api/raft-follower-health-report/515c93c8/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 729.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.477819ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.062404ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.079909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.377214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.057704ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.890007ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.928112ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 809.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.036209ms [martini] Started GET /api/lb-check for 10.1.1.81:34572 [martini] Completed 200 OK in 691.002µs [martini] Started GET /api/raft-health for 10.1.1.81:34586 [martini] Completed 200 OK in 809.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.973416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.389806ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.855716ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.994921ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 909.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.005108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.062737ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.447106ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.064108ms [martini] Started GET /api/raft-follower-health-report/04b5687f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 834.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.909116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 944.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.974737ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.870016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.737307ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.58011ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.029925ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.47151ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.112412ms [martini] Started GET /api/lb-check for 10.1.1.81:34710 [martini] Completed 200 OK in 732.803µs [martini] Started GET /api/raft-health for 10.1.1.81:34722 [martini] Completed 200 OK in 814.003µs 2018-11-29 06:11:11 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.452415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.198805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.986209ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.962412ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.199709ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.976933ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.586415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 908.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.626511ms 2018-11-29 06:11:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/cb34455f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 875.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.643715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.051805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.199409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.314118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.086005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.068908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.562615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 997.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.098713ms [martini] Started GET /api/lb-check for 10.1.1.81:34870 [martini] Completed 200 OK in 856.603µs [martini] Started GET /api/raft-health for 10.1.1.81:34902 [martini] Completed 200 OK in 779.503µs 2018-11-29 06:11:23 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.750115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 847.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.675411ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.310018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 829.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.079309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.898116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 862.503µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.870608ms [martini] Started GET /api/raft-follower-health-report/30d3dc29/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 943.404µs 2018-11-29 06:11:29 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.099317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 876.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.806607ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.556114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 876.703µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.100009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.963329ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 933.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.062408ms [martini] Started GET /api/lb-check for 10.1.1.81:35032 [martini] Completed 200 OK in 717.603µs [martini] Started GET /api/raft-health for 10.1.1.81:35044 [martini] Completed 200 OK in 793.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.437619ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 850.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.097312ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.712137ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 861.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.988309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.456419ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.021105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.912808ms [martini] Started GET /api/raft-follower-health-report/4b90c5a3/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 755.203µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.776716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 805.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.981008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.486223ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.578615ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25511ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.572327ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.736211ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.888308ms [martini] Started GET /api/lb-check for 10.1.1.81:35170 [martini] Completed 200 OK in 666.702µs [martini] Started GET /api/raft-health for 10.1.1.81:35182 [martini] Completed 200 OK in 756.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.750615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.074204ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.035609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.130914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.070305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.114009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.149513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 839.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.900408ms [martini] Started GET /api/raft-follower-health-report/090d2ad3/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 883.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 13.290955ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.041104ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.905312ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.316014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 999.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.487411ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.657224ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 893.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.773019ms [martini] Started GET /api/lb-check for 10.1.1.81:35320 [martini] Completed 200 OK in 894.904µs [martini] Started GET /api/raft-health for 10.1.1.81:35336 [martini] Completed 200 OK in 683.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.794415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 949.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.044609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.281713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.478406ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.013308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.793516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 949.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.884408ms [martini] Started GET /api/raft-follower-health-report/6dd56784/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 902.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.442914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 923.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.651715ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.554828ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 894.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.386218ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 15.226963ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 945.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.163809ms [martini] Started GET /api/lb-check for 10.1.1.81:35470 [martini] Completed 200 OK in 685.903µs [martini] Started GET /api/raft-health for 10.1.1.81:35498 [martini] Completed 200 OK in 1.153405ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.832415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 929.503µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.094208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.280822ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 928.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.070909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.81612ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.721015ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.198609ms [martini] Started GET /api/raft-follower-health-report/d24a02d9/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 920.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.705215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 847.203µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.252509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 12.13315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.996713ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22061ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.174146ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.398514ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 21.717591ms [martini] Started GET /api/lb-check for 10.1.1.81:35626 [martini] Completed 200 OK in 905.104µs [martini] Started GET /api/raft-health for 10.1.1.81:35638 [martini] Completed 200 OK in 733.703µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.385918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 898.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.237309ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.602015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.029804ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.874708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.620515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.161905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.862807ms 2018-11-29 06:12:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 06:12:17 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/c1e6c96e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 694.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.379122ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.861212ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.290909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.483814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 974.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.802508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.231114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.130404ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.736811ms [martini] Started GET /api/lb-check for 10.1.1.81:35790 [martini] Completed 200 OK in 659.003µs [martini] Started GET /api/raft-health for 10.1.1.81:35806 [martini] Completed 200 OK in 713.803µs 2018-11-29 06:12:23 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.629615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 916.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27801ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.521614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 6.975129ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.945508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.712811ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 827.703µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.168309ms [martini] Started GET /api/raft-follower-health-report/6956531a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 861.504µs 2018-11-29 06:12:29 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.024317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 786.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.45751ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.260822ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.074904ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31661ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.713115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 21.787891ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.000808ms [martini] Started GET /api/lb-check for 10.1.1.81:35932 [martini] Completed 200 OK in 1.227105ms [martini] Started GET /api/raft-health for 10.1.1.81:35944 [martini] Completed 200 OK in 746.003µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.059717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.150605ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.50641ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.980625ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.081705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.39891ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.461019ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.466006ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.35271ms [martini] Started GET /api/raft-follower-health-report/7085936d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 2.166509ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.156517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 970.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.033908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.864441ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 850.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.859108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.334514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 956.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.069309ms [martini] Started GET /api/lb-check for 10.1.1.81:36074 [martini] Completed 200 OK in 1.082204ms [martini] Started GET /api/raft-health for 10.1.1.81:36098 [martini] Completed 200 OK in 749.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.82182ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.202005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.166817ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.555415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 919.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.998708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.471415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 888.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.029108ms [martini] Started GET /api/raft-follower-health-report/77b8eada/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 820.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.594915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 982.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.014908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.165913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 990.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.099609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.589819ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.650507ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.965908ms [martini] Started GET /api/lb-check for 10.1.1.81:36236 [martini] Completed 200 OK in 597.103µs [martini] Started GET /api/raft-health for 10.1.1.81:36252 [martini] Completed 200 OK in 708.503µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.855116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.266206ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.175109ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.445414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.022204ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.094309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.719516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 963.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.954708ms [martini] Started GET /api/raft-follower-health-report/e48b5e5c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 799.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.684915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.084805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.139909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.588815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 842.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.132209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.333714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 915.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.134608ms [martini] Started GET /api/lb-check for 10.1.1.81:36386 [martini] Completed 200 OK in 725.503µs [martini] Started GET /api/raft-health for 10.1.1.81:36398 [martini] Completed 200 OK in 841.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.80572ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 758.603µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.012508ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.690924ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 918.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.128609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.876321ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 983.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.294509ms [martini] Started GET /api/raft-follower-health-report/181d0cd9/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 850.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.675015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.006205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.049309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.508019ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 9.482739ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.928712ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.925125ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 938.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.978808ms [martini] Started GET /api/lb-check for 10.1.1.81:36532 [martini] Completed 200 OK in 658.202µs [martini] Started GET /api/raft-health for 10.1.1.81:36552 [martini] Completed 200 OK in 721.603µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.691915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.097105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.157909ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.484714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 965.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.058209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.528515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.039104ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.681736ms 2018-11-29 06:13:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 06:13:17 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/1f4fc077/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 657.503µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.044317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.061505ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.273809ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.352914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 996.205µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.323309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.91982ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.031005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.950909ms [martini] Started GET /api/lb-check for 10.1.1.81:36690 [martini] Completed 200 OK in 1.051905ms [martini] Started GET /api/raft-health for 10.1.1.81:36722 [martini] Completed 200 OK in 800.103µs 2018-11-29 06:13:23 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.663715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 910.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.081509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.254014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.065404ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.900108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.310413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 804.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.951508ms [martini] Started GET /api/raft-follower-health-report/34b2cbe6/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 928.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.88872ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.409806ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.78462ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.833833ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 827.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.072008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.048713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 825.103µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.015509ms [martini] Started GET /api/lb-check for 10.1.1.81:36852 [martini] Completed 200 OK in 627.203µs [martini] Started GET /api/raft-health for 10.1.1.81:36862 [martini] Completed 200 OK in 775.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.216214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.086305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.061709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.972029ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 927.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.374331ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.348219ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.294805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31631ms 2018-11-29 06:13:35 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/68606bab/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 731.903µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.812337ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.138804ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.720111ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 14.37226ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.146005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.45161ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.267818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.241005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.406511ms [martini] Started GET /api/lb-check for 10.1.1.81:36994 [martini] Completed 200 OK in 2.34521ms [martini] Started GET /api/raft-health for 10.1.1.81:37006 [martini] Completed 200 OK in 899.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.385514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 968.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.193709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.287314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 937.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.130209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.560515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 841.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.161609ms [martini] Started GET /api/raft-follower-health-report/affa8e70/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 2.904712ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.130817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.690907ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.144509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.887417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 803.703µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.072608ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.143913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 801.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.040609ms [martini] Started GET /api/lb-check for 10.1.1.81:37134 [martini] Completed 200 OK in 620.403µs [martini] Started GET /api/raft-health for 10.1.1.81:37170 [martini] Completed 200 OK in 831.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.296914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.042905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.64812ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.548914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 752.003µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.873208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.049212ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 852.103µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.918008ms [martini] Started GET /api/raft-follower-health-report/158894ef/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 609.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.409619ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 938.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.941409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.282214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 866.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.160809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.78862ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.748212ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.031908ms [martini] Started GET /api/lb-check for 10.1.1.81:37294 [martini] Completed 200 OK in 857.303µs [martini] Started GET /api/raft-health for 10.1.1.81:37320 [martini] Completed 200 OK in 781.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.431815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.133505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.031208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.73682ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 933.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26551ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.214918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 819.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.216609ms [martini] Started GET /api/raft-follower-health-report/07e0cc3b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 687.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.520215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 998.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.149209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 12.754153ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 818.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.031209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.190417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 894.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.615511ms [martini] Started GET /api/lb-check for 10.1.1.81:37452 [martini] Completed 200 OK in 861.403µs [martini] Started GET /api/raft-health for 10.1.1.81:37462 [martini] Completed 200 OK in 714.303µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.535924ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.599007ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29601ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.194914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 893.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.786307ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.003513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 794.003µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.007709ms 2018-11-29 06:14:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/6efa9a46/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 749.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.891716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 951.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.248909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.374814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.809612ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.992009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.483315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.158805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.138809ms [martini] Started GET /api/lb-check for 10.1.1.81:37604 [martini] Completed 200 OK in 860.603µs [martini] Started GET /api/raft-health for 10.1.1.81:37622 [martini] Completed 200 OK in 1.037104ms 2018-11-29 06:14:23 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.360114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.145105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26411ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.372114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 855.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.448211ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.238014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.447806ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.240126ms [martini] Started GET /api/raft-follower-health-report/83214b8f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 871.004µs 2018-11-29 06:14:29 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.359914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.047405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.39131ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.145017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 843.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.808224ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.113814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 710.503µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.960808ms [martini] Started GET /api/lb-check for 10.1.1.81:37756 [martini] Completed 200 OK in 857.504µs [martini] Started GET /api/raft-health for 10.1.1.81:37780 [martini] Completed 200 OK in 782.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.734316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 939.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.35591ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.112521ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 964.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.046108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.626024ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.285306ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.028608ms 2018-11-29 06:14:35 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/c1cde3b8/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 742.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.456914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 914.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.685615ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.219818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 868.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.489411ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.540524ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.334106ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.835312ms [martini] Started GET /api/lb-check for 10.1.1.81:37916 [martini] Completed 200 OK in 673.503µs [martini] Started GET /api/raft-health for 10.1.1.81:37928 [martini] Completed 200 OK in 710.302µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.363314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 892.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.111209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.408115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 818.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.937708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 12.327552ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 920.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.901908ms [martini] Started GET /api/raft-follower-health-report/5c26ee86/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.705307ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.449214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 947.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.534114ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.007013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.149805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.147109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.419823ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 878.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.38551ms [martini] Started GET /api/lb-check for 10.1.1.81:38060 [martini] Completed 200 OK in 1.819708ms [martini] Started GET /api/raft-health for 10.1.1.81:38076 [martini] Completed 200 OK in 1.022804ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.563115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 971.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.46191ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.624316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.055304ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.136109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.191414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 871.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.999909ms [martini] Started GET /api/raft-follower-health-report/2470751f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 763.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.761216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.096405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.343214ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.318514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.002204ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.797208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.890112ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 890.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.098709ms [martini] Started GET /api/lb-check for 10.1.1.81:38220 [martini] Completed 200 OK in 790.903µs [martini] Started GET /api/raft-health for 10.1.1.81:38234 [martini] Completed 200 OK in 870.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.664816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.037105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.110709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.673441ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 747.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.095508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.953717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 881.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.284909ms [martini] Started GET /api/raft-follower-health-report/7e355935/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 795.703µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.544515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 902.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.222009ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.781033ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 832.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.697807ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 15.238964ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.79352ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28371ms [martini] Started GET /api/lb-check for 10.1.1.81:38378 [martini] Completed 200 OK in 861.703µs [martini] Started GET /api/raft-health for 10.1.1.81:38402 [martini] Completed 200 OK in 714.303µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.599315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.309906ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.841008ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.019113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.021304ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.873208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.175914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 907.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.019809ms 2018-11-29 06:15:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/88076f9f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 790.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.397014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.044805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.018408ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.395314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 904.703µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.164309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.092413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 855.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.946408ms [martini] Started GET /api/lb-check for 10.1.1.81:38552 [martini] Completed 200 OK in 703.703µs [martini] Started GET /api/raft-health for 10.1.1.81:38568 [martini] Completed 200 OK in 630.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.010117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 870.703µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31371ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.691716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 883.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.952008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.553315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.096305ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.910408ms [martini] Started GET /api/raft-follower-health-report/3e212938/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 725.903µs 2018-11-29 06:15:29 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 06:15:29 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.246313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.711807ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.618432ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.256718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 751.603µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.440111ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.110313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 898.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.86962ms [martini] Started GET /api/lb-check for 10.1.1.81:38706 [martini] Completed 200 OK in 1.013004ms [martini] Started GET /api/raft-health for 10.1.1.81:38720 [martini] Completed 200 OK in 670.903µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.449914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 896.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.884813ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.232314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.275906ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.904808ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.004847ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 898.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.996513ms [martini] Started GET /api/raft-follower-health-report/739b8de0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 800.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.742616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.012504ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.166709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.38874ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.314109ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.33841ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.313618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.376606ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.821608ms [martini] Started GET /api/lb-check for 10.1.1.81:38856 [martini] Completed 200 OK in 719.303µs [martini] Started GET /api/raft-health for 10.1.1.81:38866 [martini] Completed 200 OK in 2.905212ms 2018-11-29 06:15:41 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.784916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.060005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.148409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.628616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.040304ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.106709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.370314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 968.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.982309ms [martini] Started GET /api/raft-follower-health-report/2efc0203/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 841.304µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 12.435153ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.441915ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.669911ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.437014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 817.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.937908ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.323014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 833.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.938709ms [martini] Started GET /api/lb-check for 10.1.1.81:38998 [martini] Completed 200 OK in 618.903µs [martini] Started GET /api/raft-health for 10.1.1.81:39032 [martini] Completed 200 OK in 863.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.981816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.118305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.077309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.562115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.616111ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.727216ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.247813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 824.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.740507ms [martini] Started GET /api/raft-follower-health-report/bd6f7e03/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 967.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.435119ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 950.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.211109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.401115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 850.703µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.092609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.125013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.095404ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.020921ms [martini] Started GET /api/lb-check for 10.1.1.81:39172 [martini] Completed 200 OK in 782.604µs [martini] Started GET /api/raft-health for 10.1.1.81:39186 [martini] Completed 200 OK in 1.021604ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.839816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.082104ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.203309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.043921ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.279705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.049308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.654516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.286806ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.405311ms [martini] Started GET /api/raft-follower-health-report/9776afb3/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 734.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.862116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.033304ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.158509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.856637ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 864.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.871708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.639928ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.090705ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.592311ms [martini] Started GET /api/lb-check for 10.1.1.81:39336 [martini] Completed 200 OK in 853.003µs [martini] Started GET /api/raft-health for 10.1.1.81:39350 [martini] Completed 200 OK in 833.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.910616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.120305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.590615ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.448314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.086505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.014408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.207513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 900.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.073409ms 2018-11-29 06:16:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/f0b16219/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.099505ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.067717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.068805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.283709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.299514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 906.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.40181ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 13.387157ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 875.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.15491ms [martini] Started GET /api/lb-check for 10.1.1.81:39494 [martini] Completed 200 OK in 621.202µs [martini] Started GET /api/raft-health for 10.1.1.81:39522 [martini] Completed 200 OK in 703.503µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.906716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.271405ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.118709ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.177214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.114604ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.009209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.494315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 882.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.808716ms [martini] Started GET /api/raft-follower-health-report/68c9534b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 673.603µs 2018-11-29 06:16:29 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 06:16:29 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.640215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 939.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.998208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.263218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.204706ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.37541ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.442114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 880.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.087209ms [martini] Started GET /api/lb-check for 10.1.1.81:39660 [martini] Completed 200 OK in 698.803µs [martini] Started GET /api/raft-health for 10.1.1.81:39686 [martini] Completed 200 OK in 936.704µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.372819ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.104304ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.078408ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.63812ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.180305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.124809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.252118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 891.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.875808ms [martini] Started GET /api/raft-follower-health-report/a60bf442/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 919.704µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.714616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.166305ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26551ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 14.689662ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 856.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.17041ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.804424ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.360406ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25631ms [martini] Started GET /api/lb-check for 10.1.1.81:39814 [martini] Completed 200 OK in 734.703µs [martini] Started GET /api/raft-health for 10.1.1.81:39828 [martini] Completed 200 OK in 778.104µs 2018-11-29 06:16:41 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.037317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.040504ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.35371ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.280814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 909.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.346115ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.790916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 776.103µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.175209ms [martini] Started GET /api/raft-follower-health-report/b993252f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 784.704µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.138517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.167705ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.590511ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.220114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 903.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.003208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.435914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.371811ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.140226ms [martini] Started GET /api/lb-check for 10.1.1.81:39956 [martini] Completed 200 OK in 1.580007ms [martini] Started GET /api/raft-health for 10.1.1.81:39972 [martini] Completed 200 OK in 745.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.318614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 951.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.699007ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.321614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.49621ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.882208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.275313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.627907ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.780908ms [martini] Started GET /api/raft-follower-health-report/a9ec6796/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 843.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.127217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 996.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22501ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.297714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 947.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.57351ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.133617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.045404ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.42521ms [martini] Started GET /api/lb-check for 10.1.1.81:40114 [martini] Completed 200 OK in 713.203µs [martini] Started GET /api/raft-health for 10.1.1.81:40140 [martini] Completed 200 OK in 714.803µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.118917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 807.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.262509ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.664136ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.053409ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31921ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.712416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 793.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.723012ms [martini] Started GET /api/raft-follower-health-report/b0db6660/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 689.903µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.604115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.054604ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.120409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.213339ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.529707ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.060009ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.377714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.002408ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.890917ms [martini] Started GET /api/lb-check for 10.1.1.81:40272 [martini] Completed 200 OK in 1.305105ms [martini] Started GET /api/raft-health for 10.1.1.81:40290 [martini] Completed 200 OK in 897.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.384318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.072105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.419911ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.172314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 953.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.967208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.076413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 837.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.961708ms 2018-11-29 06:17:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/90bcf9d0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.030905ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 14.484261ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 944.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.51971ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.508415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 770.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.057209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.104121ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 859.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.159309ms [martini] Started GET /api/lb-check for 10.1.1.81:40432 [martini] Completed 200 OK in 615.703µs [martini] Started GET /api/raft-health for 10.1.1.81:40448 [martini] Completed 200 OK in 910.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 15.071364ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.933808ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.212009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.78842ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 905.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.483711ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.503515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.004505ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.36221ms [martini] Started GET /api/raft-follower-health-report/36cbfcfb/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 864.003µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.071417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 867.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.076309ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.248031ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.348905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.182509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.11293ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.207405ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.025008ms [martini] Started GET /api/lb-check for 10.1.1.81:40586 [martini] Completed 200 OK in 748.203µs [martini] Started GET /api/raft-health for 10.1.1.81:40598 [martini] Completed 200 OK in 689.702µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.405915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 979.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.36521ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.983513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.292209ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.880108ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.276318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 910.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.637124ms 2018-11-29 06:17:35 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 06:17:35 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/1f74c67c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 764.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.882216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 992.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.24171ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.475314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 824.003µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.156518ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.434214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.260105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.912212ms [martini] Started GET /api/lb-check for 10.1.1.81:40736 [martini] Completed 200 OK in 966.604µs [martini] Started GET /api/raft-health for 10.1.1.81:40764 [martini] Completed 200 OK in 888.404µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.089817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 999.305µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.36021ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.974213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 835.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.804408ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.376014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 930.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.962808ms 2018-11-29 06:17:47 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/6f4b195c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 799.503µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.063421ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 919.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.955008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.372114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 943.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.031608ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.275414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 804.203µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.178409ms [martini] Started GET /api/lb-check for 10.1.1.81:40894 [martini] Completed 200 OK in 829.504µs [martini] Started GET /api/raft-health for 10.1.1.81:40910 [martini] Completed 200 OK in 697.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.656015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 924.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.38551ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.62202ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.792707ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27351ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.139314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.096605ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.951109ms [martini] Started GET /api/raft-follower-health-report/d1347453/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.186105ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.65822ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.186709ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.968016ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.495723ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 798.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.886108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.220814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 745.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.492824ms [martini] Started GET /api/lb-check for 10.1.1.81:41058 [martini] Completed 200 OK in 1.004404ms [martini] Started GET /api/raft-health for 10.1.1.81:41072 [martini] Completed 200 OK in 902.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.951817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.472806ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.159209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.65502ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.990617ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.961408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.113722ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.176505ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.37291ms [martini] Started GET /api/raft-follower-health-report/facfb4c1/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.330405ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.593619ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.323406ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.104009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.309314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.006404ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.022909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.620741ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.291205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.895708ms [martini] Started GET /api/lb-check for 10.1.1.81:41208 [martini] Completed 200 OK in 724.503µs [martini] Started GET /api/raft-health for 10.1.1.81:41220 [martini] Completed 200 OK in 750.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.17183ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 904.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.032913ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.528615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.019005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.027809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.978313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 811.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.894908ms 2018-11-29 06:18:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/0c82c0d8/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 785.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.512819ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.238205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.893713ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.12623ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 10.772446ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.84122ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.131021ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 949.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.85312ms [martini] Started GET /api/lb-check for 10.1.1.81:41370 [martini] Completed 200 OK in 770.003µs [martini] Started GET /api/raft-health for 10.1.1.81:41400 [martini] Completed 200 OK in 648.202µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.903016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.326106ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.123909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.610115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 805.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.681411ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.939013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 998.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.564837ms [martini] Started GET /api/raft-follower-health-report/8dc3d821/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 798.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.078313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.057205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.027613ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.957012ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.471806ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.812207ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.135914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 879.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.918608ms [martini] Started GET /api/lb-check for 10.1.1.81:41542 [martini] Completed 200 OK in 620.303µs [martini] Started GET /api/raft-health for 10.1.1.81:41554 [martini] Completed 200 OK in 1.098904ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.812229ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.834308ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.147309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.726633ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 906.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.24101ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.426519ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.857308ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.080008ms 2018-11-29 06:18:35 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/16fda265/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 856.104µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.740716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27681ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.913913ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 18.68718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.087709ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.038109ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.272235ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 855.303µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28461ms [martini] Started GET /api/lb-check for 10.1.1.81:41688 [martini] Completed 200 OK in 850.804µs [martini] Started GET /api/raft-health for 10.1.1.81:41700 [martini] Completed 200 OK in 878.003µs 2018-11-29 06:18:41 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.731816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.922308ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.067209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.211214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.207406ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.599541ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.119413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 958.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.168309ms [martini] Started GET /api/raft-follower-health-report/1330f351/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 624.703µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.665816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.157705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.507511ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.894116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 756.103µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.140113ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.811616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 927.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.395636ms [martini] Started GET /api/lb-check for 10.1.1.81:41830 [martini] Completed 200 OK in 580.203µs [martini] Started GET /api/raft-health for 10.1.1.81:41846 [martini] Completed 200 OK in 740.603µs 2018-11-29 06:18:53 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.043217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.027504ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.30161ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.749416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 946.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.033509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.885116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.262805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.291409ms [martini] Started GET /api/raft-follower-health-report/22030fd0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 650.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.685816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 912.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.098809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.022943ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 985.305µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.101509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.397614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 825.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.903308ms [martini] Started GET /api/lb-check for 10.1.1.81:41986 [martini] Completed 200 OK in 1.018805ms [martini] Started GET /api/raft-health for 10.1.1.81:42018 [martini] Completed 200 OK in 659.403µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.533615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 820.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.724724ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.156739ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.418206ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.957008ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.944313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 983.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.078309ms [martini] Started GET /api/raft-follower-health-report/6db98fbd/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 752.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.191113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 878.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.30691ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 25.099806ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.195014ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.452749ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.346415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 861.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.010708ms [martini] Started GET /api/lb-check for 10.1.1.81:42150 [martini] Completed 200 OK in 689.103µs [martini] Started GET /api/raft-health for 10.1.1.81:42162 [martini] Completed 200 OK in 667.406µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.607331ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.104809ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.070918ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.289429ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.027609ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.131519ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.262328ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 906.008µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.888316ms 2018-11-29 06:19:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/2d2323bb/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 689.706µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.798729ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 984.507µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.067715ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.789529ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.142309ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.208417ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.753628ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.050208ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.098223ms [martini] Started GET /api/lb-check for 10.1.1.81:42310 [martini] Completed 200 OK in 835.007µs [martini] Started GET /api/raft-health for 10.1.1.81:42326 [martini] Completed 200 OK in 666.505µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.008635ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 929.607µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.309123ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.426523ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 886.606µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.984214ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.195122ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 778.505µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.014013ms [martini] Started GET /api/raft-follower-health-report/8c5765ec/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 838.206µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.367421ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 6.176639ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.169339ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.12422ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 867.505µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.824811ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.950931ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 746.505µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.896112ms [martini] Started GET /api/lb-check for 10.1.1.81:42458 [martini] Completed 200 OK in 660.104µs [martini] Started GET /api/raft-health for 10.1.1.81:42484 [martini] Completed 200 OK in 686.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.748123ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.025506ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.175613ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.48872ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.045906ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.192413ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 12.956577ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 864.405µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.945711ms 2018-11-29 06:19:35 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/8e66de5d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 806.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.255619ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 873.405µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.087911ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 16.687294ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 884.905µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.503314ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.941422ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.296118ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.198612ms [martini] Started GET /api/lb-check for 10.1.1.81:42602 [martini] Completed 200 OK in 3.053717ms [martini] Started GET /api/raft-health for 10.1.1.81:42628 [martini] Completed 200 OK in 953.705µs 2018-11-29 06:19:41 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.841021ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 858.805µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.355212ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.113217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 942.905µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.93891ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.186417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 797.805µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.90001ms [martini] Started GET /api/raft-follower-health-report/08bdfeb6/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 756.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.870421ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.129906ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.146811ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.700019ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 768.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.784109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.972126ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.096806ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.52213ms [martini] Started GET /api/lb-check for 10.1.1.81:42758 [martini] Completed 200 OK in 717.503µs [martini] Started GET /api/raft-health for 10.1.1.81:42774 [martini] Completed 200 OK in 678.703µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.165322ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.026306ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.580239ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.262117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 987.005µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.043711ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.477718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 892.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.283112ms [martini] Started GET /api/raft-follower-health-report/b8db9a86/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 706.404µs 2018-11-29 06:19:59 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.231022ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 966.905µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.95753ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.981841ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.88131ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.004741ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 43.901125ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 955.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.999115ms [martini] Started GET /api/lb-check for 10.1.1.81:42918 [martini] Completed 200 OK in 766.604µs [martini] Started GET /api/raft-health for 10.1.1.81:42934 [martini] Completed 200 OK in 717.904µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.511018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 904.405µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.040311ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.480717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 842.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.92591ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.608219ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.726909ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.14841ms [martini] Started GET /api/raft-follower-health-report/b941141c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 633.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.893019ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.048505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.351512ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.484917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 897.005µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.88231ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.340122ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.229907ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.09351ms [martini] Started GET /api/lb-check for 10.1.1.81:43066 [martini] Completed 200 OK in 593.103µs [martini] Started GET /api/raft-health for 10.1.1.81:43092 [martini] Completed 200 OK in 671.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.960855ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 951.51µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.958522ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.386438ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 695.708µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.693219ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.084234ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 896.01µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.075723ms 2018-11-29 06:20:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/4178de3b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.081711ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.315944ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.04091ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.95834ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.137542ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 814.408µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.894619ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.491146ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 769.208µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.787618ms [martini] Started GET /api/lb-check for 10.1.1.81:43224 [martini] Completed 200 OK in 1.180612ms [martini] Started GET /api/raft-health for 10.1.1.81:43254 [martini] Completed 200 OK in 702.907µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.015157ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 943.009µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.443623ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.502591ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 821.108µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.586425ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.960228ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 712.107µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.880418ms [martini] Started GET /api/raft-follower-health-report/11847267/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 736.706µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.223838ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 844.907µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.066018ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.41334ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 936.408µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16162ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.536031ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 794.607µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.054419ms [martini] Started GET /api/lb-check for 10.1.1.81:43382 [martini] Completed 200 OK in 985.208µs [martini] Started GET /api/raft-health for 10.1.1.81:43398 [martini] Completed 200 OK in 782.207µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.318137ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.131009ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.021617ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.029643ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 853.707µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.32842ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.71764ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.021208ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.070517ms 2018-11-29 06:20:35 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/640db788/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 769.007µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.52946ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.51252ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.51422ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.685929ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 921.307µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.087417ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.525344ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.030008ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.924616ms [martini] Started GET /api/lb-check for 10.1.1.81:43534 [martini] Completed 200 OK in 824.206µs [martini] Started GET /api/raft-health for 10.1.1.81:43552 [martini] Completed 200 OK in 776.406µs 2018-11-29 06:20:41 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.210732ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.005908ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.210017ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.229324ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 6.284848ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.159332ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.128624ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 919.307µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.959615ms [martini] Started GET /api/raft-follower-health-report/69ae768a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 869.807µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.813028ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.008407ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.166916ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.580426ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.868728ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.404318ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.162024ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 940.207µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.488225ms [martini] Started GET /api/lb-check for 10.1.1.81:43684 [martini] Completed 200 OK in 798.506µs [martini] Started GET /api/raft-health for 10.1.1.81:43714 [martini] Completed 200 OK in 930.506µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.131729ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 973.307µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.908014ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.334123ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 953.607µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.864413ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.293823ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 900.607µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.754112ms [martini] Started GET /api/raft-follower-health-report/491b5143/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 962.207µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.670526ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 967.906µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.035814ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.402323ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 921.706µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.274923ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.099942ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 868.006µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.989914ms [martini] Started GET /api/lb-check for 10.1.1.81:43866 [martini] Completed 200 OK in 882.606µs [martini] Started GET /api/raft-health for 10.1.1.81:43884 [martini] Completed 200 OK in 1.791412ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.535223ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 955.806µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.844926ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.517837ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 788.706µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.086014ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.482123ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.336408ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.396616ms 2018-11-29 06:21:05 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/ee88d373/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 807.105µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.714924ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.057207ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.992513ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.490949ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.008307ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.973913ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 13.488889ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.44751ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.620117ms [martini] Started GET /api/lb-check for 10.1.1.81:44026 [martini] Completed 200 OK in 717.105µs [martini] Started GET /api/raft-health for 10.1.1.81:44036 [martini] Completed 200 OK in 723.705µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.858824ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.161008ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.180014ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.14642ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 886.906µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.959412ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.203121ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 858.805µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.022813ms 2018-11-29 06:21:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/a594b701/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 800.305µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.528222ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.209907ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.178313ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.15862ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.723617ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.596016ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.972025ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 951.106µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.814712ms [martini] Started GET /api/lb-check for 10.1.1.81:44176 [martini] Completed 200 OK in 697.304µs [martini] Started GET /api/raft-health for 10.1.1.81:44192 [martini] Completed 200 OK in 727.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.741223ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.122907ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.066813ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.958525ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 888.806µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.075213ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.125219ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 951.005µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.866912ms [martini] Started GET /api/raft-follower-health-report/57713a0c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.022606ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.995436ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.106507ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.252757ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.911529ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 864.506µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.303114ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.34502ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 893.706µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.177313ms [martini] Started GET /api/lb-check for 10.1.1.81:44322 [martini] Completed 200 OK in 961.806µs [martini] Started GET /api/raft-health for 10.1.1.81:44348 [martini] Completed 200 OK in 735.004µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.584522ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 802.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.430915ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.370332ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.343008ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.586315ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.471033ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.125425ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.572322ms [martini] Started GET /api/raft-follower-health-report/9b10abe6/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 901.106µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.799123ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 969.506µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.993412ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.852923ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.217207ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.33242ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.328644ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.250813ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.971511ms [martini] Started GET /api/lb-check for 10.1.1.81:44484 [martini] Completed 200 OK in 628.503µs [martini] Started GET /api/raft-health for 10.1.1.81:44494 [martini] Completed 200 OK in 654.804µs 2018-11-29 06:21:41 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.447021ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.022206ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.113912ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.609621ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.270107ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.020112ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.172119ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 918.106µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.097512ms 2018-11-29 06:21:47 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/4ffaa795/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 820.205µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.728822ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 9.448255ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.217919ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.727722ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 925.306µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.952211ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.100618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.022806ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.985712ms [martini] Started GET /api/lb-check for 10.1.1.81:44618 [martini] Completed 200 OK in 896.905µs [martini] Started GET /api/raft-health for 10.1.1.81:44634 [martini] Completed 200 OK in 775.505µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.131724ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.124406ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.725816ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.22383ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 908.905µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.912311ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.070418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 875.605µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.68411ms [martini] Started GET /api/raft-follower-health-report/bb2bbf7b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 790.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.565821ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 989.706µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.409414ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.774922ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 823.605µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.882511ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.819022ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 10.740063ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.150312ms [martini] Started GET /api/lb-check for 10.1.1.81:44766 [martini] Completed 200 OK in 898.205µs [martini] Started GET /api/raft-health for 10.1.1.81:44780 [martini] Completed 200 OK in 670.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.59872ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.502309ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.78421ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.914928ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 996.205µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.275642ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.947328ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.062007ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.991112ms [martini] Started GET /api/raft-follower-health-report/744cce27/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 669.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.029923ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.014505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.364713ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.733227ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 972.706µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.261513ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.972923ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.639209ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.034112ms [martini] Started GET /api/lb-check for 10.1.1.81:44910 [martini] Completed 200 OK in 780.604µs [martini] Started GET /api/raft-health for 10.1.1.81:44936 [martini] Completed 200 OK in 822.004µs 2018-11-29 06:22:11 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.722039ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.184807ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.133912ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.132818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 918.806µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.127712ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.870723ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 873.905µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.121512ms 2018-11-29 06:22:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/ba14637f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 775.605µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.299018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 815.705µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.910911ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.094918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 9.223353ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.219052ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.564337ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.137206ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.781733ms [martini] Started GET /api/lb-check for 10.1.1.81:45076 [martini] Completed 200 OK in 1.052906ms [martini] Started GET /api/raft-health for 10.1.1.81:45092 [martini] Completed 200 OK in 620.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.76701ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 869.502µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.352706ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.309109ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 953.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.096405ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.111008ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 947.203µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.141413ms [martini] Started GET /api/raft-follower-health-report/86b881ef/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 656.002µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.54431ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 866.202µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.080906ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.263912ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.061503ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.132306ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.671711ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 958.103µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.921911ms [martini] Started GET /api/lb-check for 10.1.1.81:45222 [martini] Completed 200 OK in 683.402µs [martini] Started GET /api/raft-health for 10.1.1.81:45236 [martini] Completed 200 OK in 707.002µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.907612ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 903.903µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.584608ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.151516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.014403ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.193806ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.283418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.147903ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.708208ms [martini] Started GET /api/raft-follower-health-report/a2756122/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 684.702µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.379311ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.041103ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 12.71724ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.610524ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.036403ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.063207ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.429914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 847.002µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.089507ms [martini] Started GET /api/lb-check for 10.1.1.81:45368 [martini] Completed 200 OK in 576.602µs [martini] Started GET /api/raft-health for 10.1.1.81:45380 [martini] Completed 200 OK in 802.502µs 2018-11-29 06:22:41 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.421511ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.106307ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.310107ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.625612ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.954207ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.958006ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.224711ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 839.103µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.827506ms 2018-11-29 06:22:47 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/707579d5/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 821.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.216211ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 902.903µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.230207ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.747913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.459305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.91591ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.762113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.081404ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.406618ms [martini] Started GET /api/lb-check for 10.1.1.81:45522 [martini] Completed 200 OK in 855.503µs [martini] Started GET /api/raft-health for 10.1.1.81:45554 [martini] Completed 200 OK in 828.403µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.080614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.150104ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.945007ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.345312ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 885.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.060507ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.442213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 949.903µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.943007ms [martini] Started GET /api/raft-follower-health-report/ac6eb68a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 998.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.993315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 998.003µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.177812ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.643817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 907.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.332409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.259912ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.064004ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.58701ms [martini] Started GET /api/lb-check for 10.1.1.81:45690 [martini] Completed 200 OK in 590.102µs [martini] Started GET /api/raft-health for 10.1.1.81:45704 [martini] Completed 200 OK in 841.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.990616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 873.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.457736ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.783222ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 971.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.840607ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.425717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 925.103µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.990108ms [martini] Started GET /api/raft-follower-health-report/ff3a0d0a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 839.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.525914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.198005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.074708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.345213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 754.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.157017ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.436818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 916.103µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.929711ms [martini] Started GET /api/lb-check for 10.1.1.81:45838 [martini] Completed 200 OK in 735.103µs [martini] Started GET /api/raft-health for 10.1.1.81:45850 [martini] Completed 200 OK in 732.803µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.966316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 980.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.981208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.988812ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 888.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.057609ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.376913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 942.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.253009ms 2018-11-29 06:23:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 06:23:17 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/e2e3b191/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 762.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.714615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.046804ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.932908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.137329ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.945612ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.588511ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.125113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 857.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.883707ms [martini] Started GET /api/lb-check for 10.1.1.81:45994 [martini] Completed 200 OK in 1.015104ms [martini] Started GET /api/raft-health for 10.1.1.81:46024 [martini] Completed 200 OK in 662.802µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.598916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 996.405µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.016009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.311714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 860.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.042808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.084313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 947.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.167409ms [martini] Started GET /api/raft-follower-health-report/48c72f38/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 854.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.010218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.546211ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.652624ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.339418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 738.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.832108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.929413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 758.103µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.989508ms [martini] Started GET /api/lb-check for 10.1.1.81:46144 [martini] Completed 200 OK in 760.504µs [martini] Started GET /api/raft-health for 10.1.1.81:46170 [martini] Completed 200 OK in 838.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.043217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.144405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.031909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.405837ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.138505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.575612ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.125145ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.076309ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.379914ms [martini] Started GET /api/raft-follower-health-report/07f95c87/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 836.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.548616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.081505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.32681ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.655525ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.249706ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.715217ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.71192ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.319806ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.078309ms [martini] Started GET /api/lb-check for 10.1.1.81:46306 [martini] Completed 200 OK in 2.515711ms [martini] Started GET /api/raft-health for 10.1.1.81:46320 [martini] Completed 200 OK in 812.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.607516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.198505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.765712ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.407215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 864.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.987909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.255714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 995.605µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.966709ms 2018-11-29 06:23:47 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/03dbf9c0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.846108ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.128319ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 918.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.800412ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.876617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.048904ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.153923ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.243329ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 949.305µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18301ms [martini] Started GET /api/lb-check for 10.1.1.81:46452 [martini] Completed 200 OK in 750.403µs [martini] Started GET /api/raft-health for 10.1.1.81:46470 [martini] Completed 200 OK in 768.704µs 2018-11-29 06:23:53 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.888618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 955.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.022919ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.662517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 861.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.245011ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.169015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 916.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.826109ms [martini] Started GET /api/raft-follower-health-report/8aaf1d87/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 713.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.26462ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.865813ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.968718ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.28512ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 802.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.888809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.765846ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.584808ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.804308ms [martini] Started GET /api/lb-check for 10.1.1.81:46602 [martini] Completed 200 OK in 591.803µs [martini] Started GET /api/raft-health for 10.1.1.81:46630 [martini] Completed 200 OK in 696.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.645917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 982.205µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.199211ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.602921ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 881.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.928009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.328529ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 804.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.233311ms [martini] Started GET /api/raft-follower-health-report/e950743c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 838.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.761523ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.239505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.01821ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.530617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 923.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.011014ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.479949ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.257606ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.387011ms [martini] Started GET /api/lb-check for 10.1.1.81:46770 [martini] Completed 200 OK in 708.404µs [martini] Started GET /api/raft-health for 10.1.1.81:46782 [martini] Completed 200 OK in 699.203µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.767527ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.226406ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.946009ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.919714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 823.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.03811ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.474317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 841.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.733608ms 2018-11-29 06:24:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 06:24:17 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/995e1212/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 872.104µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.03402ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.043706ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.471622ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.479617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.693518ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.719932ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.151715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.386107ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.10101ms [martini] Started GET /api/lb-check for 10.1.1.81:46928 [martini] Completed 200 OK in 728.603µs [martini] Started GET /api/raft-health for 10.1.1.81:46944 [martini] Completed 200 OK in 685.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.09072ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 844.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.874309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.265621ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 910.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.945209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.034315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 853.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.030124ms [martini] Started GET /api/raft-follower-health-report/cb84de50/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 760.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.319521ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 933.205µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.92441ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.092325ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.127506ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.506212ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.308931ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 996.405µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.417012ms [martini] Started GET /api/lb-check for 10.1.1.81:47076 [martini] Completed 200 OK in 688.503µs [martini] Started GET /api/raft-health for 10.1.1.81:47088 [martini] Completed 200 OK in 748.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.99062ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.079505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.561422ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.675718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 970.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.445512ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.338016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 826.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.843309ms [martini] Started GET /api/raft-follower-health-report/4eb05529/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 902.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.09382ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 8.931644ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.501213ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.609118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 952.105µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.336711ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.168216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 926.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.13771ms [martini] Started GET /api/lb-check for 10.1.1.81:47224 [martini] Completed 200 OK in 649.603µs [martini] Started GET /api/raft-health for 10.1.1.81:47252 [martini] Completed 200 OK in 861.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.670518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.467207ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.990009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.522118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 986.705µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.694628ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.319217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.047405ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.948509ms 2018-11-29 06:24:47 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/7979afd7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.063605ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.178621ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.086205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.470942ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.88693ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 902.005µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.96751ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.061115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 817.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.359536ms [martini] Started GET /api/lb-check for 10.1.1.81:47380 [martini] Completed 200 OK in 819.604µs [martini] Started GET /api/raft-health for 10.1.1.81:47394 [martini] Completed 200 OK in 699.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.211721ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.053805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.862609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.330917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.192405ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.93941ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.187416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.036905ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.08691ms [martini] Started GET /api/raft-follower-health-report/2d8a2c72/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 744.804µs 2018-11-29 06:24:59 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.325522ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.542318ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.465212ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.042325ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.369307ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.159421ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.383517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 981.905µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.917809ms [martini] Started GET /api/lb-check for 10.1.1.81:47532 [martini] Completed 200 OK in 738.203µs [martini] Started GET /api/raft-health for 10.1.1.81:47544 [martini] Completed 200 OK in 897.405µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.570718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.079505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.92803ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.237216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 768.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.96711ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.935415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 918.905µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.734309ms [martini] Started GET /api/raft-follower-health-report/ed07cf89/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 686.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.86293ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 5.164926ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.920109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.72876ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.196106ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.482347ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.277526ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.688213ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.962615ms [martini] Started GET /api/lb-check for 10.1.1.81:47690 [martini] Completed 200 OK in 718.304µs [martini] Started GET /api/raft-health for 10.1.1.81:47702 [martini] Completed 200 OK in 915.304µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.87532ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 900.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.97251ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.840919ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 927.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.855909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.298917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 939.905µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.278911ms 2018-11-29 06:25:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 06:25:17 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/9c36bbb0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 894.305µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.658123ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 801.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.06201ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.870919ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.094506ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.369913ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.095921ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.642709ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.373518ms [martini] Started GET /api/lb-check for 10.1.1.81:47840 [martini] Completed 200 OK in 781.904µs [martini] Started GET /api/raft-health for 10.1.1.81:47882 [martini] Completed 200 OK in 809.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.741319ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.115206ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.99301ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.356217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.105506ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.126911ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.294517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 912.405µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.117111ms [martini] Started GET /api/raft-follower-health-report/4f17418b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 773.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.310217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 10.403753ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.027215ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.356423ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.049806ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.631113ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.541338ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 945.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.364813ms [martini] Started GET /api/lb-check for 10.1.1.81:48012 [martini] Completed 200 OK in 718.904µs [martini] Started GET /api/raft-health for 10.1.1.81:48024 [martini] Completed 200 OK in 887.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.411718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.228207ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.177411ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.615818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.268406ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.384917ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.440023ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.002106ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.286712ms [martini] Started GET /api/raft-follower-health-report/9bed851c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 812.905µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.477823ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.921525ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.353812ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.492318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 6.193731ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.375112ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.760219ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.603208ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.820625ms [martini] Started GET /api/lb-check for 10.1.1.81:48156 [martini] Completed 200 OK in 8.332643ms [martini] Started GET /api/raft-health for 10.1.1.81:48174 [martini] Completed 200 OK in 935.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.651219ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 932.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.520613ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.271217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.721009ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.294811ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.475818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.018806ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.759309ms [martini] Started GET /api/raft-follower-health-report/38108d42/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.456108ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.140626ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 905.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.570813ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.652924ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.364612ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.899909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.089716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 993.005µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.78362ms [martini] Started GET /api/lb-check for 10.1.1.81:48304 [martini] Completed 200 OK in 833.605µs [martini] Started GET /api/raft-health for 10.1.1.81:48320 [martini] Completed 200 OK in 808.504µs 2018-11-29 06:25:53 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.85892ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 974.105µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.251217ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.042521ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 895.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.89211ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.392018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 919.805µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.071611ms [martini] Started GET /api/raft-follower-health-report/22ab7737/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 765.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.482718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.194312ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.845446ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.778825ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.052505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.783429ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.711025ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.126211ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.825409ms [martini] Started GET /api/lb-check for 10.1.1.81:48454 [martini] Completed 200 OK in 771.804µs [martini] Started GET /api/raft-health for 10.1.1.81:48484 [martini] Completed 200 OK in 862.005µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.630719ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 875.505µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.135611ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.261232ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.038506ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.109811ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.766524ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.232406ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.442013ms 2018-11-29 06:26:05 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/b3c33d3f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 679.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.576819ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 812.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.82962ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.090916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.447407ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.525018ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.906026ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.315506ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.692614ms [martini] Started GET /api/lb-check for 10.1.1.81:48630 [martini] Completed 200 OK in 1.065005ms [martini] Started GET /api/raft-health for 10.1.1.81:48644 [martini] Completed 200 OK in 773.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.473728ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 969.905µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.980911ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.468718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 992.605µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.92671ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.422218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 917.805µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.98531ms 2018-11-29 06:26:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/f43daa78/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 789.205µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.478634ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.215506ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.251211ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.189016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.480719ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.605213ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 14.792576ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 848.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.188211ms [martini] Started GET /api/lb-check for 10.1.1.81:48780 [martini] Completed 200 OK in 901.905µs [martini] Started GET /api/raft-health for 10.1.1.81:48806 [martini] Completed 200 OK in 757.904µs 2018-11-29 06:26:23 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.371623ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.003105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.117611ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.065816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 810.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.028115ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.314317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.919815ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.428949ms [martini] Started GET /api/raft-follower-health-report/bf583160/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 676.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.380417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.134406ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.94511ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.276417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 913.305µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.244611ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.092216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 851.405µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.86121ms [martini] Started GET /api/lb-check for 10.1.1.81:48944 [martini] Completed 200 OK in 707.604µs [martini] Started GET /api/raft-health for 10.1.1.81:48970 [martini] Completed 200 OK in 710.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.730219ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.055206ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.228512ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.543324ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.121606ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.98531ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.581929ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.147906ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.349912ms [martini] Started GET /api/raft-follower-health-report/eaec2af3/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 810.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.559907ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.005903ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.705006ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.357006ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.795503ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.158304ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.927705ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 880.102µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.894604ms [martini] Started GET /api/lb-check for 10.1.1.81:49096 [martini] Completed 200 OK in 823.101µs [martini] Started GET /api/raft-health for 10.1.1.81:49128 [martini] Completed 200 OK in 901.701µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.698306ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.152902ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.133204ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.642006ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.045001ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.135806ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.403708ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 918.901µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.153604ms [martini] Started GET /api/raft-follower-health-report/c309934d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 789.901µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.113921ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 933.302µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.76362ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.102906ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 868.202µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.535305ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.346506ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 994.802µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.950003ms [martini] Started GET /api/lb-check for 10.1.1.81:49268 [martini] Completed 200 OK in 645.501µs [martini] Started GET /api/raft-health for 10.1.1.81:49284 [martini] Completed 200 OK in 662.701µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.980608ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 898.202µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.053704ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.090106ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.149103ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.946704ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.015606ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.022002ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.890304ms 2018/11/29 06:26:56 [INFO] raft: Starting snapshot up to 438400 2018/11/29 06:26:56 [INFO] snapshot: Creating new snapshot at /var/lib/orchestrator/snapshots/9352-438400-1543472816359.tmp 2018/11/29 06:26:56 [INFO] snapshot: reaping snapshot /var/lib/orchestrator/snapshots/9352-434582-1543445736156 2018/11/29 06:26:56 [INFO] raft: Compacting logs from 427777 to 428160 2018/11/29 06:26:56 [INFO] raft: Snapshot to 438400 complete [martini] Started GET /api/raft-follower-health-report/4c58ee50/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 6.930315ms 2018-11-29 06:26:59 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.725712ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.741704ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.418608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.073307ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.122602ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.051004ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.253915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.068404ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.111006ms [martini] Started GET /api/lb-check for 10.1.1.81:49422 [martini] Completed 200 OK in 689.801µs [martini] Started GET /api/raft-health for 10.1.1.81:49434 [martini] Completed 200 OK in 945.302µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.543208ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 895.102µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.172609ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.57051ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.206303ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.944306ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.208509ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.597104ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.491306ms 2018-11-29 06:27:05 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/f702c2eb/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 872.902µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.06931ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.237503ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.970205ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.090109ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.025402ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.751607ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 16.027036ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 880.002µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.293505ms [martini] Started GET /api/lb-check for 10.1.1.81:49612 [martini] Completed 200 OK in 700.602µs [martini] Started GET /api/raft-health for 10.1.1.81:49640 [martini] Completed 200 OK in 677.701µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.338611ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.032102ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.069505ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.498108ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 823.602µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.899005ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.125307ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 816.602µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.335108ms 2018-11-29 06:27:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/01c5cb0b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 774.402µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.77091ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.582504ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.968705ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.07391ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 787.202µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.872505ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.148808ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 840.602µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.988005ms [martini] Started GET /api/lb-check for 10.1.1.81:49768 [martini] Completed 200 OK in 650.602µs [martini] Started GET /api/raft-health for 10.1.1.81:49792 [martini] Completed 200 OK in 1.055803ms 2018-11-29 06:27:23 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.89351ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.322104ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.033305ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.472409ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 846.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.868605ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.603409ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 731.602µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.050605ms [martini] Started GET /api/raft-follower-health-report/46ea625f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 780.302µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.00751ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 869.702µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.171227ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.79681ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 828.702µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.060805ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.135508ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.032202ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.553312ms [martini] Started GET /api/lb-check for 10.1.1.81:49894 [martini] Completed 200 OK in 764.202µs [martini] Started GET /api/raft-health for 10.1.1.81:49902 [martini] Completed 200 OK in 791.302µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.914211ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 952.203µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.059906ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.782711ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 881.102µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.269107ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 13.203937ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 876.202µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.109906ms [martini] Started GET /api/raft-follower-health-report/d38975df/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 904.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.53461ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 7.742722ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.027306ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.59581ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 763.302µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.933305ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.098909ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.746707ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.500412ms [martini] Started GET /api/lb-check for 10.1.1.81:50002 [martini] Completed 200 OK in 974.703µs [martini] Started GET /api/raft-health for 10.1.1.81:50012 [martini] Completed 200 OK in 827.802µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.694111ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 980.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.858305ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.216309ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 867.402µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.976206ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.103209ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 758.103µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.888205ms [martini] Started GET /api/raft-follower-health-report/1b9a64f8/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 792.502µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.248019ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.002003ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.159706ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.42691ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 820.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.896705ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.127931ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 17.469652ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.934006ms [martini] Started GET /api/lb-check for 10.1.1.81:50132 [martini] Completed 200 OK in 1.038203ms [martini] Started GET /api/raft-health for 10.1.1.81:50146 [martini] Completed 200 OK in 621.402µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.274714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.074903ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.336707ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.784624ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 886.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.288907ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.864109ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.095703ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.985709ms [martini] Started GET /api/raft-follower-health-report/ca054cf5/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 826.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.47072ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 868.903µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.936406ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.464611ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 957.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.594908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.668524ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.686908ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.176907ms [martini] Started GET /api/lb-check for 10.1.1.81:50296 [martini] Completed 200 OK in 817.002µs [martini] Started GET /api/raft-health for 10.1.1.81:50320 [martini] Completed 200 OK in 828.203µs 2018-11-29 06:28:01 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.830112ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 939.903µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.863906ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.18291ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.824606ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.20501ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.05831ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 962.903µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.105606ms 2018-11-29 06:28:07 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/d20051e1/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 702.402µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.833813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 780.502µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.405208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.231111ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 924.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.079507ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.680812ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 768.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.316814ms [martini] Started GET /api/lb-check for 10.1.1.81:50458 [martini] Completed 200 OK in 905.203µs [martini] Started GET /api/raft-health for 10.1.1.81:50468 [martini] Completed 200 OK in 1.330004ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.649712ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.072504ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.141807ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.603712ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 849.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.115707ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.443011ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 844.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.896706ms 2018-11-29 06:28:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/2f83ebe6/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 612.102µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.382011ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 888.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.167014ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.335922ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.117911ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.980707ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.481212ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 821.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.465609ms [martini] Started GET /api/lb-check for 10.1.1.81:50604 [martini] Completed 200 OK in 939.403µs [martini] Started GET /api/raft-health for 10.1.1.81:50632 [martini] Completed 200 OK in 776.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.671013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 961.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.397408ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.607816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 893.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.950107ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.608519ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 11.319239ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.020907ms 2018-11-29 06:28:25 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/83a5c373/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 716.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.941935ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 983.503µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.77421ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.72093ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.039104ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.261508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.75112ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 800.903µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.076108ms [martini] Started GET /api/lb-check for 10.1.1.81:50766 [martini] Completed 200 OK in 857.003µs [martini] Started GET /api/raft-health for 10.1.1.81:50778 [martini] Completed 200 OK in 5.092018ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.684923ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 934.403µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.900607ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.320412ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 859.703µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.945107ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.346312ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 851.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.275908ms [martini] Started GET /api/raft-follower-health-report/f95114c8/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.340005ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.308615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 829.403µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.119708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.485613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 805.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.009207ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.794018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 855.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.846306ms [martini] Started GET /api/lb-check for 10.1.1.81:50928 [martini] Completed 200 OK in 635.702µs [martini] Started GET /api/raft-health for 10.1.1.81:50956 [martini] Completed 200 OK in 802.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.641213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 923.303µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.113015ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.485912ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 897.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.852507ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.084611ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 892.203µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.094607ms [martini] Started GET /api/raft-follower-health-report/c435aae4/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 822.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.914015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.617206ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.831614ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.258116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.574906ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.967507ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.734525ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.598306ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.337709ms [martini] Started GET /api/lb-check for 10.1.1.81:51112 [martini] Completed 200 OK in 944.604µs [martini] Started GET /api/raft-health for 10.1.1.81:51136 [martini] Completed 200 OK in 1.093504ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.046519ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.164204ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.462324ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.175027ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 916.003µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.169108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.819933ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 995.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.88741ms [martini] Started GET /api/raft-follower-health-report/53cffe4c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 694.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.40692ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 872.903µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.118508ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.374131ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.194205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.974808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.363121ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 969.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.084408ms [martini] Started GET /api/lb-check for 10.1.1.81:51294 [martini] Completed 200 OK in 661.402µs [martini] Started GET /api/raft-health for 10.1.1.81:51304 [martini] Completed 200 OK in 784.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.390717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.421205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.020908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.717115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 824.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.937507ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.429913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 876.703µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.388009ms 2018-11-29 06:29:07 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/e294f849/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 768.103µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.795227ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 844.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.904508ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.010612ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.105004ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.048123ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.512929ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 910.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.406309ms [martini] Started GET /api/lb-check for 10.1.1.81:51442 [martini] Completed 200 OK in 619.803µs [martini] Started GET /api/raft-health for 10.1.1.81:51466 [martini] Completed 200 OK in 932.703µs 2018-11-29 06:29:13 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.388413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.016104ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.45821ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.522814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 982.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.974008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.867711ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 789.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.155912ms 2018-11-29 06:29:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/b0115d7e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.044104ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.239317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.44011ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.348209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.302913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 890.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.887608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.239121ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 838.703µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.831208ms [martini] Started GET /api/lb-check for 10.1.1.81:51594 [martini] Completed 200 OK in 785.103µs [martini] Started GET /api/raft-health for 10.1.1.81:51632 [martini] Completed 200 OK in 807.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.599014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.091004ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.034008ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.207813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 962.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.039828ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.698222ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.074505ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.107009ms 2018-11-29 06:29:25 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/259e1b99/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 832.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.624014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 894.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.008424ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.613215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.084104ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.281909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 32.168329ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.189805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.003308ms [martini] Started GET /api/lb-check for 10.1.1.81:51778 [martini] Completed 200 OK in 734.503µs [martini] Started GET /api/raft-health for 10.1.1.81:51788 [martini] Completed 200 OK in 1.105004ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.608014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.109405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.151909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.791115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 868.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.715307ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.103824ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 899.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.900307ms [martini] Started GET /api/raft-follower-health-report/fef4c114/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 830.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.459314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 931.903µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.070208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.324614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 824.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.326209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.043812ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.359306ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.222109ms [martini] Started GET /api/lb-check for 10.1.1.81:51936 [martini] Completed 200 OK in 2.953712ms [martini] Started GET /api/raft-health for 10.1.1.81:51952 [martini] Completed 200 OK in 840.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.793815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.029805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.156408ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.365414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 861.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.902708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.400214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 988.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.874808ms [martini] Started GET /api/raft-follower-health-report/72fe1260/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.099105ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.951916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.027204ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.057708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.530914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 970.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.880608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.498414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 817.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.988308ms [martini] Started GET /api/lb-check for 10.1.1.81:52088 [martini] Completed 200 OK in 849.504µs [martini] Started GET /api/raft-health for 10.1.1.81:52122 [martini] Completed 200 OK in 770.303µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.866116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 964.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.157709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.854032ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 863.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.56361ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.188922ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.014804ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.123909ms [martini] Started GET /api/raft-follower-health-report/ae522a4e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 808.204µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.761615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 924.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.518515ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.134418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.388106ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.588511ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.198613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.38791ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.388914ms [martini] Started GET /api/lb-check for 10.1.1.81:52288 [martini] Completed 200 OK in 676.303µs [martini] Started GET /api/raft-health for 10.1.1.81:52304 [martini] Completed 200 OK in 757.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.637716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 965.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.027108ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.558315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.030304ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.881408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.267113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 985.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.915408ms 2018-11-29 06:30:07 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/4bd3652a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 791.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.495015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.054905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.995909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.348319ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.948608ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.219809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.287218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 831.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31661ms [martini] Started GET /api/lb-check for 10.1.1.81:52450 [martini] Completed 200 OK in 754.204µs [martini] Started GET /api/raft-health for 10.1.1.81:52462 [martini] Completed 200 OK in 684.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 15.473565ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.070804ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.211218ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.734116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.020004ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.925808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.237118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 832.203µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.44971ms 2018-11-29 06:30:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/c9f96a1f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.566607ms 2018-11-29 06:30:19 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.510715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 832.803µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.111009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.894025ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 796.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.985809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.860816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 867.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.204214ms [martini] Started GET /api/lb-check for 10.1.1.81:52608 [martini] Completed 200 OK in 690.703µs [martini] Started GET /api/raft-health for 10.1.1.81:52634 [martini] Completed 200 OK in 882.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.972417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.223006ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.070209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.482437ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.559307ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.131409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.116717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 921.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.98733ms [martini] Started GET /api/raft-follower-health-report/ab95368f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 735.103µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 14.245061ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.152205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.890008ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.402336ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.119004ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.37571ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.593419ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.190105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.086909ms [martini] Started GET /api/lb-check for 10.1.1.81:52772 [martini] Completed 200 OK in 621.703µs [martini] Started GET /api/raft-health for 10.1.1.81:52798 [martini] Completed 200 OK in 953.804µs 2018-11-29 06:30:31 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.055222ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 964.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.948608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.902217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 837.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.094809ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.934912ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 850.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.868608ms [martini] Started GET /api/raft-follower-health-report/8f91cc13/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 811.404µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.686225ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 7.105631ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.055609ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.081713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 882.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.922908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.258823ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31561ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.36401ms [martini] Started GET /api/lb-check for 10.1.1.81:52944 [martini] Completed 200 OK in 868.304µs [martini] Started GET /api/raft-health for 10.1.1.81:52954 [martini] Completed 200 OK in 676.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.727416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 875.303µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.040409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.832817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.160809ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.067313ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.272114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.003304ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.876808ms [martini] Started GET /api/raft-follower-health-report/47d73622/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 704.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.711317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 886.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16081ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.534016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 991.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.840408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.974213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.019704ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.455224ms [martini] Started GET /api/lb-check for 10.1.1.81:53102 [martini] Completed 200 OK in 1.357306ms [martini] Started GET /api/raft-health for 10.1.1.81:53116 [martini] Completed 200 OK in 717.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.635116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.151205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.316711ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.166623ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 787.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.106609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.41712ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.249206ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.469528ms [martini] Started GET /api/raft-follower-health-report/14d28653/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 733.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.332915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 889.903µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.006409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.497916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 8.759239ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.603811ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.341415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 797.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.999909ms [martini] Started GET /api/lb-check for 10.1.1.81:53260 [martini] Completed 200 OK in 749.103µs [martini] Started GET /api/raft-health for 10.1.1.81:53270 [martini] Completed 200 OK in 884.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.488215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.363006ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.861526ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.322914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 832.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.683511ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.53322ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 909.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.721908ms [martini] Started GET /api/raft-follower-health-report/68dd5143/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 953.505µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.721017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 904.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.939509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.957213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 851.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.76033ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.069319ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.065704ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.686417ms [martini] Started GET /api/lb-check for 10.1.1.81:53408 [martini] Completed 200 OK in 813.703µs [martini] Started GET /api/raft-health for 10.1.1.81:53436 [martini] Completed 200 OK in 886.104µs 2018-11-29 06:31:13 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.881918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 856.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.023709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.518916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 847.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.760607ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.997913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 843.303µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.270515ms 2018-11-29 06:31:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/94dee7cc/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 901.404µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.954718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 935.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.135714ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.976832ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 797.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.896209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.736316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.457507ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.386716ms [martini] Started GET /api/lb-check for 10.1.1.81:53592 [martini] Completed 200 OK in 972.404µs [martini] Started GET /api/raft-health for 10.1.1.81:53618 [martini] Completed 200 OK in 739.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.542016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.053604ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.332511ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.241523ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.662608ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.556411ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.386534ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.131305ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.12101ms 2018-11-29 06:31:25 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/48addd44/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 816.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.340015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 861.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.167727ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.49402ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.470907ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.024109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.853418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.783308ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.625138ms [martini] Started GET /api/lb-check for 10.1.1.81:53758 [martini] Completed 200 OK in 983.005µs [martini] Started GET /api/raft-health for 10.1.1.81:53770 [martini] Completed 200 OK in 801.604µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.791417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.064304ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.109809ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.296815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 953.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.10771ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.506143ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 952.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.473212ms 2018-11-29 06:31:37 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/9d48886c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 747.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.708631ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.302606ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.929209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.431529ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 972.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.998209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.652416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.249206ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.295915ms [martini] Started GET /api/lb-check for 10.1.1.81:53924 [martini] Completed 200 OK in 2.426311ms [martini] Started GET /api/raft-health for 10.1.1.81:53932 [martini] Completed 200 OK in 635.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.482116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.045805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.344711ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.576016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 999.705µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.915108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.095215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 983.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.093709ms [martini] Started GET /api/raft-follower-health-report/93f2c32b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 748.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.317815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 900.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.150709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.847217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 839.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.823809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.727326ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 802.703µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.15301ms [martini] Started GET /api/lb-check for 10.1.1.81:54072 [martini] Completed 200 OK in 907.804µs [martini] Started GET /api/raft-health for 10.1.1.81:54100 [martini] Completed 200 OK in 689.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 12.974559ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.170805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.24651ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.411648ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.282706ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.578212ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.744131ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.777513ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.549812ms [martini] Started GET /api/raft-follower-health-report/fe11d6ad/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 733.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.511416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 841.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.001609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.369939ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.027605ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.583912ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.146019ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 5.190424ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.776113ms [martini] Started GET /api/lb-check for 10.1.1.81:54254 [martini] Completed 200 OK in 881.004µs [martini] Started GET /api/raft-health for 10.1.1.81:54266 [martini] Completed 200 OK in 835.604µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.884417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.013205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.038609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.301016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 981.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.625612ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.050214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 961.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16981ms [martini] Started GET /api/raft-follower-health-report/564ca508/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 766.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.396116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.083505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.850009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.284015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.046505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.778322ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.052414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 957.205µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.737012ms [martini] Started GET /api/lb-check for 10.1.1.81:54404 [martini] Completed 200 OK in 727.303µs [martini] Started GET /api/raft-health for 10.1.1.81:54414 [martini] Completed 200 OK in 817.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.549216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.139305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.439612ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.073214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 803.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.804608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.116514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 861.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.767208ms 2018-11-29 06:32:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/6fd86ca4/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 790.704µs 2018-11-29 06:32:19 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.615917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.012305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.415825ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.306733ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 888.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20431ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.253115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.036605ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.883109ms [martini] Started GET /api/lb-check for 10.1.1.81:54562 [martini] Completed 200 OK in 848.704µs [martini] Started GET /api/raft-health for 10.1.1.81:54594 [martini] Completed 200 OK in 708.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.332925ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 941.505µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.419111ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.314216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 919.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.449511ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.259615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.459812ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.439511ms [martini] Started GET /api/raft-follower-health-report/474a5cc0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 759.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.460316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.140305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.98161ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.893618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 805.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.949809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.054728ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.184105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.647712ms [martini] Started GET /api/lb-check for 10.1.1.81:54732 [martini] Completed 200 OK in 891.004µs [martini] Started GET /api/raft-health for 10.1.1.81:54756 [martini] Completed 200 OK in 830.204µs 2018-11-29 06:32:31 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.595517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.913708ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.051509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.351516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.031305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.02481ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.986914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.116606ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.04521ms 2018-11-29 06:32:37 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/e8f11810/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 734.103µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.661117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.096419ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.888109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.032918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.089205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.536712ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.87465ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.985409ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.759808ms [martini] Started GET /api/lb-check for 10.1.1.81:54904 [martini] Completed 200 OK in 825.804µs [martini] Started GET /api/raft-health for 10.1.1.81:54920 [martini] Completed 200 OK in 695.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.385015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 917.505µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.13561ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.709932ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.11101ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.865308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.236915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 910.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.940709ms [martini] Started GET /api/raft-follower-health-report/f19fedf5/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 623.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.416716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 5.343625ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.191411ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.377416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.387806ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.894409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.338725ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.302311ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.275144ms [martini] Started GET /api/lb-check for 10.1.1.81:55056 [martini] Completed 200 OK in 872.404µs [martini] Started GET /api/raft-health for 10.1.1.81:55068 [martini] Completed 200 OK in 772.703µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.633117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.441512ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.062024ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.223824ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.223106ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.554212ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.693222ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.105205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.96521ms [martini] Started GET /api/raft-follower-health-report/e6d4ff5b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 678.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.417616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 783.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.06341ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.212515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.083005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.502312ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.467726ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.579408ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.732212ms [martini] Started GET /api/lb-check for 10.1.1.81:55224 [martini] Completed 200 OK in 653.704µs [martini] Started GET /api/raft-health for 10.1.1.81:55254 [martini] Completed 200 OK in 858.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.631417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 5.996328ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.02951ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.330015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 918.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.03311ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.221316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.016105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.09261ms [martini] Started GET /api/raft-follower-health-report/463151d7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.112005ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.382916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 798.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.033014ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.840628ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 7.662236ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.39503ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.428317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 931.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.074309ms [martini] Started GET /api/lb-check for 10.1.1.81:55404 [martini] Completed 200 OK in 630.503µs [martini] Started GET /api/raft-health for 10.1.1.81:55416 [martini] Completed 200 OK in 662.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.552117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.070505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.359111ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.658017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 909.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.865209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.837413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.101206ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.505226ms 2018-11-29 06:33:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/b9b35644/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 665.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.380715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.141806ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23051ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.253416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.070305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.975809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.482954ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.608307ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.155515ms [martini] Started GET /api/lb-check for 10.1.1.81:55560 [martini] Completed 200 OK in 664.904µs [martini] Started GET /api/raft-health for 10.1.1.81:55574 [martini] Completed 200 OK in 710.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.819918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 903.105µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.12941ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.058819ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.131806ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.02731ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.594917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.203606ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.019509ms 2018-11-29 06:33:25 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/480e3d70/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 911.705µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.428916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.741013ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.284215ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.547617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 726.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.920609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.569227ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 805.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.99521ms [martini] Started GET /api/lb-check for 10.1.1.81:55726 [martini] Completed 200 OK in 895.204µs [martini] Started GET /api/raft-health for 10.1.1.81:55736 [martini] Completed 200 OK in 675.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.634218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 948.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.185511ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.410016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 924.405µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.356616ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.24422ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 960.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.14701ms 2018-11-29 06:33:37 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/af185a00/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 883.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.575817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 908.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.97151ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.614326ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 815.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.989214ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.271715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.178905ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.11431ms [martini] Started GET /api/lb-check for 10.1.1.81:55892 [martini] Completed 200 OK in 2.676913ms [martini] Started GET /api/raft-health for 10.1.1.81:55916 [martini] Completed 200 OK in 848.504µs 2018-11-29 06:33:43 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.691417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 874.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.011309ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.996619ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 878.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.066109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.363816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 871.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.943709ms [martini] Started GET /api/raft-follower-health-report/22bbd008/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 826.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.716218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.14512ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.656313ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.15232ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.527508ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.515417ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.066114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 823.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.808209ms [martini] Started GET /api/lb-check for 10.1.1.81:56056 [martini] Completed 200 OK in 773.203µs [martini] Started GET /api/raft-health for 10.1.1.81:56072 [martini] Completed 200 OK in 711.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.374021ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 850.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.985109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.35125ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.055705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.885509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.609522ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.371211ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.298911ms [martini] Started GET /api/raft-follower-health-report/c67ad71a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 675.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.265916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.148805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.07271ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.684818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 796.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.907509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.049748ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 788.503µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.768809ms [martini] Started GET /api/lb-check for 10.1.1.81:56216 [martini] Completed 200 OK in 739.403µs [martini] Started GET /api/raft-health for 10.1.1.81:56226 [martini] Completed 200 OK in 771.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.635417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.017704ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.305311ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.264416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 872.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.841809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.720613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 853.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.730508ms [martini] Started GET /api/raft-follower-health-report/93c59d79/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 934.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.469717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 801.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.337811ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.595817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 971.205µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.194515ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.524522ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.101305ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.771323ms [martini] Started GET /api/lb-check for 10.1.1.81:56360 [martini] Completed 200 OK in 690.303µs [martini] Started GET /api/raft-health for 10.1.1.81:56370 [martini] Completed 200 OK in 728.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.954918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 869.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.298611ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.230316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 947.405µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.237011ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.049514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 922.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.94021ms 2018-11-29 06:34:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/acd0f543/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 759.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.804818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 851.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.584741ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.704127ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.048705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.879513ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.125515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.171206ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.896809ms [martini] Started GET /api/lb-check for 10.1.1.81:56524 [martini] Completed 200 OK in 786.104µs [martini] Started GET /api/raft-health for 10.1.1.81:56556 [martini] Completed 200 OK in 787.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.698018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.115305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.04461ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.376416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.022105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.896409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.162515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.782118ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.823818ms [martini] Started GET /api/raft-follower-health-report/6fb4cf11/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.243406ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.414354ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.476807ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.825009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 27.845933ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.95091ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.17581ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 25.403221ms [martini] Started GET /api/lb-check for 10.1.1.81:56722 [martini] Completed 200 OK in 636.903µs [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.428607ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.319211ms [martini] Started GET /api/raft-health for 10.1.1.81:56734 [martini] Completed 200 OK in 633.503µs 2018-11-29 06:34:31 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.559817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 904.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.930709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.31382ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.217005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.95711ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.593717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 973.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.01521ms 2018-11-29 06:34:37 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/afe99aaf/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 626.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.899123ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.524607ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.11851ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.497317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 754.703µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.08841ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.994314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 801.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.48514ms [martini] Started GET /api/lb-check for 10.1.1.81:56886 [martini] Completed 200 OK in 659.003µs [martini] Started GET /api/raft-health for 10.1.1.81:56896 [martini] Completed 200 OK in 789.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.893719ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.067005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.02181ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.886818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.345411ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.361011ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.806913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 941.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.748208ms [martini] Started GET /api/raft-follower-health-report/205a29b0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 733.104µs 2018-11-29 06:34:49 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.356316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 996.705µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.813913ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.862124ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.258906ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.447016ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.755123ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 881.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.754018ms [martini] Started GET /api/lb-check for 10.1.1.81:57032 [martini] Completed 200 OK in 821.204µs [martini] Started GET /api/raft-health for 10.1.1.81:57050 [martini] Completed 200 OK in 1.005405ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.488017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.012005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.039809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.159515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 856.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.858009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.719328ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.067305ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.942309ms [martini] Started GET /api/raft-follower-health-report/11c772d0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 776.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.471016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 878.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.916209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.572241ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 879.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.921809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.280915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.431707ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.998309ms [martini] Started GET /api/lb-check for 10.1.1.81:57192 [martini] Completed 200 OK in 723.003µs [martini] Started GET /api/raft-health for 10.1.1.81:57218 [martini] Completed 200 OK in 668.003µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.871118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 889.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.635327ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.035915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 863.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.94071ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.128115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 979.505µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.839009ms [martini] Started GET /api/raft-follower-health-report/db4a26e8/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 994.505µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.630317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 822.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.94191ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.432716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.012405ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.859438ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.469126ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 991.805µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.986609ms [martini] Started GET /api/lb-check for 10.1.1.81:57368 [martini] Completed 200 OK in 788.804µs [martini] Started GET /api/raft-health for 10.1.1.81:57380 [martini] Completed 200 OK in 746.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.003013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.228704ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.922306ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.356811ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 888.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.120007ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.29191ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 827.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.164506ms 2018-11-29 06:35:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/7323c167/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 663.602µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.644511ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.485205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.909707ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.448211ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 854.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.935006ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.936132ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.650305ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.618812ms [martini] Started GET /api/lb-check for 10.1.1.81:57542 [martini] Completed 200 OK in 663.002µs [martini] Started GET /api/raft-health for 10.1.1.81:57556 [martini] Completed 200 OK in 683.602µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.437911ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 911.303µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.044307ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.508811ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.213204ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.813906ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.888112ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 893.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.009407ms [martini] Started GET /api/raft-follower-health-report/df4a6b67/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 757.202µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.502711ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.698205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 21.912872ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.755729ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.026903ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.193308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.783913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 967.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.110107ms [martini] Started GET /api/lb-check for 10.1.1.81:57726 [martini] Completed 200 OK in 588.002µs [martini] Started GET /api/raft-health for 10.1.1.81:57750 [martini] Completed 200 OK in 798.003µs 2018-11-29 06:35:31 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.854813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.073204ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.204308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.634112ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 940.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.399117ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.686312ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 831.503µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.211407ms [martini] Started GET /api/raft-follower-health-report/4075d274/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 839.503µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.388318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 5.95812ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.339811ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.231617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 909.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.458808ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.15071ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 822.902µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.347608ms [martini] Started GET /api/lb-check for 10.1.1.81:57886 [martini] Completed 200 OK in 726.302µs [martini] Started GET /api/raft-health for 10.1.1.81:57912 [martini] Completed 200 OK in 725.102µs 2018-11-29 06:35:43 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.488912ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 836.602µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.962906ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.388411ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 789.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.364608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.97431ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 830.803µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.029807ms [martini] Started GET /api/raft-follower-health-report/6dbd2289/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 737.202µs 2018-11-29 06:35:49 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.473112ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.503706ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.340211ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.288314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.733106ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.08151ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.238011ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.050404ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.096407ms [martini] Started GET /api/lb-check for 10.1.1.81:58048 [martini] Completed 200 OK in 684.802µs [martini] Started GET /api/raft-health for 10.1.1.81:58062 [martini] Completed 200 OK in 805.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.584812ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.050103ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.021614ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.897017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 951.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.438308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.552712ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 887.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.963907ms [martini] Started GET /api/raft-follower-health-report/f762bf04/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 833.002µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.549613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 903.503µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.921606ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.97092ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 874.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.039707ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.98394ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 917.203µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.170808ms [martini] Started GET /api/lb-check for 10.1.1.81:58212 [martini] Completed 200 OK in 921.103µs [martini] Started GET /api/raft-health for 10.1.1.81:58226 [martini] Completed 200 OK in 2.164407ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.603813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 892.003µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.006606ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.240012ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 891.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.320608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.062111ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 910.903µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.955407ms [martini] Started GET /api/raft-follower-health-report/63171804/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 718.502µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.622012ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 811.503µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.296415ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.134114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.193904ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.028707ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.96501ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 925.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.851307ms [martini] Started GET /api/lb-check for 10.1.1.81:58382 [martini] Completed 200 OK in 845.503µs [martini] Started GET /api/raft-health for 10.1.1.81:58408 [martini] Completed 200 OK in 750.902µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.077614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.184704ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.121508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.00341ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 889.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.888806ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.99191ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 790.503µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.479409ms 2018-11-29 06:36:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/799c7472/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 807.202µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.579627ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.705706ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.481633ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.520412ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 938.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.021607ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.161811ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 870.803µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.876006ms [martini] Started GET /api/lb-check for 10.1.1.81:58558 [martini] Completed 200 OK in 656.803µs [martini] Started GET /api/raft-health for 10.1.1.81:58574 [martini] Completed 200 OK in 688.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.329012ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.099604ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.974007ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.092229ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 960.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.985107ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 12.828946ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 951.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.007507ms [martini] Started GET /api/raft-follower-health-report/03803eac/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 832.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.435913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 5.109018ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.189811ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.673027ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.546012ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.65481ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.225532ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 982.703µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.584924ms [martini] Started GET /api/lb-check for 10.1.1.81:58734 [martini] Completed 200 OK in 2.94161ms [martini] Started GET /api/raft-health for 10.1.1.81:58744 [martini] Completed 200 OK in 853.103µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.455413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 796.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.177208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.81141ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 886.903µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.772206ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.914811ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 920.403µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.804206ms 2018-11-29 06:36:37 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/df6ce376/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 712.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.306312ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.306609ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.680517ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.519013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.024604ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.237908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.247412ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 964.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.004307ms [martini] Started GET /api/lb-check for 10.1.1.81:58888 [martini] Completed 200 OK in 766.002µs [martini] Started GET /api/raft-health for 10.1.1.81:58900 [martini] Completed 200 OK in 697.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.421916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.160605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.265133ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.177912ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 834.003µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.996508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.246012ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 816.202µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.920007ms [martini] Started GET /api/raft-follower-health-report/fc72e877/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 816.103µs 2018-11-29 06:36:49 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.864118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.362005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.528809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.704813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 832.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.747614ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.81061ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 856.203µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.836606ms [martini] Started GET /api/lb-check for 10.1.1.81:59038 [martini] Completed 200 OK in 684.803µs [martini] Started GET /api/raft-health for 10.1.1.81:59052 [martini] Completed 200 OK in 862.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.716613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.035404ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.096607ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.206511ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 867.703µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.922107ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.94671ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 924.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.922707ms 2018-11-29 06:36:55 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/e62d097a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 845.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.533313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 912.703µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.020507ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.943629ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.035204ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.178808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.597917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.681906ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.162119ms [martini] Started GET /api/lb-check for 10.1.1.81:59202 [martini] Completed 200 OK in 868.003µs [martini] Started GET /api/raft-health for 10.1.1.81:59214 [martini] Completed 200 OK in 658.502µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.427713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 899.703µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.402009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.156212ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 744.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.869307ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.966611ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.127404ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.195908ms [martini] Started GET /api/raft-follower-health-report/6580d6d8/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 886.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.193715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 826.803µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.93764ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.076323ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 884.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.820207ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.709114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 944.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.131708ms [martini] Started GET /api/lb-check for 10.1.1.81:59364 [martini] Completed 200 OK in 933.604µs [martini] Started GET /api/raft-health for 10.1.1.81:59388 [martini] Completed 200 OK in 806.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.949715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.175604ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.345908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.600013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 799.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.152608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.242723ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.079404ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.876807ms 2018-11-29 06:37:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/58bf19b6/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 814.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.008126ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 998.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.121308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.18862ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.832807ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.806514ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.207512ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.003604ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.828607ms [martini] Started GET /api/lb-check for 10.1.1.81:59528 [martini] Completed 200 OK in 2.65621ms [martini] Started GET /api/raft-health for 10.1.1.81:59542 [martini] Completed 200 OK in 644.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.950415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.108404ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.256209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.073623ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.004804ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.326209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.582513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 817.903µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.412309ms [martini] Started GET /api/raft-follower-health-report/71e0bff0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 805.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.411928ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.101708ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.023907ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.383913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 789.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.992308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.388532ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.343305ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.038519ms [martini] Started GET /api/lb-check for 10.1.1.81:59692 [martini] Completed 200 OK in 724.603µs [martini] Started GET /api/raft-health for 10.1.1.81:59702 [martini] Completed 200 OK in 782.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.820314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.390205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.020308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.021419ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.585606ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.908908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.174213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 918.903µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.868007ms 2018-11-29 06:37:37 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/039e87a4/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 836.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.108416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.301805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.21062ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.741214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 944.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.223608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.151812ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.772406ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.531118ms [martini] Started GET /api/lb-check for 10.1.1.81:59850 [martini] Completed 200 OK in 849.504µs [martini] Started GET /api/raft-health for 10.1.1.81:59866 [martini] Completed 200 OK in 672.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.031415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 966.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.935607ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.999615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 973.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.796007ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.508314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.053804ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.011908ms [martini] Started GET /api/raft-follower-health-report/200deae1/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 3.005812ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.230424ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.331105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.432317ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.298913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 845.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.008907ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.372813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 867.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.441509ms [martini] Started GET /api/lb-check for 10.1.1.81:60006 [martini] Completed 200 OK in 3.621514ms [martini] Started GET /api/raft-health for 10.1.1.81:60034 [martini] Completed 200 OK in 768.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.243417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.316405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.587314ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.250832ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 840.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.070308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.087116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 930.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.036408ms 2018-11-29 06:37:55 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 06:37:55 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/a9ebad74/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 758.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.183517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 912.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.321113ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.731615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.107604ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.243813ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.571837ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.627507ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.255909ms [martini] Started GET /api/lb-check for 10.1.1.81:60182 [martini] Completed 200 OK in 671.303µs [martini] Started GET /api/raft-health for 10.1.1.81:60194 [martini] Completed 200 OK in 625.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.309416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 966.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.018908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.620018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 813.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.885207ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.152716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.070904ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.62991ms [martini] Started GET /api/raft-follower-health-report/3eb4a4e7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 731.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.237513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.280005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.977119ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.156013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 799.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.003708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.928311ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 881.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.49451ms [martini] Started GET /api/lb-check for 10.1.1.81:60356 [martini] Completed 200 OK in 593.702µs [martini] Started GET /api/raft-health for 10.1.1.81:60366 [martini] Completed 200 OK in 870.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.358513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 821.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.953408ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.560714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 839.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.314209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.250013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 809.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.107809ms 2018-11-29 06:38:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/aa60638f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 686.002µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.149029ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.60151ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.587918ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.006816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.742507ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.260609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.386013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.062304ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.917811ms [martini] Started GET /api/lb-check for 10.1.1.81:60518 [martini] Completed 200 OK in 725.503µs [martini] Started GET /api/raft-health for 10.1.1.81:60544 [martini] Completed 200 OK in 756.303µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.636815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 835.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.101409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.456013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.124912ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.57181ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.344817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.238705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.802207ms [martini] Started GET /api/raft-follower-health-report/c1119ffb/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 745.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.852915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.034004ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.383009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.455313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.43861ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.788419ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.04132ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.032804ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.61501ms [martini] Started GET /api/lb-check for 10.1.1.81:60684 [martini] Completed 200 OK in 580.303µs [martini] Started GET /api/raft-health for 10.1.1.81:60710 [martini] Completed 200 OK in 751.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.540714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.013804ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.262509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.226213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 886.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.874007ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.046913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 886.203µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.899707ms [martini] Started GET /api/raft-follower-health-report/ba0eaa2c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.547107ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.382614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 941.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.162709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.906912ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 796.803µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.753707ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.913611ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 930.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.178009ms [martini] Started GET /api/lb-check for 10.1.1.81:60862 [martini] Completed 200 OK in 795.003µs [martini] Started GET /api/raft-health for 10.1.1.81:60872 [martini] Completed 200 OK in 756.503µs 2018-11-29 06:38:43 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.728915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.027505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.934616ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.541514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.067804ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.985708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.530915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 833.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.33801ms [martini] Started GET /api/raft-follower-health-report/8b7b7521/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 841.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.188325ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.690907ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.65721ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.581118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 965.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.858207ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.79002ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.401306ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.893107ms [martini] Started GET /api/lb-check for 10.1.1.81:32772 [martini] Completed 200 OK in 669.403µs [martini] Started GET /api/raft-health for 10.1.1.81:32786 [martini] Completed 200 OK in 842.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.384114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.050204ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.118609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.527918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.026004ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26011ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.005612ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 844.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.858508ms 2018-11-29 06:38:55 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 06:38:55 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/172e74f6/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 837.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.815028ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 890.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29051ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.00512ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.047004ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.038209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.796115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.013504ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.216009ms [martini] Started GET /api/lb-check for 10.1.1.81:32924 [martini] Completed 200 OK in 624.703µs [martini] Started GET /api/raft-health for 10.1.1.81:32950 [martini] Completed 200 OK in 626.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.714919ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.294405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.940008ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.874116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 868.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.996708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.333613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.052904ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.172309ms [martini] Started GET /api/raft-follower-health-report/55dda369/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 868.504µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.09152ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.103405ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.102309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.230814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 992.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.745019ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.981212ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 985.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.141608ms [martini] Started GET /api/lb-check for 10.1.1.81:33100 [martini] Completed 200 OK in 781.403µs [martini] Started GET /api/raft-health for 10.1.1.81:33110 [martini] Completed 200 OK in 787.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.848015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 829.303µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.127109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.345214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.063305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.48071ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.346314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.138408ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.086709ms 2018-11-29 06:39:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/8b35d262/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 730.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.849724ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 967.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.214709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.131513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 957.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.003308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.720816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 991.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.935708ms [martini] Started GET /api/lb-check for 10.1.1.81:33254 [martini] Completed 200 OK in 822.504µs [martini] Started GET /api/raft-health for 10.1.1.81:33272 [martini] Completed 200 OK in 675.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.545114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 999.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.36321ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.361218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.062104ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.299009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.328014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.089405ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.266509ms [martini] Started GET /api/raft-follower-health-report/30bc796b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 777.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.012017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.961912ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.246517ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.398714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 922.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.564615ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.243213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 828.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.985508ms [martini] Started GET /api/lb-check for 10.1.1.81:33424 [martini] Completed 200 OK in 1.085705ms [martini] Started GET /api/raft-health for 10.1.1.81:33440 [martini] Completed 200 OK in 713.403µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.121617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.135904ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.007708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.956416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 734.103µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.276913ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.484015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.005205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.37481ms [martini] Started GET /api/raft-follower-health-report/25552f02/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 706.203µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.500315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.075504ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.343609ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.053013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 907.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.832108ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.036213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 838.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.144009ms [martini] Started GET /api/lb-check for 10.1.1.81:33592 [martini] Completed 200 OK in 2.193009ms [martini] Started GET /api/raft-health for 10.1.1.81:33616 [martini] Completed 200 OK in 932.904µs 2018-11-29 06:39:43 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.507014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.116104ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.357809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.239713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.245505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.759311ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.342014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.025005ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.930508ms [martini] Started GET /api/raft-follower-health-report/1ae9d019/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 781.803µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.119446ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.205705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.32211ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.301914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 923.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.825408ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.948613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 827.003µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.984208ms [martini] Started GET /api/lb-check for 10.1.1.81:33750 [martini] Completed 200 OK in 720.103µs [martini] Started GET /api/raft-health for 10.1.1.81:33764 [martini] Completed 200 OK in 845.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.908916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 933.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.795716ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.514947ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 890.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.995509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.744816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 956.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.976609ms 2018-11-29 06:39:55 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/291f6601/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 675.703µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.405515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 893.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.101108ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.072113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 969.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.996708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.437531ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.711608ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.676012ms [martini] Started GET /api/lb-check for 10.1.1.81:33912 [martini] Completed 200 OK in 712.503µs [martini] Started GET /api/raft-health for 10.1.1.81:33920 [martini] Completed 200 OK in 644.003µs 2018-11-29 06:40:01 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.144329ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.046604ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.386109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.994817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.005704ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.235809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.246214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.025804ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.028709ms [martini] Started GET /api/raft-follower-health-report/4a17d208/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 962.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.837716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 923.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.987708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.123313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 920.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.022108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.509115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 841.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.749307ms [martini] Started GET /api/lb-check for 10.1.1.81:34062 [martini] Completed 200 OK in 662.002µs [martini] Started GET /api/raft-health for 10.1.1.81:34072 [martini] Completed 200 OK in 962.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.985817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.014704ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.955113ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.937016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 769.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.967408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.042212ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 899.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.138209ms 2018-11-29 06:40:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/1f5381ab/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 906.603µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.018417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.043304ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.640432ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.066217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 824.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27541ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.584019ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 899.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.657012ms [martini] Started GET /api/lb-check for 10.1.1.81:34220 [martini] Completed 200 OK in 787.404µs [martini] Started GET /api/raft-health for 10.1.1.81:34254 [martini] Completed 200 OK in 630.502µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.721316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 906.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.823108ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.720415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 871.403µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.118009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.649933ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 881.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.863508ms [martini] Started GET /api/raft-follower-health-report/92e85c0d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 785.103µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.475315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.106605ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.918108ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.026913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.039204ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.901708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.837716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 852.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.948009ms [martini] Started GET /api/lb-check for 10.1.1.81:34410 [martini] Completed 200 OK in 654.603µs [martini] Started GET /api/raft-health for 10.1.1.81:34420 [martini] Completed 200 OK in 3.006313ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.882617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.125705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.098109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.461615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 845.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.928708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.273614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 953.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.197109ms [martini] Started GET /api/raft-follower-health-report/9bf2c387/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 874.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.205522ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.025004ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.162709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.331414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 948.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.924308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.208013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 866.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.006909ms [martini] Started GET /api/lb-check for 10.1.1.81:34570 [martini] Completed 200 OK in 831.404µs [martini] Started GET /api/raft-health for 10.1.1.81:34582 [martini] Completed 200 OK in 806.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.739216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.383605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.150409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.744238ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.032004ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.116409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.354623ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 835.903µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.214309ms [martini] Started GET /api/raft-follower-health-report/6c412614/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 687.703µs 2018-11-29 06:40:49 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.686616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 999.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.370023ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.247114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 800.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.969608ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.501915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.211105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.832708ms [martini] Started GET /api/lb-check for 10.1.1.81:34716 [martini] Completed 200 OK in 932.004µs [martini] Started GET /api/raft-health for 10.1.1.81:34736 [martini] Completed 200 OK in 947.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.281322ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.452007ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.895308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.463123ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.323306ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.940808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.504323ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.011005ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.742007ms 2018-11-29 06:40:55 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/dcfde6d4/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 4.487419ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.180818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.048804ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21351ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.664415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 996.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.258709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.792929ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.015204ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.170309ms [martini] Started GET /api/lb-check for 10.1.1.81:34886 [martini] Completed 200 OK in 658.403µs [martini] Started GET /api/raft-health for 10.1.1.81:34912 [martini] Completed 200 OK in 651.403µs 2018-11-29 06:41:01 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.763116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.82222ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.617212ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.351614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 832.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.866608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.303314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 867.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.930409ms [martini] Started GET /api/raft-follower-health-report/0ea4350c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 713.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.493415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 947.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.043409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.468915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.35761ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.196109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.279514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 918.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.926809ms [martini] Started GET /api/lb-check for 10.1.1.81:35060 [martini] Completed 200 OK in 680.903µs [martini] Started GET /api/raft-health for 10.1.1.81:35072 [martini] Completed 200 OK in 783.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.483915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.072205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.603412ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.696625ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.065705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.858708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.072814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.926509ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.160909ms 2018-11-29 06:41:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/35989d18/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 756.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.979617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 860.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.115509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.555416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.059005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21691ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.119514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 867.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.960008ms [martini] Started GET /api/lb-check for 10.1.1.81:35222 [martini] Completed 200 OK in 814.304µs [martini] Started GET /api/raft-health for 10.1.1.81:35234 [martini] Completed 200 OK in 678.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.814117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 747.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.202109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.559316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 984.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.46611ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.554419ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 897.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.826808ms [martini] Started GET /api/raft-follower-health-report/cce3a4d4/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 926.404µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.27344ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.63812ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.157627ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.080039ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.631107ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.333818ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.501232ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.033104ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.044609ms [martini] Started GET /api/lb-check for 10.1.1.81:35388 [martini] Completed 200 OK in 869.204µs [martini] Started GET /api/raft-health for 10.1.1.81:35414 [martini] Completed 200 OK in 712.703µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.338924ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.866921ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.031508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.404515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 828.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.546124ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.241914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 850.903µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.12641ms [martini] Started GET /api/raft-follower-health-report/d8e5efd7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 973.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.300128ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.095909ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.023313ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.740616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.293906ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.024321ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.033417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 880.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.410336ms [martini] Started GET /api/lb-check for 10.1.1.81:35556 [martini] Completed 200 OK in 2.811612ms [martini] Started GET /api/raft-health for 10.1.1.81:35578 [martini] Completed 200 OK in 741.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.698716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 913.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.093009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.485615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 983.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.897509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.350315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 948.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.948908ms [martini] Started GET /api/raft-follower-health-report/a14558e6/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 692.003µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.807416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.251305ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.446511ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.676825ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 879.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.905808ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.497715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 868.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.023209ms [martini] Started GET /api/lb-check for 10.1.1.81:35714 [martini] Completed 200 OK in 634.003µs [martini] Started GET /api/raft-health for 10.1.1.81:35726 [martini] Completed 200 OK in 840.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.603116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 907.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.73793ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.58402ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.094805ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.558611ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.034822ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 829.803µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27191ms 2018-11-29 06:41:55 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/261a2290/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 768.303µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.617616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 898.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.032509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.498715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 846.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.091422ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.416919ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.093405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.517924ms [martini] Started GET /api/lb-check for 10.1.1.81:35870 [martini] Completed 200 OK in 786.904µs [martini] Started GET /api/raft-health for 10.1.1.81:35880 [martini] Completed 200 OK in 774.403µs 2018-11-29 06:42:01 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.486115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 877.203µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.906809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.096418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 927.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.899308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.792416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.062005ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.023209ms 2018-11-29 06:42:07 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/5e1a851f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 696.903µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.788916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 881.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.097009ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.906613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.168906ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.770508ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.198814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 792.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.021109ms [martini] Started GET /api/lb-check for 10.1.1.81:36020 [martini] Completed 200 OK in 767.404µs [martini] Started GET /api/raft-health for 10.1.1.81:36048 [martini] Completed 200 OK in 650.003µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.995017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 892.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.920408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.020113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 763.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.897108ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.611716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 901.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.782708ms 2018-11-29 06:42:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/7cb4b65a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 763.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.872917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.037114ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.307514ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.087918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 840.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.097409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.927517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 955.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.801707ms [martini] Started GET /api/lb-check for 10.1.1.81:36188 [martini] Completed 200 OK in 813.903µs [martini] Started GET /api/raft-health for 10.1.1.81:36200 [martini] Completed 200 OK in 684.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.906617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 975.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.049109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.044122ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.077505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.020013ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.924422ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 900.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.137709ms [martini] Started GET /api/raft-follower-health-report/6a67ca6d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 738.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.451541ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 963.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.983108ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.569937ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.081905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.728712ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.015917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.046804ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.959109ms [martini] Started GET /api/lb-check for 10.1.1.81:36350 [martini] Completed 200 OK in 2.413111ms [martini] Started GET /api/raft-health for 10.1.1.81:36360 [martini] Completed 200 OK in 618.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.53072ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.085605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.064909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.202914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 947.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.06851ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.097814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 935.005µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.13671ms [martini] Started GET /api/raft-follower-health-report/b57d416b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.736208ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.53712ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.057205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.297211ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.419715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 947.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.941309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.465915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 912.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.909808ms [martini] Started GET /api/lb-check for 10.1.1.81:36504 [martini] Completed 200 OK in 749.803µs [martini] Started GET /api/raft-health for 10.1.1.81:36516 [martini] Completed 200 OK in 971.604µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.948117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.110505ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.222527ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.571015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 737.803µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.386011ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.315615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.074305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.140309ms [martini] Started GET /api/raft-follower-health-report/e8eb8d78/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 841.103µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.751116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 970.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.930909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.135314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.112205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.828508ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.491624ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.456316ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22531ms [martini] Started GET /api/lb-check for 10.1.1.81:36684 [martini] Completed 200 OK in 715.003µs [martini] Started GET /api/raft-health for 10.1.1.81:36714 [martini] Completed 200 OK in 689.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.434615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 989.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.981009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.195623ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 968.005µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.169409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.310123ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 761.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.09851ms 2018-11-29 06:42:55 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/cfb05022/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 773.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.370515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 978.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.984708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.582934ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 846.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.844608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.805021ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.048213ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.646612ms [martini] Started GET /api/lb-check for 10.1.1.81:36856 [martini] Completed 200 OK in 697.304µs [martini] Started GET /api/raft-health for 10.1.1.81:36868 [martini] Completed 200 OK in 778.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.126832ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.935908ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.016409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.260214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 897.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.864209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.052014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 916.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.874808ms 2018-11-29 06:43:07 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/a7172947/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 729.504µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.632216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.039205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.065609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.010313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.089305ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.33861ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.708116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 968.605µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18931ms [martini] Started GET /api/lb-check for 10.1.1.81:37014 [martini] Completed 200 OK in 672.403µs [martini] Started GET /api/raft-health for 10.1.1.81:37024 [martini] Completed 200 OK in 738.203µs 2018-11-29 06:43:13 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.359015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 904.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.016709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.748416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 903.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.788508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.029614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 747.103µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.278524ms 2018-11-29 06:43:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/cb39c91b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 869.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.245614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 990.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.950609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.429416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 856.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.947409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.056613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 929.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.004109ms [martini] Started GET /api/lb-check for 10.1.1.81:37178 [martini] Completed 200 OK in 632.702µs [martini] Started GET /api/raft-health for 10.1.1.81:37192 [martini] Completed 200 OK in 724.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.568016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.033405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.693612ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.425415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 969.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.157009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.520924ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 823.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.921008ms [martini] Started GET /api/raft-follower-health-report/945ecc5f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 883.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.365015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.973717ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.554925ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.848739ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.331915ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.36981ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.403915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.061105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19431ms [martini] Started GET /api/lb-check for 10.1.1.81:37338 [martini] Completed 200 OK in 625.303µs [martini] Started GET /api/raft-health for 10.1.1.81:37368 [martini] Completed 200 OK in 666.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.703016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.008005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.983509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.047613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 902.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.750416ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.032113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 732.703µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.096913ms [martini] Started GET /api/raft-follower-health-report/8b788eeb/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 760.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.161719ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 899.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.025409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.335415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 851.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.972709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.168814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 819.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.959609ms [martini] Started GET /api/lb-check for 10.1.1.81:37510 [martini] Completed 200 OK in 825.004µs [martini] Started GET /api/raft-health for 10.1.1.81:37522 [martini] Completed 200 OK in 872.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.787716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.074505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.022509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.170714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 906.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.982809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.318615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 788.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.857608ms [martini] Started GET /api/raft-follower-health-report/fea62ff7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 627.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.697417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.042004ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.10421ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.165314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 840.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.885808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.989531ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.336606ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.963309ms [martini] Started GET /api/lb-check for 10.1.1.81:37664 [martini] Completed 200 OK in 1.014804ms [martini] Started GET /api/raft-health for 10.1.1.81:37688 [martini] Completed 200 OK in 859.104µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.850726ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.033205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.626648ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.136314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 849.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.742712ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.64572ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.016004ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.973909ms [martini] Started GET /api/raft-follower-health-report/cec4d20f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 850.204µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.547416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.080705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27381ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.016014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 930.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.70483ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.173124ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 897.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.014609ms [martini] Started GET /api/lb-check for 10.1.1.81:37842 [martini] Completed 200 OK in 820.404µs [martini] Started GET /api/raft-health for 10.1.1.81:37866 [martini] Completed 200 OK in 732.103µs 2018-11-29 06:44:01 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.502529ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 863.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.997509ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.036813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 805.303µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.960009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.339215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 779.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.145509ms 2018-11-29 06:44:07 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/34348932/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 812.804µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.608516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.060405ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.002909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.197814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.045105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.923509ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.949514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 741.303µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.967809ms [martini] Started GET /api/lb-check for 10.1.1.81:38002 [martini] Completed 200 OK in 744.903µs [martini] Started GET /api/raft-health for 10.1.1.81:38024 [martini] Completed 200 OK in 776.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.615717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 931.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.14881ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.408315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.367406ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22721ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.406315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 941.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.944509ms 2018-11-29 06:44:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/f6200c6c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 842.304µs 2018-11-29 06:44:19 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.64512ms [martini] Started GET /api/lb-check for 10.1.1.81:38184 [martini] Completed 200 OK in 738.503µs [martini] Started GET /api/raft-health for 10.1.1.81:38198 [martini] Completed 200 OK in 876.404µs [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.139405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.38161ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.282215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 947.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.988722ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.926818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 718.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.09711ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.054313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 858.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.799808ms [martini] Started GET /api/raft-follower-health-report/d7481f62/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.058305ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.353116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 881.603µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.889409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.190314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 882.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.910309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.884913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.037305ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.859008ms [martini] Started GET /api/lb-check for 10.1.1.81:38348 [martini] Completed 200 OK in 613.203µs [martini] Started GET /api/raft-health for 10.1.1.81:38358 [martini] Completed 200 OK in 789.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.043327ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.815508ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.14111ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.450816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.007505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.33471ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.249414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 851.303µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.828908ms [martini] Started GET /api/raft-follower-health-report/c8673f13/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 751.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.666617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.017304ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.960208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.107814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 867.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.096541ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.182715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 724.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.851308ms [martini] Started GET /api/lb-check for 10.1.1.81:38506 [martini] Completed 200 OK in 633.203µs [martini] Started GET /api/raft-health for 10.1.1.81:38532 [martini] Completed 200 OK in 752.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.384215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.393607ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.964309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.304815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 719.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.009909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.729213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.519707ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.998222ms [martini] Started GET /api/raft-follower-health-report/a0b538aa/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 871.304µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.36762ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 799.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.880708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.929118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 985.605µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.892708ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.478515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 773.803µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.603012ms [martini] Started GET /api/lb-check for 10.1.1.81:38674 [martini] Completed 200 OK in 671.403µs [martini] Started GET /api/raft-health for 10.1.1.81:38690 [martini] Completed 200 OK in 921.404µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.44492ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.137905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20581ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.631717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 790.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.053009ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.53522ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.026705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.468211ms [martini] Started GET /api/raft-follower-health-report/34b601e6/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 737.403µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.794017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 905.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.351519ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.785922ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.283806ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.566212ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.813731ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 880.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.039514ms [martini] Started GET /api/lb-check for 10.1.1.81:38832 [martini] Completed 200 OK in 760.904µs [martini] Started GET /api/raft-health for 10.1.1.81:38844 [martini] Completed 200 OK in 674.403µs 2018-11-29 06:45:01 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.813817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 791.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.926809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.795817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.490307ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.525811ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.48462ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 795.803µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.709608ms 2018-11-29 06:45:07 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/06994175/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 894.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.567416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 788.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16991ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.483715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 863.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.895709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.571116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 999.305µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.989809ms [martini] Started GET /api/lb-check for 10.1.1.81:38984 [martini] Completed 200 OK in 1.153705ms [martini] Started GET /api/raft-health for 10.1.1.81:38994 [martini] Completed 200 OK in 809.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.900218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.016405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.353911ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.754317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.055105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.151309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.063314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.004805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29681ms 2018-11-29 06:45:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/55ced1c6/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 800.404µs 2018-11-29 06:45:19 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.761517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.274105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21181ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.321315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 857.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.997309ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.610216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 927.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.15441ms [martini] Started GET /api/lb-check for 10.1.1.81:39136 [martini] Completed 200 OK in 763.703µs [martini] Started GET /api/raft-health for 10.1.1.81:39162 [martini] Completed 200 OK in 662.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.902918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.069905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.219842ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.602821ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 938.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.003509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.343315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 764.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.782708ms [martini] Started GET /api/raft-follower-health-report/49364d12/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 848.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.567016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 847.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.892209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.612443ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.095905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16941ms [martini] Started GET /api/lb-check for 10.1.1.81:39310 [martini] Completed 200 OK in 604.702µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 13.812363ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 924.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.062009ms [martini] Started GET /api/raft-health for 10.1.1.81:39320 [martini] Completed 200 OK in 692.903µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.975823ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.115305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.070209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.211315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 859.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26031ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.705716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 818.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.37681ms [martini] Started GET /api/raft-follower-health-report/0f0b51ad/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 802.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.32372ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 906.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.10891ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.250314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 786.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.983409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.036114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 838.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.918009ms [martini] Started GET /api/lb-check for 10.1.1.81:39468 [martini] Completed 200 OK in 1.113805ms [martini] Started GET /api/raft-health for 10.1.1.81:39476 [martini] Completed 200 OK in 764.603µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.901718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 896.805µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.257515ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.232714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 946.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.814409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.092014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 946.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.002309ms [martini] Started GET /api/raft-follower-health-report/034ed069/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 862.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.281015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 761.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.67713ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.396015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.040605ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.05971ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.641821ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.299006ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.323211ms [martini] Started GET /api/lb-check for 10.1.1.81:39626 [martini] Completed 200 OK in 764.803µs [martini] Started GET /api/raft-health for 10.1.1.81:39640 [martini] Completed 200 OK in 924.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.583716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 981.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.967313ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.240719ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.003104ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.36111ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.966118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 865.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.351411ms [martini] Started GET /api/raft-follower-health-report/80bfe4ce/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 957.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.639021ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.016805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.875009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.309028ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 942.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.15801ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.664125ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 910.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.448311ms [martini] Started GET /api/lb-check for 10.1.1.81:39788 [martini] Completed 200 OK in 2.366411ms [martini] Started GET /api/raft-health for 10.1.1.81:39810 [martini] Completed 200 OK in 838.603µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.34482ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 864.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18051ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.098514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 6.030828ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.973209ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.145214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 913.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.859008ms 2018-11-29 06:46:07 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 06:46:07 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/96fd531e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.105305ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.745117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.115405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.13181ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.360015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.006504ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.353311ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.486016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 876.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.086509ms [martini] Started GET /api/lb-check for 10.1.1.81:39948 [martini] Completed 200 OK in 1.104705ms [martini] Started GET /api/raft-health for 10.1.1.81:39958 [martini] Completed 200 OK in 812.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.684816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 853.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.173119ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.30992ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.034805ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.899009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.706817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 967.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.051909ms 2018-11-29 06:46:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/5c8187bf/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 868.304µs 2018-11-29 06:46:19 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.004718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.078305ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.05951ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.102114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 831.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19511ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.276124ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 814.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.656212ms [martini] Started GET /api/lb-check for 10.1.1.81:40104 [martini] Completed 200 OK in 599.603µs [martini] Started GET /api/raft-health for 10.1.1.81:40118 [martini] Completed 200 OK in 904.605µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.920118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 877.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.13031ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.148919ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 913.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.02121ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.60553ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 861.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.17671ms [martini] Started GET /api/raft-follower-health-report/89f32ab0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 746.603µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.401516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.045104ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28051ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.133419ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 992.205µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.565012ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.111219ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.585908ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.084709ms [martini] Started GET /api/lb-check for 10.1.1.81:40264 [martini] Completed 200 OK in 657.803µs [martini] Started GET /api/raft-health for 10.1.1.81:40274 [martini] Completed 200 OK in 767.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.987127ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 5.845027ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.030109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.188815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 901.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.935909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.086914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.34781ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.971509ms [martini] Started GET /api/raft-follower-health-report/1f49d365/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 786.304µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.640616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 830.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.161009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.360315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.597112ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.710122ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.876918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.051605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.34661ms [martini] Started GET /api/lb-check for 10.1.1.81:40422 [martini] Completed 200 OK in 675.603µs [martini] Started GET /api/raft-health for 10.1.1.81:40444 [martini] Completed 200 OK in 724.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.394416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 864.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28651ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.657817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 801.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19691ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.239615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.521107ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.876636ms [martini] Started GET /api/raft-follower-health-report/8609b5c3/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 735.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.980718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 929.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.873309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.446615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 978.805µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.981909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.361616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 902.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.900308ms [martini] Started GET /api/lb-check for 10.1.1.81:40584 [martini] Completed 200 OK in 804.104µs [martini] Started GET /api/raft-health for 10.1.1.81:40600 [martini] Completed 200 OK in 704.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.878117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.064305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23961ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.269815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 772.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.22832ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.618117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.12241ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28591ms [martini] Started GET /api/raft-follower-health-report/96b9939d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 812.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.563616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 800.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.927332ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.092223ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.007005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.920013ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.773127ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.410307ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.570512ms [martini] Started GET /api/lb-check for 10.1.1.81:40740 [martini] Completed 200 OK in 637.803µs [martini] Started GET /api/raft-health for 10.1.1.81:40752 [martini] Completed 200 OK in 752.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.106819ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.017805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.049809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.687417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.05921ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.376625ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.824513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 839.203µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.681008ms 2018-11-29 06:47:07 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 06:47:07 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/9672e606/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 862.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.176319ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 974.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19701ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.450416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.768908ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.98821ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.023913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 781.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.812518ms [martini] Started GET /api/lb-check for 10.1.1.81:40892 [martini] Completed 200 OK in 958.904µs [martini] Started GET /api/raft-health for 10.1.1.81:40918 [martini] Completed 200 OK in 886.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.860418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.015804ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.652412ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.359215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 766.003µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.01131ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.281415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 752.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.374111ms 2018-11-29 06:47:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/67221231/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 919.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.905718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 808.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27471ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.522016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 818.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.04211ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.305215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 914.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.074509ms [martini] Started GET /api/lb-check for 10.1.1.81:41056 [martini] Completed 200 OK in 840.104µs [martini] Started GET /api/raft-health for 10.1.1.81:41082 [martini] Completed 200 OK in 703.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.977318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 844.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.575626ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.295824ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 872.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.801009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.188615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.068105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.372811ms 2018-11-29 06:47:25 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/9276ad0e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 819.803µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.518416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 840.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.325911ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.128714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.037904ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.289815ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.119441ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.019405ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.446111ms [martini] Started GET /api/lb-check for 10.1.1.81:41224 [martini] Completed 200 OK in 1.033205ms [martini] Started GET /api/raft-health for 10.1.1.81:41236 [martini] Completed 200 OK in 850.803µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.29522ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.357806ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.999309ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.314415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.211906ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.419315ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.555816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.025504ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.500916ms [martini] Started GET /api/raft-follower-health-report/177a63ab/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 755.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.725017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.099905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.049009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.510016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 898.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.871409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.245815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 817.203µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.567212ms [martini] Started GET /api/lb-check for 10.1.1.81:41384 [martini] Completed 200 OK in 667.003µs [martini] Started GET /api/raft-health for 10.1.1.81:41392 [martini] Completed 200 OK in 609.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.951318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 868.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.287511ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.159114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 924.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.02061ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.189814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 859.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.839708ms [martini] Started GET /api/raft-follower-health-report/f48345f5/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 705.903µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.068323ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 915.205µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.321551ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.220515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 868.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.499316ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.53133ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 942.205µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.897609ms [martini] Started GET /api/lb-check for 10.1.1.81:41538 [martini] Completed 200 OK in 737.003µs [martini] Started GET /api/raft-health for 10.1.1.81:41566 [martini] Completed 200 OK in 704.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.183919ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 727.703µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.768313ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.870417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 726.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.050218ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.847222ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 852.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.12121ms [martini] Started GET /api/raft-follower-health-report/9e695e1a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 840.904µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.080619ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 913.405µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.917509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.667926ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 5.039123ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.686022ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.361629ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 975.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.15231ms [martini] Started GET /api/lb-check for 10.1.1.81:41708 [martini] Completed 200 OK in 2.022209ms [martini] Started GET /api/raft-health for 10.1.1.81:41722 [martini] Completed 200 OK in 943.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.572117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.071505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.08231ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.126314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 934.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.982809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.231515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 884.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.822508ms [martini] Started GET /api/raft-follower-health-report/91dac470/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.918509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.192514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.103305ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.06631ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.51313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.858108ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.911309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.275115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 975.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.769008ms [martini] Started GET /api/lb-check for 10.1.1.81:41860 [martini] Completed 200 OK in 785.803µs [martini] Started GET /api/raft-health for 10.1.1.81:41870 [martini] Completed 200 OK in 963.604µs 2018-11-29 06:48:13 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 06:48:13 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.921618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 988.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.836318ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.229828ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.014705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.101209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.029014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 856.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.17171ms 2018-11-29 06:48:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/97dc1332/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 722.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.693717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.077805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.432311ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.417816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 966.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19201ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.465125ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.110505ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.929008ms [martini] Started GET /api/lb-check for 10.1.1.81:42024 [martini] Completed 200 OK in 1.050405ms [martini] Started GET /api/raft-health for 10.1.1.81:42042 [martini] Completed 200 OK in 880.804µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.963018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 938.305µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.914509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.817336ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 973.005µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.659312ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.735322ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.112005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.10651ms [martini] Started GET /api/raft-follower-health-report/1d1164c7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 808.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.579117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.014705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.918509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.988419ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.272715ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.652617ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.001214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 831.903µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.201928ms [martini] Started GET /api/lb-check for 10.1.1.81:42188 [martini] Completed 200 OK in 820.703µs [martini] Started GET /api/raft-health for 10.1.1.81:42210 [martini] Completed 200 OK in 680.903µs 2018-11-29 06:48:31 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.586926ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.10091ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.052809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.001614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 784.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.793809ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.018814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 879.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.970609ms [martini] Started GET /api/raft-follower-health-report/23ed91e5/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 701.704µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.474216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 990.205µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.968209ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.137814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.074505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.037614ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.353816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 837.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.929109ms [martini] Started GET /api/lb-check for 10.1.1.81:42356 [martini] Completed 200 OK in 786.004µs [martini] Started GET /api/raft-health for 10.1.1.81:42366 [martini] Completed 200 OK in 991.005µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.642617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.045305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.475111ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.014714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 997.205µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.986309ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.969113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 834.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.860918ms [martini] Started GET /api/raft-follower-health-report/1359214f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 800.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.390715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.140605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.968814ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.307815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.476607ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18681ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.590117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.108205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.223911ms [martini] Started GET /api/lb-check for 10.1.1.81:42508 [martini] Completed 200 OK in 675.704µs [martini] Started GET /api/raft-health for 10.1.1.81:42526 [martini] Completed 200 OK in 1.132305ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.577017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 863.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.982709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.335924ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 938.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.14311ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.909622ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.114606ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.134109ms [martini] Started GET /api/raft-follower-health-report/c6872de0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 660.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.435916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 905.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.971109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.261452ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 833.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22721ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.033832ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.033105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.074309ms [martini] Started GET /api/lb-check for 10.1.1.81:42680 [martini] Completed 200 OK in 554.102µs [martini] Started GET /api/raft-health for 10.1.1.81:42694 [martini] Completed 200 OK in 3.729717ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.988218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 907.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.09001ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.233914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 778.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.12121ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.722931ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 791.703µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.059109ms [martini] Started GET /api/raft-follower-health-report/b25fc882/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 669.903µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.648216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 983.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19171ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.618916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 964.505µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.985209ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.068514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 850.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.242511ms [martini] Started GET /api/lb-check for 10.1.1.81:42834 [martini] Completed 200 OK in 2.20911ms [martini] Started GET /api/raft-health for 10.1.1.81:42860 [martini] Completed 200 OK in 848.804µs 2018-11-29 06:49:13 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.293019ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.194305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.10241ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.172215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 972.605µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.14941ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.051814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 776.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.854208ms 2018-11-29 06:49:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/722b62ba/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 915.704µs 2018-11-29 06:49:19 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.814018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.225006ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.101109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.291715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 916.805µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.930309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.992713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 805.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.750508ms [martini] Started GET /api/lb-check for 10.1.1.81:43002 [martini] Completed 200 OK in 662.303µs [martini] Started GET /api/raft-health for 10.1.1.81:43018 [martini] Completed 200 OK in 1.570808ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.823518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 951.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.656913ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.696226ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.859208ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.845313ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.210024ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 892.505µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.04971ms [martini] Started GET /api/raft-follower-health-report/dbb71cb2/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 713.103µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.797418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 955.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.14591ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.101119ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 962.005µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.358511ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.80744ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.419515ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.871508ms [martini] Started GET /api/lb-check for 10.1.1.81:43166 [martini] Completed 200 OK in 655.503µs [martini] Started GET /api/raft-health for 10.1.1.81:43178 [martini] Completed 200 OK in 646.803µs 2018-11-29 06:49:31 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.854318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.011905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.977209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.979714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 958.505µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.939209ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.325915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 826.603µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.04641ms [martini] Started GET /api/raft-follower-health-report/95c9aabe/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 673.604µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.020819ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.132505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.064309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.39542ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.029905ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.288111ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.118814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 848.703µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.030109ms [martini] Started GET /api/lb-check for 10.1.1.81:43320 [martini] Completed 200 OK in 692.803µs [martini] Started GET /api/raft-health for 10.1.1.81:43330 [martini] Completed 200 OK in 800.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.003519ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 843.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.903509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.250515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 830.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.09081ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.091114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 828.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.906008ms [martini] Started GET /api/raft-follower-health-report/a46a8f17/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 778.403µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.051419ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 826.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.437515ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.832618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 908.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.044409ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.234915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 850.203µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.807508ms [martini] Started GET /api/lb-check for 10.1.1.81:43472 [martini] Completed 200 OK in 646.003µs [martini] Started GET /api/raft-health for 10.1.1.81:43500 [martini] Completed 200 OK in 701.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.25672ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.132305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.121709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.819917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 794.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.999809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.933213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 6.47233ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.040809ms [martini] Started GET /api/raft-follower-health-report/f78f60b0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 783.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.424616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.003904ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.989009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.888341ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.169105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.06061ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.088218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.727217ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.862609ms [martini] Started GET /api/lb-check for 10.1.1.81:43646 [martini] Completed 200 OK in 679.403µs [martini] Started GET /api/raft-health for 10.1.1.81:43656 [martini] Completed 200 OK in 2.839813ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.548916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 960.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.916109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.229115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 902.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.03881ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.865413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 910.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.911008ms [martini] Started GET /api/raft-follower-health-report/51fc2b12/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 978.405µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.177824ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.645607ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.01231ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.448716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 728.703µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.943309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.889013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 847.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.867009ms [martini] Started GET /api/lb-check for 10.1.1.81:43798 [martini] Completed 200 OK in 848.904µs [martini] Started GET /api/raft-health for 10.1.1.81:43810 [martini] Completed 200 OK in 780.104µs 2018-11-29 06:50:13 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.710417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 966.605µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.916709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.138819ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.808209ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.896709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.091214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 902.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.829808ms 2018-11-29 06:50:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/ab774430/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 801.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.543816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.017805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.015409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.600916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 992.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.771317ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.117614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.122809ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.412311ms [martini] Started GET /api/lb-check for 10.1.1.81:43950 [martini] Completed 200 OK in 713.503µs [martini] Started GET /api/raft-health for 10.1.1.81:43978 [martini] Completed 200 OK in 699.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.776118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 924.805µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16911ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.55513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 969.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.15541ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.003018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.044605ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.002819ms 2018-11-29 06:50:25 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/70be2962/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 799.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.751918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.220105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.03201ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.696117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.230906ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.500911ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.671922ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.126705ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18461ms [martini] Started GET /api/lb-check for 10.1.1.81:44114 [martini] Completed 200 OK in 594.702µs [martini] Started GET /api/raft-health for 10.1.1.81:44138 [martini] Completed 200 OK in 629.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.020523ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.317606ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.040209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.946914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 966.405µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.810809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.455916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 828.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.689308ms 2018-11-29 06:50:37 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/4aecc5c0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 677.403µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.696922ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.025005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.359611ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.113815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.871314ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.06381ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.293415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 921.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.830208ms [martini] Started GET /api/lb-check for 10.1.1.81:44286 [martini] Completed 200 OK in 707.103µs [martini] Started GET /api/raft-health for 10.1.1.81:44296 [martini] Completed 200 OK in 1.318906ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.419916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.074005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.599612ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.15032ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 974.305µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.468212ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.132114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 865.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.424939ms [martini] Started GET /api/raft-follower-health-report/ecea6bcf/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 609.602µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.535516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.042205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.03941ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.640522ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.030504ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.344811ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.970414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 945.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.554411ms [martini] Started GET /api/lb-check for 10.1.1.81:44440 [martini] Completed 200 OK in 542.503µs [martini] Started GET /api/raft-health for 10.1.1.81:44454 [martini] Completed 200 OK in 668.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.030019ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.090405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.253811ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.474025ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.008705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.287311ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.746827ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.326206ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16851ms [martini] Started GET /api/raft-follower-health-report/72bcf492/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 860.004µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.29222ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.32021ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.323916ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.333725ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.101205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.073409ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.25602ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 774.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.016409ms [martini] Started GET /api/lb-check for 10.1.1.81:44598 [martini] Completed 200 OK in 807.903µs [martini] Started GET /api/raft-health for 10.1.1.81:44624 [martini] Completed 200 OK in 936.705µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.566217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 917.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.02141ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.291315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 812.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.420039ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.568816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.080605ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.955613ms [martini] Started GET /api/raft-follower-health-report/1847810d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.392407ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.642117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.088605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.024709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.179515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 933.605µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.867709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.247015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 891.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.587816ms [martini] Started GET /api/lb-check for 10.1.1.81:44766 [martini] Completed 200 OK in 742.404µs [martini] Started GET /api/raft-health for 10.1.1.81:44776 [martini] Completed 200 OK in 838.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.450016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 879.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.04251ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.153915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 892.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.882008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.094614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 737.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.906409ms 2018-11-29 06:51:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/7836e19e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 838.504µs 2018-11-29 06:51:19 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.39792ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.367411ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23161ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.672417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 876.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19081ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.547316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 837.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.012809ms [martini] Started GET /api/lb-check for 10.1.1.81:44918 [martini] Completed 200 OK in 977.704µs [martini] Started GET /api/raft-health for 10.1.1.81:44932 [martini] Completed 200 OK in 815.304µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.752217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.023305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.639026ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.942028ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.168805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.937714ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.694222ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.058305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.427411ms [martini] Started GET /api/raft-follower-health-report/7a519070/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 2.283311ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.585326ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.373106ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.11031ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.018842ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 944.105µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.363116ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.730322ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.570716ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.983609ms [martini] Started GET /api/lb-check for 10.1.1.81:45086 [martini] Completed 200 OK in 636.503µs [martini] Started GET /api/raft-health for 10.1.1.81:45098 [martini] Completed 200 OK in 802.104µs 2018-11-29 06:51:31 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.054919ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.111605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.025309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.169315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 982.205µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.11881ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.276215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 872.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.232111ms 2018-11-29 06:51:37 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/58c6395e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 757.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.225815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 971.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.526212ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.724917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 866.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.890808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.903018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.001405ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.967409ms [martini] Started GET /api/lb-check for 10.1.1.81:45238 [martini] Completed 200 OK in 652.203µs [martini] Started GET /api/raft-health for 10.1.1.81:45266 [martini] Completed 200 OK in 693.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.702218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 815.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21731ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.546717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 870.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.09531ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.207315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 800.803µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.625712ms [martini] Started GET /api/raft-follower-health-report/64d2988b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 716.103µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.515817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 843.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.845341ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.143015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 867.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.96931ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.455716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 905.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.860508ms [martini] Started GET /api/lb-check for 10.1.1.81:45406 [martini] Completed 200 OK in 618.203µs [martini] Started GET /api/raft-health for 10.1.1.81:45424 [martini] Completed 200 OK in 871.304µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.963819ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 809.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.07531ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.664822ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.422207ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.090623ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.28902ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.448812ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.17931ms [martini] Started GET /api/raft-follower-health-report/8da81467/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 808.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.452716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.240006ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.98191ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.117124ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.155005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.340511ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.443725ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.192205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.985309ms [martini] Started GET /api/lb-check for 10.1.1.81:45574 [martini] Completed 200 OK in 4.41112ms [martini] Started GET /api/raft-health for 10.1.1.81:45590 [martini] Completed 200 OK in 928.004µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.025619ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.225506ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.07811ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.466216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 895.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.15601ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.095314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 791.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.038709ms [martini] Started GET /api/raft-follower-health-report/1a9f6a96/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 819.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.468816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.594607ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.249911ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.114114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 912.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.05251ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.053114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 957.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.940709ms [martini] Started GET /api/lb-check for 10.1.1.81:45724 [martini] Completed 200 OK in 791.704µs [martini] Started GET /api/raft-health for 10.1.1.81:45734 [martini] Completed 200 OK in 740.804µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.011418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.208606ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.544931ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.146414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 857.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.04291ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.317715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 969.105µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.918009ms 2018-11-29 06:52:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/39d13ee0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 824.603µs 2018-11-29 06:52:19 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.791316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.229805ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.658512ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.496215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.114404ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.215913ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.635719ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 837.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.010709ms [martini] Started GET /api/lb-check for 10.1.1.81:45882 [martini] Completed 200 OK in 659.703µs [martini] Started GET /api/raft-health for 10.1.1.81:45912 [martini] Completed 200 OK in 810.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.950516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 987.905µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.823728ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.888133ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.212505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.082909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.958721ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.171205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.720911ms [martini] Started GET /api/raft-follower-health-report/c7211be0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 645.903µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.442122ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.666507ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.45341ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.079817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 926.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.244009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.016017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 883.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.807508ms [martini] Started GET /api/lb-check for 10.1.1.81:46060 [martini] Completed 200 OK in 650.703µs [martini] Started GET /api/raft-health for 10.1.1.81:46072 [martini] Completed 200 OK in 821.804µs 2018-11-29 06:52:31 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.406514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 974.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.821607ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.482315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 862.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.139909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.906912ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 888.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.891708ms [martini] Started GET /api/raft-follower-health-report/79651014/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 760.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.739715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 949.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.780624ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.396714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 934.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.026608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.101913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 775.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.841108ms [martini] Started GET /api/lb-check for 10.1.1.81:46212 [martini] Completed 200 OK in 659.603µs [martini] Started GET /api/raft-health for 10.1.1.81:46224 [martini] Completed 200 OK in 697.703µs 2018-11-29 06:52:43 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.775816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 826.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.155609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.381814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.189009ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.138518ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.161414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.477806ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.851908ms [martini] Started GET /api/raft-follower-health-report/faa92e69/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 747.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.686916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.223105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.622711ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.400614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 919.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.954108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.285514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 881.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.029916ms [martini] Started GET /api/lb-check for 10.1.1.81:46366 [martini] Completed 200 OK in 835.903µs [martini] Started GET /api/raft-health for 10.1.1.81:46384 [martini] Completed 200 OK in 592.702µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.158622ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.024504ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.059408ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.96783ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 971.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.187309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.140813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.234205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.205009ms [martini] Started GET /api/raft-follower-health-report/2400ed10/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 687.403µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.660616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.027904ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.078408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.120713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 852.203µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.507815ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.428715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 912.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.585511ms [martini] Started GET /api/lb-check for 10.1.1.81:46530 [martini] Completed 200 OK in 669.903µs [martini] Started GET /api/raft-health for 10.1.1.81:46554 [martini] Completed 200 OK in 1.113205ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.099918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.173605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.922916ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.607915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 999.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.817007ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.058113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.059105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.143809ms [martini] Started GET /api/raft-follower-health-report/45a09630/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 999.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.64732ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.299805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.255909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.539315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 980.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.873808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.519919ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.761208ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.990209ms [martini] Started GET /api/lb-check for 10.1.1.81:46694 [martini] Completed 200 OK in 1.032404ms [martini] Started GET /api/raft-health for 10.1.1.81:46702 [martini] Completed 200 OK in 1.431606ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.151417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.809108ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.498411ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.244313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 941.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.121509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.068021ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 979.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.944809ms 2018-11-29 06:53:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/e5fcf3f4/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 862.904µs 2018-11-29 06:53:19 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.755616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.796707ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.007209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.453515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 879.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.064008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.087313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.218705ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27951ms [martini] Started GET /api/lb-check for 10.1.1.81:46848 [martini] Completed 200 OK in 890.504µs [martini] Started GET /api/raft-health for 10.1.1.81:46864 [martini] Completed 200 OK in 1.184505ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.294422ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.309114ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.986208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.477019ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.032313ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.906008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.192917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.043504ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.24771ms [martini] Started GET /api/raft-follower-health-report/2f88df1a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 832.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.974517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 835.703µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.120709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.163926ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 5.871025ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.795029ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.304918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.036304ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.179409ms [martini] Started GET /api/lb-check for 10.1.1.81:47018 [martini] Completed 200 OK in 752.603µs [martini] Started GET /api/raft-health for 10.1.1.81:47044 [martini] Completed 200 OK in 824.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.611415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.070604ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25401ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.248214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 965.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.032309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.207613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 771.103µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.565224ms 2018-11-29 06:53:37 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/3e383b38/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 853.904µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.494423ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 882.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.915208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.404814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 978.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.139309ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.388315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 892.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.156009ms [martini] Started GET /api/lb-check for 10.1.1.81:47182 [martini] Completed 200 OK in 638.403µs [martini] Started GET /api/raft-health for 10.1.1.81:47208 [martini] Completed 200 OK in 692.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.926116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.086805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.47651ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.322615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 891.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.36581ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.301114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 917.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.266909ms [martini] Started GET /api/raft-follower-health-report/c856787f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 845.804µs 2018-11-29 06:53:49 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.941521ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.465306ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.544611ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.376315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 866.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.926608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.097213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 897.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.807608ms [martini] Started GET /api/lb-check for 10.1.1.81:47350 [martini] Completed 200 OK in 625.002µs [martini] Started GET /api/raft-health for 10.1.1.81:47368 [martini] Completed 200 OK in 737.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.473415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.121605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.114309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.285214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.875108ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.825042ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.326515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 848.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.837208ms [martini] Started GET /api/raft-follower-health-report/6400791b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 857.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.579615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 849.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.35221ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.795629ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 935.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.697712ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.369022ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.148205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.821346ms [martini] Started GET /api/lb-check for 10.1.1.81:47518 [martini] Completed 200 OK in 688.103µs [martini] Started GET /api/raft-health for 10.1.1.81:47530 [martini] Completed 200 OK in 725.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.008517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.242614ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.112809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.450115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 818.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.930908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.995213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 859.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.951508ms [martini] Started GET /api/raft-follower-health-report/c181e4a6/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 899.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.520015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.026205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.030908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.438414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 898.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.021609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.518415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 964.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.177109ms [martini] Started GET /api/lb-check for 10.1.1.81:47670 [martini] Completed 200 OK in 793.404µs [martini] Started GET /api/raft-health for 10.1.1.81:47692 [martini] Completed 200 OK in 817.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.397115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.021905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.243009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.282214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.218006ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.937008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.380914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.172505ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.562311ms 2018-11-29 06:54:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/304866b7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 878.504µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.373144ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.32661ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.087517ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.231523ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.016504ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.980717ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.69052ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.253105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.983208ms [martini] Started GET /api/lb-check for 10.1.1.81:47840 [martini] Completed 200 OK in 664.603µs [martini] Started GET /api/raft-health for 10.1.1.81:47854 [martini] Completed 200 OK in 792.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.777417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.076205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.582311ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.72182ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 856.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.102609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.173518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 6.181926ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.08303ms 2018-11-29 06:54:25 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/293c912e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.012504ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.920439ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 792.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.905109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.746216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 877.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.078426ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.220214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 911.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.24871ms [martini] Started GET /api/lb-check for 10.1.1.81:48004 [martini] Completed 200 OK in 580.002µs [martini] Started GET /api/raft-health for 10.1.1.81:48016 [martini] Completed 200 OK in 665.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.096818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.004504ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.044909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.884417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 920.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.187809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.180514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 955.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31121ms [martini] Started GET /api/raft-follower-health-report/159b917d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 2.166809ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.154422ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.700807ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.103409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.512215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.066205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.091709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.958812ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.056405ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.831808ms [martini] Started GET /api/lb-check for 10.1.1.81:48160 [martini] Completed 200 OK in 639.003µs [martini] Started GET /api/raft-health for 10.1.1.81:48172 [martini] Completed 200 OK in 1.066305ms 2018-11-29 06:54:43 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.642816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 907.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.104009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.255919ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.074209ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.897108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.578815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 897.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.794208ms [martini] Started GET /api/raft-follower-health-report/e3748e32/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 713.003µs 2018-11-29 06:54:49 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.589915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 934.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.911008ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.190413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 782.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.916108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.028013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 937.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.987725ms [martini] Started GET /api/lb-check for 10.1.1.81:48312 [martini] Completed 200 OK in 615.903µs [martini] Started GET /api/raft-health for 10.1.1.81:48340 [martini] Completed 200 OK in 908.404µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.469215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.059404ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.136309ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.771921ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.036405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.023008ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.455623ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.122704ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.885208ms [martini] Started GET /api/raft-follower-health-report/77a187e9/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 4.761621ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.196722ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 946.805µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.503811ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.619424ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 941.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.983309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.621233ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.013504ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.62192ms [martini] Started GET /api/lb-check for 10.1.1.81:48498 [martini] Completed 200 OK in 2.11901ms [martini] Started GET /api/raft-health for 10.1.1.81:48508 [martini] Completed 200 OK in 816.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.086618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.430806ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.055409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.225613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 709.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.018509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.091313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 925.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.090009ms [martini] Started GET /api/raft-follower-health-report/b5f2be50/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 816.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.829917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 933.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.183409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.802617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.449611ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.915309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.273314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 807.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.823508ms [martini] Started GET /api/lb-check for 10.1.1.81:48656 [martini] Completed 200 OK in 843.903µs [martini] Started GET /api/raft-health for 10.1.1.81:48670 [martini] Completed 200 OK in 703.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.689316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 875.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.070209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.307714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 832.003µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.902808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.558719ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.485211ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.844608ms 2018-11-29 06:55:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/7d2639cd/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 717.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.934217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 823.903µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.417811ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.500415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 769.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.102809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.429715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.757808ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.577116ms [martini] Started GET /api/lb-check for 10.1.1.81:48818 [martini] Completed 200 OK in 992.504µs [martini] Started GET /api/raft-health for 10.1.1.81:48834 [martini] Completed 200 OK in 931.304µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 25.650111ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 906.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.228509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.304632ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 942.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.988808ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.219614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 917.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.881108ms 2018-11-29 06:55:25 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/6da1565a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 949.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.359014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 5.626124ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.974852ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.322319ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.088505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.929009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.851516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 836.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.935809ms [martini] Started GET /api/lb-check for 10.1.1.81:48980 [martini] Completed 200 OK in 1.039205ms [martini] Started GET /api/raft-health for 10.1.1.81:49010 [martini] Completed 200 OK in 732.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.420115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.158605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.994409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.457615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.088405ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.413423ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.942912ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 862.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.993409ms [martini] Started GET /api/raft-follower-health-report/d8264348/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 835.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.944217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 954.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.881308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.016817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 962.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.985109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.565915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 876.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.291032ms [martini] Started GET /api/lb-check for 10.1.1.81:49150 [martini] Completed 200 OK in 744.803µs [martini] Started GET /api/raft-health for 10.1.1.81:49160 [martini] Completed 200 OK in 674.003µs 2018-11-29 06:55:43 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.896017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.226205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.905513ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.139113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.063905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18691ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.272714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.019104ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.121409ms [martini] Started GET /api/raft-follower-health-report/3055e2eb/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 781.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.530115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.156705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26471ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.229114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 911.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.047009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.368614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.098805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.33341ms [martini] Started GET /api/lb-check for 10.1.1.81:49330 [martini] Completed 200 OK in 834.004µs [martini] Started GET /api/raft-health for 10.1.1.81:49346 [martini] Completed 200 OK in 690.103µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.956017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.103604ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.228231ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.155314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.047505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.696211ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.191314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 857.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.044909ms 2018-11-29 06:55:55 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/4dcc506c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 977.004µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.066017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.126605ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27021ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.139418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.287806ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.312223ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.066018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.44621ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31011ms [martini] Started GET /api/lb-check for 10.1.1.81:49486 [martini] Completed 200 OK in 631.703µs [martini] Started GET /api/raft-health for 10.1.1.81:49500 [martini] Completed 200 OK in 858.504µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.917817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 861.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.097209ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.637716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 966.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.064109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.536016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.005709ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.845213ms [martini] Started GET /api/raft-follower-health-report/fe2236e4/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 807.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.353814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 957.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.085909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.405015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 883.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.040809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.015013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 929.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.872208ms [martini] Started GET /api/lb-check for 10.1.1.81:49636 [martini] Completed 200 OK in 1.176705ms [martini] Started GET /api/raft-health for 10.1.1.81:49660 [martini] Completed 200 OK in 656.402µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.665016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.856808ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.884608ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.378115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.085005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18911ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.609216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 958.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.984409ms 2018-11-29 06:56:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/76eb74aa/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.109905ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.747129ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.451106ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.15991ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.256014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.410306ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.969209ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.313427ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 861.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.079409ms [martini] Started GET /api/lb-check for 10.1.1.81:49804 [martini] Completed 200 OK in 800.404µs [martini] Started GET /api/raft-health for 10.1.1.81:49816 [martini] Completed 200 OK in 658.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.727516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 949.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.070109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.366615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 915.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.873947ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.76642ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.016805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22391ms 2018-11-29 06:56:25 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/420ffe16/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 929.005µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.600415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.163105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.972613ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.642116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 975.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.245209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.949726ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 976.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.023917ms [martini] Started GET /api/lb-check for 10.1.1.81:49964 [martini] Completed 200 OK in 3.897517ms [martini] Started GET /api/raft-health for 10.1.1.81:49972 [martini] Completed 200 OK in 793.804µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.441315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 854.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21531ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.048814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 826.003µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.761807ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.358514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 947.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.914408ms [martini] Started GET /api/raft-follower-health-report/189929d8/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 796.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.632516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.201105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23411ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.271515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.040505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.944408ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.360314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 977.605µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.556111ms [martini] Started GET /api/lb-check for 10.1.1.81:50136 [martini] Completed 200 OK in 709.203µs [martini] Started GET /api/raft-health for 10.1.1.81:50160 [martini] Completed 200 OK in 714.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.487537ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.24501ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31341ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.448815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.043704ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.149309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.148213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 876.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.925008ms [martini] Started GET /api/raft-follower-health-report/5d7cfbe4/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 727.403µs 2018-11-29 06:56:49 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.786716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 875.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.11371ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.540616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.060305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.572029ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.035913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 945.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.060409ms [martini] Started GET /api/lb-check for 10.1.1.81:50290 [martini] Completed 200 OK in 619.303µs [martini] Started GET /api/raft-health for 10.1.1.81:50320 [martini] Completed 200 OK in 733.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.212514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.598807ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.961309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.832517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 967.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23671ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.259619ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 859.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.024908ms 2018-11-29 06:56:55 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/b1ee1d97/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 730.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.794216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 937.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.060309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.483719ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.103005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.921908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.662816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.158514ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.375911ms [martini] Started GET /api/lb-check for 10.1.1.81:50464 [martini] Completed 200 OK in 811.003µs [martini] Started GET /api/raft-health for 10.1.1.81:50474 [martini] Completed 200 OK in 878.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.626715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.061604ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26271ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.754416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.280506ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.026709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.102122ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 764.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.971608ms [martini] Started GET /api/raft-follower-health-report/720f1df1/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 771.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.787817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22011ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31721ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.494315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 839.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.883308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.069214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 990.505µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.007209ms [martini] Started GET /api/lb-check for 10.1.1.81:50620 [martini] Completed 200 OK in 788.404µs [martini] Started GET /api/raft-health for 10.1.1.81:50630 [martini] Completed 200 OK in 823.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.771216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.225605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26891ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.330915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.193305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.111509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.530616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 917.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.581216ms 2018-11-29 06:57:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/00ece81d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 914.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.873317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.065805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.32781ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.785417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 926.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.377011ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.319315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 780.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.671216ms [martini] Started GET /api/lb-check for 10.1.1.81:50806 [martini] Completed 200 OK in 665.203µs [martini] Started GET /api/raft-health for 10.1.1.81:50834 [martini] Completed 200 OK in 781.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.630916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.003004ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.043109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.957835ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.387806ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.052609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.540615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 892.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.169909ms [martini] Started GET /api/raft-follower-health-report/fd3dfec0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 924.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.959422ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.367406ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.136409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.60562ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.211505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.152309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.002613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 896.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.44871ms [martini] Started GET /api/lb-check for 10.1.1.81:50992 [martini] Completed 200 OK in 577.202µs [martini] Started GET /api/raft-health for 10.1.1.81:51004 [martini] Completed 200 OK in 770.704µs 2018-11-29 06:57:31 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.281137ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.046605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.491228ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.314815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 868.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.886208ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.105613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 891.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.947709ms [martini] Started GET /api/raft-follower-health-report/b872df92/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 773.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.748116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.052505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.622412ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.157314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 761.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.229214ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.817012ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 901.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.844908ms [martini] Started GET /api/lb-check for 10.1.1.81:51160 [martini] Completed 200 OK in 788.403µs [martini] Started GET /api/raft-health for 10.1.1.81:51172 [martini] Completed 200 OK in 646.702µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.128018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.283705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.516711ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.089418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.199705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.599215ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.193114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 901.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.230609ms [martini] Started GET /api/raft-follower-health-report/2e6456bf/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 780.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.894617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 998.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.35431ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.768016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 899.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.959009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.322915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 917.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.960609ms [martini] Started GET /api/lb-check for 10.1.1.81:51314 [martini] Completed 200 OK in 657.303µs [martini] Started GET /api/raft-health for 10.1.1.81:51330 [martini] Completed 200 OK in 679.403µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.356119ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.020404ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.123209ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.744821ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 751.103µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.099809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.693025ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 904.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.022809ms 2018-11-29 06:57:55 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 06:57:55 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/476ffeed/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 824.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.732216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 947.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.884009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.895352ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 952.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.015708ms [martini] Started GET /api/lb-check for 10.1.1.81:51482 [martini] Completed 200 OK in 603.002µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.982822ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 802.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.147809ms [martini] Started GET /api/raft-health for 10.1.1.81:51508 [martini] Completed 200 OK in 839.004µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.734516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.025604ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.966809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.450215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 991.505µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.622416ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.378719ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 816.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.822208ms [martini] Started GET /api/raft-follower-health-report/f24222d7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 883.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.418915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.058505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.088909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.869217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.044005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.103209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.349115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.449007ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27851ms [martini] Started GET /api/lb-check for 10.1.1.81:51654 [martini] Completed 200 OK in 811.404µs [martini] Started GET /api/raft-health for 10.1.1.81:51664 [martini] Completed 200 OK in 919.104µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.620121ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 905.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.917609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.936417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 958.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29711ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.408015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.822108ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.996409ms 2018-11-29 06:58:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/c6e3902d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 732.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.482124ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.092405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29811ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.972017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 858.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.114209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.226014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 910.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.101809ms [martini] Started GET /api/lb-check for 10.1.1.81:51812 [martini] Completed 200 OK in 786.703µs [martini] Started GET /api/raft-health for 10.1.1.81:51830 [martini] Completed 200 OK in 901.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 12.868857ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.044704ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.040509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.797543ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 931.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.975209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.326319ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.102205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.876808ms [martini] Started GET /api/raft-follower-health-report/19dda362/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 835.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.631424ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 894.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.093109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.652516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 933.705µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.291614ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.914326ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 5.402424ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.15541ms [martini] Started GET /api/lb-check for 10.1.1.81:51976 [martini] Completed 200 OK in 512.402µs [martini] Started GET /api/raft-health for 10.1.1.81:51988 [martini] Completed 200 OK in 881.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.477016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.026104ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25441ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.589415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 951.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.030209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.988613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 971.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.904309ms 2018-11-29 06:58:37 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/b7a3c588/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 800.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.955117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.018604ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.11301ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.176514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 825.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.13581ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.283915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 818.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16471ms [martini] Started GET /api/lb-check for 10.1.1.81:52142 [martini] Completed 200 OK in 595.003µs [martini] Started GET /api/raft-health for 10.1.1.81:52164 [martini] Completed 200 OK in 792.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.937126ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.027904ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31201ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.576816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 938.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.971309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.301014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 913.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.862008ms [martini] Started GET /api/raft-follower-health-report/7853bda0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 696.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.354415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 974.305µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.067309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.066327ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 848.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.878608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.094414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 856.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.847108ms [martini] Started GET /api/lb-check for 10.1.1.81:52310 [martini] Completed 200 OK in 599.603µs [martini] Started GET /api/raft-health for 10.1.1.81:52326 [martini] Completed 200 OK in 723.403µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.50422ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.014005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.989109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.220914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.142705ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.14401ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.87003ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 774.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.841608ms [martini] Started GET /api/raft-follower-health-report/63e46116/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 808.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.896618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 947.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.130209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.923222ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 838.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.928109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.151218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.025005ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.071909ms [martini] Started GET /api/lb-check for 10.1.1.81:52476 [martini] Completed 200 OK in 572.902µs [martini] Started GET /api/raft-health for 10.1.1.81:52492 [martini] Completed 200 OK in 3.049514ms 2018-11-29 06:59:01 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 06:59:01 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.674116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.129805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25291ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.333015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 991.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.992709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.028114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.901208ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.446211ms [martini] Started GET /api/raft-follower-health-report/3fa5f2f4/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 962.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.232823ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.527406ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.938408ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.134814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 824.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.770108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.984913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 814.603µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.11701ms [martini] Started GET /api/lb-check for 10.1.1.81:52636 [martini] Completed 200 OK in 703.503µs [martini] Started GET /api/raft-health for 10.1.1.81:52648 [martini] Completed 200 OK in 927.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.854317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 982.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.001609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.37882ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.223205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.921508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.818717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 937.705µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.897509ms 2018-11-29 06:59:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/2d138881/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 826.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.782317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.253706ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.445411ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.687516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 947.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.014809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.688816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.726816ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.813912ms [martini] Started GET /api/lb-check for 10.1.1.81:52796 [martini] Completed 200 OK in 740.003µs [martini] Started GET /api/raft-health for 10.1.1.81:52824 [martini] Completed 200 OK in 788.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.722117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.045704ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.007809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.054322ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 933.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.935508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.566815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 864.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.608916ms [martini] Started GET /api/raft-follower-health-report/91f87ca4/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 2.510911ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.488415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 903.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.163809ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.600829ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.063205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.729208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.088418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.276005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.482619ms [martini] Started GET /api/lb-check for 10.1.1.81:52972 [martini] Completed 200 OK in 708.303µs [martini] Started GET /api/raft-health for 10.1.1.81:52982 [martini] Completed 200 OK in 834.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.274515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.082005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.732116ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.907818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 861.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.755207ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.910013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 846.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.04641ms [martini] Started GET /api/raft-follower-health-report/aa7b8833/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 703.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.469616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 877.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.916709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.59922ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 989.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.845808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.619121ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 758.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.36551ms [martini] Started GET /api/lb-check for 10.1.1.81:53134 [martini] Completed 200 OK in 640.303µs [martini] Started GET /api/raft-health for 10.1.1.81:53144 [martini] Completed 200 OK in 821.704µs 2018-11-29 06:59:43 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.854821ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.503807ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.199409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.126322ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 966.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.113509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.403115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 839.903µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.008009ms [martini] Started GET /api/raft-follower-health-report/03adc9d1/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 854.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.593415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.028905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.988609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.599515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 800.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.918609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.904613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 830.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.017708ms [martini] Started GET /api/lb-check for 10.1.1.81:53286 [martini] Completed 200 OK in 657.203µs [martini] Started GET /api/raft-health for 10.1.1.81:53318 [martini] Completed 200 OK in 714.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.468224ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.335206ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.808522ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.441229ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.007504ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.381919ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.829121ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 864.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.437511ms [martini] Started GET /api/raft-follower-health-report/684a2c45/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 839.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.353715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.203305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.677016ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.52792ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.656508ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.147827ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.305214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.010005ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.789308ms [martini] Started GET /api/lb-check for 10.1.1.81:53448 [martini] Completed 200 OK in 537.302µs [martini] Started GET /api/raft-health for 10.1.1.81:53476 [martini] Completed 200 OK in 649.503µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.659316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.167605ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23481ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.036418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 894.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.037309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.398315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.322605ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.356432ms 2018-11-29 07:00:07 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 07:00:07 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:53594 [martini] Completed 200 OK in 689.803µs [martini] Started GET /api/raft-follower-health-report/f5d23e16/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.153205ms [martini] Completed 200 OK in 436.539635ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.176905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.07071ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.843343ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.064105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.214115ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.269514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 942.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25171ms [martini] Started GET /api/raft-health for 10.1.1.81:53636 [martini] Completed 200 OK in 599.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.381215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 948.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.539511ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.521316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 876.703µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.933709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.244414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.084704ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.140709ms 2018-11-29 07:00:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/47c0cdf3/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 889.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.348015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.129809ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.111323ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.891117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 842.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.38241ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.266414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.145205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.916509ms [martini] Started GET /api/lb-check for 10.1.1.81:53800 [martini] Completed 200 OK in 939.104µs [martini] Started GET /api/raft-health for 10.1.1.81:53820 [martini] Completed 200 OK in 838.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.539516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 836.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20341ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.096027ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 792.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.966409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.060449ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.501507ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26081ms [martini] Started GET /api/raft-follower-health-report/b29d84be/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 760.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.157019ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 889.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.184409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.305715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 843.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.950909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.310719ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 804.503µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.088409ms [martini] Started GET /api/lb-check for 10.1.1.81:53968 [martini] Completed 200 OK in 629.402µs [martini] Started GET /api/raft-health for 10.1.1.81:53982 [martini] Completed 200 OK in 2.811212ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.658348ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 877.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.089909ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.097313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 917.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.982009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.404815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 977.305µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.757908ms [martini] Started GET /api/raft-follower-health-report/adc50d80/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.059005ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.515724ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 917.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.24561ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.673016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 895.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.113409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.890822ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 864.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.981309ms [martini] Started GET /api/lb-check for 10.1.1.81:54126 [martini] Completed 200 OK in 1.101205ms [martini] Started GET /api/raft-health for 10.1.1.81:54162 [martini] Completed 200 OK in 906.804µs 2018-11-29 07:00:43 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 15.64797ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 968.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.060709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.215514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.239219ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.308011ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.257814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 834.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.838609ms [martini] Started GET /api/raft-follower-health-report/a292b81c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 939.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.48582ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.038904ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.15571ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.253414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 905.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.853508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.048313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.584116ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.606012ms [martini] Started GET /api/lb-check for 10.1.1.81:54284 [martini] Completed 200 OK in 741.203µs [martini] Started GET /api/raft-health for 10.1.1.81:54320 [martini] Completed 200 OK in 833.404µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.660016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 889.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.24181ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.121231ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.126805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.727616ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.730816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.250815ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.434811ms [martini] Started GET /api/raft-follower-health-report/05122d75/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 4.658221ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.002817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.006804ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19221ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.251624ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.051105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.064209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.011336ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.660207ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.045209ms [martini] Started GET /api/lb-check for 10.1.1.81:54464 [martini] Completed 200 OK in 796.103µs [martini] Started GET /api/raft-health for 10.1.1.81:54480 [martini] Completed 200 OK in 975.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.221923ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 5.533824ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.572711ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.783817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 814.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.880909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.579316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.169105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.886009ms 2018-11-29 07:01:07 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/09f00a2a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 790.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.540215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 892.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.102809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.493016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 922.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.256423ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.685716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 933.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19881ms [martini] Started GET /api/lb-check for 10.1.1.81:54618 [martini] Completed 200 OK in 870.904µs [martini] Started GET /api/raft-health for 10.1.1.81:54636 [martini] Completed 200 OK in 2.370711ms 2018-11-29 07:01:13 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.852717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 940.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.529511ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.617216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 865.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.921909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.440815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.118005ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.097136ms 2018-11-29 07:01:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/40309f12/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.062804ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.245428ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 934.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.940509ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.191714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.077905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.936908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.776116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 912.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.838608ms [martini] Started GET /api/lb-check for 10.1.1.81:54778 [martini] Completed 200 OK in 1.089005ms [martini] Started GET /api/raft-health for 10.1.1.81:54812 [martini] Completed 200 OK in 1.365706ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.863017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 995.005µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.026609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.946818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.873908ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.925809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.882417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 939.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.989408ms [martini] Started GET /api/raft-follower-health-report/861ffa3e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 799.703µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.416115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.072205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.132327ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.100518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 812.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.926309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.088736ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.936408ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.009609ms [martini] Started GET /api/lb-check for 10.1.1.81:54948 [martini] Completed 200 OK in 658.203µs [martini] Started GET /api/raft-health for 10.1.1.81:54968 [martini] Completed 200 OK in 841.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.674817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.164305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.957408ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.375015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 815.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.044609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.981127ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.010204ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.928808ms [martini] Started GET /api/raft-follower-health-report/6e69f903/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 782.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.449615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 874.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.953109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.801517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 890.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.056309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.477916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 891.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.923209ms [martini] Started GET /api/lb-check for 10.1.1.81:55110 [martini] Completed 200 OK in 1.991809ms [martini] Started GET /api/raft-health for 10.1.1.81:55126 [martini] Completed 200 OK in 708.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.844517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.380306ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.34711ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.263514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.198506ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.040009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.236315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 822.703µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.140709ms [martini] Started GET /api/raft-follower-health-report/ca42c541/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 876.404µs 2018-11-29 07:01:49 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.356415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 923.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.037909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.992313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 880.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.824308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.993613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.423207ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.303911ms [martini] Started GET /api/lb-check for 10.1.1.81:55262 [martini] Completed 200 OK in 638.002µs [martini] Started GET /api/raft-health for 10.1.1.81:55284 [martini] Completed 200 OK in 1.051304ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.617016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.143405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.58592ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 12.413855ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.179805ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.028209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.406334ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 920.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.319911ms [martini] Started GET /api/raft-follower-health-report/fe355478/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 810.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.382515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.051005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25991ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.567916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.178505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.109109ms [martini] Started GET /api/lb-check for 10.1.1.81:55426 [martini] Completed 200 OK in 1.294806ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.336328ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 780.703µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.10111ms [martini] Started GET /api/raft-health for 10.1.1.81:55458 [martini] Completed 200 OK in 798.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.718417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.121005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.999508ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.649716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.068905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.027509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.252015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 934.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19361ms 2018-11-29 07:02:07 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/aeeb0d91/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 629.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.853418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 995.705µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.09751ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.351815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 869.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.922609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.660417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 740.503µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.07321ms [martini] Started GET /api/lb-check for 10.1.1.81:55608 [martini] Completed 200 OK in 527.502µs [martini] Started GET /api/raft-health for 10.1.1.81:55624 [martini] Completed 200 OK in 911.604µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.067718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.207206ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.695821ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.187214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.409906ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.847409ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.492215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 988.705µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.14021ms 2018-11-29 07:02:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/3b9fa261/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 668.103µs 2018-11-29 07:02:19 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.884117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.512711ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.752231ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.856717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.357006ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.102109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.146214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 974.405µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.989209ms [martini] Started GET /api/lb-check for 10.1.1.81:55768 [martini] Completed 200 OK in 647.003µs [martini] Started GET /api/raft-health for 10.1.1.81:55792 [martini] Completed 200 OK in 865.904µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.811717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 937.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.067609ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.183723ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.097105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.739617ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.644121ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.012004ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.146114ms [martini] Started GET /api/raft-follower-health-report/a059c788/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 701.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.858422ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.046205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.775317ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.270237ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.418207ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.018109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.42512ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 878.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.937609ms [martini] Started GET /api/lb-check for 10.1.1.81:55938 [martini] Completed 200 OK in 2.446311ms [martini] Started GET /api/raft-health for 10.1.1.81:55954 [martini] Completed 200 OK in 758.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.862718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.075105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.099609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.135314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 921.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22941ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.248415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.053905ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.079009ms [martini] Started GET /api/raft-follower-health-report/554d0424/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 657.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.680917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 919.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26851ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.330615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 838.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.863809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.575416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.145305ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20791ms [martini] Started GET /api/lb-check for 10.1.1.81:56094 [martini] Completed 200 OK in 564.703µs [martini] Started GET /api/raft-health for 10.1.1.81:56124 [martini] Completed 200 OK in 905.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.112918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.853312ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.968009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.489515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.128105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.772917ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.933613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 915.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.152509ms [martini] Started GET /api/raft-follower-health-report/19369f20/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 795.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.408315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 954.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.954508ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.350015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.169805ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.721717ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.707716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.001204ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.007609ms [martini] Started GET /api/lb-check for 10.1.1.81:56260 [martini] Completed 200 OK in 699.803µs [martini] Started GET /api/raft-health for 10.1.1.81:56282 [martini] Completed 200 OK in 647.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.888417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.172705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.976009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.971622ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 938.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.945309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.305715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 962.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.401011ms 2018-11-29 07:02:55 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/057ccfdc/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 770.803µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.236819ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 975.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.871809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.657021ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.125806ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.36771ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.739321ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 981.005µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.040709ms [martini] Started GET /api/lb-check for 10.1.1.81:56428 [martini] Completed 200 OK in 781.504µs [martini] Started GET /api/raft-health for 10.1.1.81:56446 [martini] Completed 200 OK in 769.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.599316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.136705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21771ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.591016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 893.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.620512ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.541516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 982.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.999609ms [martini] Started GET /api/raft-follower-health-report/5be5c5e1/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 727.403µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.572616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 979.305µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.793617ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.689717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 864.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.065609ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.210115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.021005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.972409ms [martini] Started GET /api/lb-check for 10.1.1.81:56584 [martini] Completed 200 OK in 666.703µs [martini] Started GET /api/raft-health for 10.1.1.81:56600 [martini] Completed 200 OK in 762.604µs 2018-11-29 07:03:13 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.833217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.087605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.126009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.206619ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 918.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.17141ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.999932ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.057405ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.515711ms 2018-11-29 07:03:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/8e5e4c9e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 711.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.179219ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 853.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.05781ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.734817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.176405ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.414911ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.064414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.106405ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16391ms [martini] Started GET /api/lb-check for 10.1.1.81:56748 [martini] Completed 200 OK in 2.470611ms [martini] Started GET /api/raft-health for 10.1.1.81:56786 [martini] Completed 200 OK in 761.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.570716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.015005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21391ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.628216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.390206ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.514011ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.179915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.041605ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.807108ms 2018-11-29 07:03:25 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/5c156962/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 912.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.177033ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.911408ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.860509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.512725ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.781908ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.038509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.185214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.399707ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.835412ms [martini] Started GET /api/lb-check for 10.1.1.81:56930 [martini] Completed 200 OK in 462.702µs [martini] Started GET /api/raft-health for 10.1.1.81:56946 [martini] Completed 200 OK in 803.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.789617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.122305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.34511ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.265719ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.11781ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.482611ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.380415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 866.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.947609ms [martini] Started GET /api/raft-follower-health-report/759a6fe1/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 716.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.479616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 920.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.161809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.151214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 843.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.070909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.304515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 840.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.321914ms [martini] Started GET /api/lb-check for 10.1.1.81:57084 [martini] Completed 200 OK in 556.203µs [martini] Started GET /api/raft-health for 10.1.1.81:57102 [martini] Completed 200 OK in 745.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.148523ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.484211ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.795312ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.086823ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 939.405µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.15131ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.870717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 846.203µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.863308ms [martini] Started GET /api/raft-follower-health-report/868fc7e6/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 797.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.271015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 998.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.434211ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.378015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.177106ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.11511ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.058614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.087405ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.956409ms [martini] Started GET /api/lb-check for 10.1.1.81:57236 [martini] Completed 200 OK in 503.902µs [martini] Started GET /api/raft-health for 10.1.1.81:57272 [martini] Completed 200 OK in 656.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.804448ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.914322ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.934631ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.561716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.396906ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.32421ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.225614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.079205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29881ms [martini] Started GET /api/raft-follower-health-report/bec0802e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 873.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.076818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.091204ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.931109ms [martini] Started GET /api/lb-check for 10.1.1.81:57398 [martini] Completed 200 OK in 709.303µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.466715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 893.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.982509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 24.28721ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 863.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.084809ms [martini] Started GET /api/raft-health for 10.1.1.81:57434 [martini] Completed 200 OK in 675.603µs 2018-11-29 07:04:01 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.731517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 980.105µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16201ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.561916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 975.805µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19251ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.195315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 987.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.001409ms [martini] Started GET /api/raft-follower-health-report/fd611c96/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 812.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.767117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.135005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26981ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.487416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 877.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.084709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.080814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 952.805µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.819008ms [martini] Started GET /api/lb-check for 10.1.1.81:57566 [martini] Completed 200 OK in 666.903µs [martini] Started GET /api/raft-health for 10.1.1.81:57582 [martini] Completed 200 OK in 803.304µs 2018-11-29 07:04:13 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.051832ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.229306ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.458911ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.259815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 966.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.061409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.505424ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 888.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.876408ms 2018-11-29 07:04:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/45ceb389/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 902.804µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.708017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.006309ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.334511ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.439015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 886.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.961708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.37532ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.243705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.13711ms [martini] Started GET /api/lb-check for 10.1.1.81:57728 [martini] Completed 200 OK in 614.703µs [martini] Started GET /api/raft-health for 10.1.1.81:57750 [martini] Completed 200 OK in 829.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.666016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 828.503µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.962609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.954722ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.216006ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22711ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 12.016454ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 968.205µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.012409ms [martini] Started GET /api/raft-follower-health-report/f224cdfe/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 792.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.402915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 919.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.13691ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.962118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.467306ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.36631ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.464829ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 830.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.838208ms [martini] Started GET /api/lb-check for 10.1.1.81:57898 [martini] Completed 200 OK in 2.09791ms [martini] Started GET /api/raft-health for 10.1.1.81:57924 [martini] Completed 200 OK in 854.304µs 2018-11-29 07:04:31 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.071936ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.077505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.664017ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.849822ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 991.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27001ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.186223ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 993.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.887009ms [martini] Started GET /api/raft-follower-health-report/0a847c8b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.058705ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.553016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.028904ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.042209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.246714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 859.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.905908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.197214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 870.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.782208ms [martini] Started GET /api/lb-check for 10.1.1.81:58074 [martini] Completed 200 OK in 655.803µs [martini] Started GET /api/raft-health for 10.1.1.81:58090 [martini] Completed 200 OK in 784.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.385816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 991.305µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.762317ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.544721ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.050605ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.695112ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.554116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 846.703µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.538512ms [martini] Started GET /api/raft-follower-health-report/8dda7e89/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 933.505µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.606216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.017404ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18951ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.460816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.049105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.09811ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.368415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.666821ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.02821ms [martini] Started GET /api/lb-check for 10.1.1.81:58236 [martini] Completed 200 OK in 680.103µs [martini] Started GET /api/raft-health for 10.1.1.81:58250 [martini] Completed 200 OK in 809.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.364915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 988.705µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.983109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.849822ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 896.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.842508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.511643ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.059109ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.12351ms [martini] Started GET /api/raft-follower-health-report/d6e7c9f8/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 882.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.645216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.031904ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.011709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.323919ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.166905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.881409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.192914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.691908ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.345715ms [martini] Started GET /api/lb-check for 10.1.1.81:58404 [martini] Completed 200 OK in 933.604µs [martini] Started GET /api/raft-health for 10.1.1.81:58418 [martini] Completed 200 OK in 738.503µs 2018-11-29 07:05:01 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.987032ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 833.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.787408ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.116014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 669.003µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.830908ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.178114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 904.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.042609ms [martini] Started GET /api/raft-follower-health-report/1c66ae86/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 882.704µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.615116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 931.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.364811ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.649125ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.615911ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.997609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.284915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.211106ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.094209ms [martini] Started GET /api/lb-check for 10.1.1.81:58560 [martini] Completed 200 OK in 611.803µs [martini] Started GET /api/raft-health for 10.1.1.81:58586 [martini] Completed 200 OK in 640.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.523016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.861708ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.09561ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.431416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 901.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.742907ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.587325ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 6.138427ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.895208ms 2018-11-29 07:05:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/21be566b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 773.303µs 2018-11-29 07:05:19 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.029518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.123105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.015909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.908314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 891.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.974809ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.115114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 870.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.15691ms [martini] Started GET /api/lb-check for 10.1.1.81:58730 [martini] Completed 200 OK in 563.003µs [martini] Started GET /api/raft-health for 10.1.1.81:58748 [martini] Completed 200 OK in 662.103µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.289719ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 993.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.17251ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.554717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 975.805µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.060009ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.616616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 904.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.995109ms [martini] Started GET /api/raft-follower-health-report/6cabb940/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 705.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.599716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.500611ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.707121ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.580225ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 940.905µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.604212ms [martini] Started GET /api/lb-check for 10.1.1.81:58898 [martini] Completed 200 OK in 558.602µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.479116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.724308ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.469116ms [martini] Started GET /api/raft-health for 10.1.1.81:58912 [martini] Completed 200 OK in 861.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.489916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.244305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.09351ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.188815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.635208ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.407411ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.114214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 903.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.017909ms 2018-11-29 07:05:37 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/c123dd5a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 637.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.786817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.112705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.09681ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.789317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 835.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.032109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.995814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 863.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.594016ms [martini] Started GET /api/lb-check for 10.1.1.81:59056 [martini] Completed 200 OK in 566.702µs [martini] Started GET /api/raft-health for 10.1.1.81:59070 [martini] Completed 200 OK in 840.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.555116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.020505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.262615ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.511316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 922.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.965309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.178819ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 935.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.03531ms [martini] Started GET /api/raft-follower-health-report/047cd202/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 897.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.34582ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 907.705µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.092909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.600016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.356306ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.061209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.956517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 881.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.016409ms [martini] Started GET /api/lb-check for 10.1.1.81:59208 [martini] Completed 200 OK in 705.203µs [martini] Started GET /api/raft-health for 10.1.1.81:59242 [martini] Completed 200 OK in 798.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.680417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 927.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.782926ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.952723ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 835.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.974609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.098719ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 887.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21721ms [martini] Started GET /api/raft-follower-health-report/533be51d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 711.203µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.897117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.257106ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16791ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.422016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.024105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.745917ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.632221ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 753.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.897108ms [martini] Started GET /api/lb-check for 10.1.1.81:59386 [martini] Completed 200 OK in 627.703µs [martini] Started GET /api/raft-health for 10.1.1.81:59402 [martini] Completed 200 OK in 791.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.888417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.466407ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.697412ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.313815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 868.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.07781ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.052114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 799.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.175715ms 2018-11-29 07:06:07 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/84542318/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 680.303µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.31552ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 803.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.697608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.051418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 851.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.915209ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.087314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.558007ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.800008ms [martini] Started GET /api/lb-check for 10.1.1.81:59542 [martini] Completed 200 OK in 816.104µs [martini] Started GET /api/raft-health for 10.1.1.81:59554 [martini] Completed 200 OK in 764.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.341624ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.042104ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.347411ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.573816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.129205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.387311ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.129114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.006305ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.259619ms 2018-11-29 07:06:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/03e6c598/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 712.303µs 2018-11-29 07:06:19 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.719817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.263606ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.486815ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.324215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 903.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.066409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.165915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 884.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.657912ms [martini] Started GET /api/lb-check for 10.1.1.81:59700 [martini] Completed 200 OK in 844.104µs [martini] Started GET /api/raft-health for 10.1.1.81:59718 [martini] Completed 200 OK in 667.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.751317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.019904ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.11241ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.940022ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 909.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.979609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 14.981568ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 978.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.831308ms [martini] Started GET /api/raft-follower-health-report/428f7f98/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 787.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.607817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 910.005µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.831613ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.455216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.100405ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22971ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.744822ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.102105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20861ms [martini] Started GET /api/lb-check for 10.1.1.81:59860 [martini] Completed 200 OK in 2.089109ms [martini] Started GET /api/raft-health for 10.1.1.81:59888 [martini] Completed 200 OK in 943.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.560016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 898.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.017209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.317815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.027804ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.008609ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.487615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.095205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16711ms [martini] Started GET /api/raft-follower-health-report/80451515/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.064805ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.650116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 972.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16961ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.327015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.023405ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.09641ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.138314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 882.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.129409ms [martini] Started GET /api/lb-check for 10.1.1.81:60032 [martini] Completed 200 OK in 712.003µs [martini] Started GET /api/raft-health for 10.1.1.81:60044 [martini] Completed 200 OK in 625.103µs 2018-11-29 07:06:43 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.270815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.070505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.083541ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.556616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.383406ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.490721ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.996114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 912.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.878008ms [martini] Started GET /api/raft-follower-health-report/bc017722/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 740.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.071423ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.210206ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.397816ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.501516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.245606ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.558112ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.748521ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.852813ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.336311ms [martini] Started GET /api/lb-check for 10.1.1.81:60178 [martini] Completed 200 OK in 608.303µs [martini] Started GET /api/raft-health for 10.1.1.81:60198 [martini] Completed 200 OK in 694.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.648717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.107205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.917109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.836222ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.029704ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.943709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.010718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 806.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.838708ms [martini] Started GET /api/raft-follower-health-report/9c962ebd/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 744.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.891218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.134706ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.13291ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.840222ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.108705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.771213ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.542125ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.174305ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.488516ms [martini] Started GET /api/lb-check for 10.1.1.81:60346 [martini] Completed 200 OK in 680.503µs [martini] Started GET /api/raft-health for 10.1.1.81:60376 [martini] Completed 200 OK in 860.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.403733ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25021ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.048209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.592817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.047805ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.952109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.795617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 841.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16791ms 2018-11-29 07:07:07 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/74b99c1d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 788.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.403024ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 10.507148ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 13.27696ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.850417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.559612ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.361911ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.414416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 739.803µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.639612ms [martini] Started GET /api/lb-check for 10.1.1.81:60498 [martini] Completed 200 OK in 621.803µs [martini] Started GET /api/raft-health for 10.1.1.81:60526 [martini] Completed 200 OK in 814.003µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.604616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 973.705µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.99231ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.290015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.071005ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.138014ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.324415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.617008ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.427011ms 2018-11-29 07:07:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/215092a2/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 723.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.39642ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 995.405µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.09691ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.274415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 884.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.14661ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.543616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.003705ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20311ms [martini] Started GET /api/lb-check for 10.1.1.81:60672 [martini] Completed 200 OK in 724.703µs [martini] Started GET /api/raft-health for 10.1.1.81:60694 [martini] Completed 200 OK in 788.304µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.619316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.020104ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.11421ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.445916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 881.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.977909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.47332ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 994.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.129214ms 2018-11-29 07:07:25 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/37c78085/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 883.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.320719ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.788013ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.821717ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.869122ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 972.505µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.938708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.987918ms [martini] Started GET /api/lb-check for 10.1.1.81:60842 [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 818.403µs [martini] Completed 200 OK in 1.466707ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.359611ms [martini] Started GET /api/raft-health for 10.1.1.81:60856 [martini] Completed 200 OK in 611.903µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.183419ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.017605ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.24411ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.089514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 864.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.413115ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.900917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 947.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.866308ms [martini] Started GET /api/raft-follower-health-report/a2372ca2/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 727.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.667217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 854.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.415611ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.524616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 816.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.890708ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.393415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 909.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.11521ms [martini] Started GET /api/lb-check for 10.1.1.81:32768 [martini] Completed 200 OK in 851.704µs [martini] Started GET /api/raft-health for 10.1.1.81:32796 [martini] Completed 200 OK in 746.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.876118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.148705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.34821ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.301115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.182505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25541ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.146815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 881.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.015009ms [martini] Started GET /api/raft-follower-health-report/c7eaed3d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 967.004µs 2018-11-29 07:07:49 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.602617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 836.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.625221ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.45542ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.062205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.06521ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.226615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 838.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.368911ms [martini] Started GET /api/lb-check for 10.1.1.81:32930 [martini] Completed 200 OK in 739.403µs [martini] Started GET /api/raft-health for 10.1.1.81:32946 [martini] Completed 200 OK in 1.99941ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.871718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.030605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25101ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.834944ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.123605ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.602812ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.392824ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.041305ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.986409ms [martini] Started GET /api/raft-follower-health-report/9fd253ca/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 871.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.712817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.597707ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.067609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.147923ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 928.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26631ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.112436ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.239106ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.09331ms [martini] Started GET /api/lb-check for 10.1.1.81:33096 [martini] Completed 200 OK in 623.403µs [martini] Started GET /api/raft-health for 10.1.1.81:33108 [martini] Completed 200 OK in 794.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.802817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.205506ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.475011ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.523116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.238006ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.14381ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.540316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 817.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.108209ms [martini] Started GET /api/raft-follower-health-report/2d9c412a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 710.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.596217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 976.105µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.24371ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.454315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 835.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.778008ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.066014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 860.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.046909ms [martini] Started GET /api/lb-check for 10.1.1.81:33250 [martini] Completed 200 OK in 2.18721ms [martini] Started GET /api/raft-health for 10.1.1.81:33262 [martini] Completed 200 OK in 798.404µs 2018-11-29 07:08:13 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.664317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.477307ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.880713ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.871918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.190505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23741ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.350515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 876.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.935909ms 2018-11-29 07:08:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/00ea940d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 862.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.538016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 877.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.674448ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.590916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 847.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.905108ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.554216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.147206ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19341ms [martini] Started GET /api/lb-check for 10.1.1.81:33402 [martini] Completed 200 OK in 609.503µs [martini] Started GET /api/raft-health for 10.1.1.81:33432 [martini] Completed 200 OK in 674.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.517316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.202506ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.488911ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.957227ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.084205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.21232ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.356915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 909.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.11171ms [martini] Started GET /api/raft-follower-health-report/660677d0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 657.803µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.697017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 890.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.653835ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.358015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 966.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.760517ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.967923ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 892.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.895608ms [martini] Started GET /api/lb-check for 10.1.1.81:33584 [martini] Completed 200 OK in 437.002µs [martini] Started GET /api/raft-health for 10.1.1.81:33596 [martini] Completed 200 OK in 742.603µs 2018-11-29 07:08:31 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.554316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 997.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26671ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.140014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 957.605µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.370511ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.621516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 910.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.882109ms [martini] Started GET /api/raft-follower-health-report/9467ae8c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 2.21991ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.633216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 943.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.436115ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.517616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 887.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22661ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.224814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 879.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.666412ms [martini] Started GET /api/lb-check for 10.1.1.81:33740 [martini] Completed 200 OK in 663.903µs [martini] Started GET /api/raft-health for 10.1.1.81:33754 [martini] Completed 200 OK in 713.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.186919ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.151405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.330715ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.006918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.106605ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19051ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.194514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 899.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.076409ms [martini] Started GET /api/raft-follower-health-report/03c37074/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 816.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.947445ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.050209ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.11861ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.49902ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 926.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.954109ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.904945ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 992.805µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.082909ms [martini] Started GET /api/lb-check for 10.1.1.81:33894 [martini] Completed 200 OK in 569.602µs [martini] Started GET /api/raft-health for 10.1.1.81:33912 [martini] Completed 200 OK in 744.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.634517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.321106ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23251ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.524339ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.113205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.661112ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.480121ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.082305ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.07281ms 2018-11-29 07:08:55 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/a7806550/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 764.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.820217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.047105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.11621ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.053519ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.613112ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.530111ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.932527ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.086005ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.33581ms [martini] Started GET /api/lb-check for 10.1.1.81:34074 [martini] Completed 200 OK in 726.404µs [martini] Started GET /api/raft-health for 10.1.1.81:34100 [martini] Completed 200 OK in 741.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.239428ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.585312ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.157909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.493716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 771.003µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.928308ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.261614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 836.003µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.369311ms [martini] Started GET /api/raft-follower-health-report/e5347197/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 762.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.173519ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.092705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.34731ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.591917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.865008ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.095309ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.113514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 774.903µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.999409ms [martini] Started GET /api/lb-check for 10.1.1.81:34252 [martini] Completed 200 OK in 649.603µs [martini] Started GET /api/raft-health for 10.1.1.81:34264 [martini] Completed 200 OK in 1.462606ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.990918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.018305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23381ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.156815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 870.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.293715ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.088414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 872.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.92004ms 2018-11-29 07:09:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/2e5a5c46/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 688.003µs 2018-11-29 07:09:19 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.737417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.078305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.17211ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.654117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 977.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.14741ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.564116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 952.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.487711ms [martini] Started GET /api/lb-check for 10.1.1.81:34426 [martini] Completed 200 OK in 705.503µs [martini] Started GET /api/raft-health for 10.1.1.81:34444 [martini] Completed 200 OK in 1.001605ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.597817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.162806ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.317311ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.696716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.536107ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.865513ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.093527ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.077805ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22211ms [martini] Started GET /api/raft-follower-health-report/847dff12/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 936.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.287015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 788.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.98215ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.396616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 830.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.806608ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.194415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 945.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.934709ms [martini] Started GET /api/lb-check for 10.1.1.81:34596 [martini] Completed 200 OK in 498.203µs [martini] Started GET /api/raft-health for 10.1.1.81:34608 [martini] Completed 200 OK in 770.303µs 2018-11-29 07:09:31 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.446516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.395711ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.00351ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.236915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.449111ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.233628ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.171919ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.033005ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21531ms [martini] Started GET /api/raft-follower-health-report/f52ee8a2/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 673.903µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.553116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.086605ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.522321ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.739522ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.003904ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.482711ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.171215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 991.705µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.595916ms [martini] Started GET /api/lb-check for 10.1.1.81:34748 [martini] Completed 200 OK in 601.103µs [martini] Started GET /api/raft-health for 10.1.1.81:34776 [martini] Completed 200 OK in 701.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.791017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 862.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.13641ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.33842ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 770.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.900809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.276415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 880.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.854708ms [martini] Started GET /api/raft-follower-health-report/e6283c86/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 880.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.49822ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.290306ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.083309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.304115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.137405ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.13411ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.210114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 804.503µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.042409ms [martini] Started GET /api/lb-check for 10.1.1.81:34910 [martini] Completed 200 OK in 674.603µs [martini] Started GET /api/raft-health for 10.1.1.81:34928 [martini] Completed 200 OK in 738.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.577816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 947.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.405916ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.265315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 852.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.910209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.139214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 885.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.34801ms 2018-11-29 07:09:55 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/5cb495e7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 844.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.146119ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 906.905µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.085009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.047218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.307806ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.088809ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.081241ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.158605ms [martini] Started GET /api/lb-check for 10.1.1.81:35080 [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 454.502µs [martini] Completed 200 OK in 2.523312ms [martini] Started GET /api/raft-health for 10.1.1.81:35092 [martini] Completed 200 OK in 878.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.47602ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.149805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.299211ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.579317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 931.505µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.006709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.077419ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 874.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.001009ms [martini] Started GET /api/raft-follower-health-report/56102d92/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 825.804µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.967718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.071205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.012509ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.184515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.223106ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.344511ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.817617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 988.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.987309ms [martini] Started GET /api/lb-check for 10.1.1.81:35234 [martini] Completed 200 OK in 826.904µs [martini] Started GET /api/raft-health for 10.1.1.81:35260 [martini] Completed 200 OK in 635.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.039819ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.222205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.426515ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.530516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 948.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.054709ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.187814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 935.005µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.881208ms 2018-11-29 07:10:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/53aa7b56/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 974.004µs 2018-11-29 07:10:19 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.133424ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.009805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.463916ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.976032ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 822.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.928409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.664817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 878.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.875408ms [martini] Started GET /api/lb-check for 10.1.1.81:35390 [martini] Completed 200 OK in 659.103µs [martini] Started GET /api/raft-health for 10.1.1.81:35420 [martini] Completed 200 OK in 1.130605ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 18.103782ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.935409ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.556843ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.559921ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 947.705µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.955913ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 30.957641ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 16.941678ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.877209ms [martini] Started GET /api/raft-follower-health-report/834d8cda/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 720.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.468616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 830.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.020109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.486021ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.536607ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.999813ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.422015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 754.403µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.936309ms [martini] Started GET /api/lb-check for 10.1.1.81:35570 [martini] Completed 200 OK in 536.603µs [martini] Started GET /api/raft-health for 10.1.1.81:35582 [martini] Completed 200 OK in 2.379911ms 2018-11-29 07:10:31 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.282119ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.088805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.35561ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.456816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.571707ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.015509ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.341215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.162305ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.10221ms [martini] Started GET /api/raft-follower-health-report/9138f0dc/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 794.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.071328ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.518112ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.11231ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.488616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 827.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.00251ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.297115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 824.504µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.080309ms [martini] Started GET /api/lb-check for 10.1.1.81:35728 [martini] Completed 200 OK in 650.103µs [martini] Started GET /api/raft-health for 10.1.1.81:35740 [martini] Completed 200 OK in 991.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.643517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.126205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.412911ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.44112ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.25922ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.06921ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.037514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 908.204µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.934809ms 2018/11/29 07:10:46 [INFO] raft: Starting snapshot up to 438722 2018/11/29 07:10:46 [INFO] snapshot: Creating new snapshot at /var/lib/orchestrator/snapshots/9352-438722-1543475446646.tmp 2018/11/29 07:10:46 [INFO] snapshot: reaping snapshot /var/lib/orchestrator/snapshots/9352-435540-1543449305152 2018/11/29 07:10:46 [INFO] raft: Compacting logs from 428161 to 428482 2018/11/29 07:10:46 [INFO] raft: Snapshot to 438722 complete [martini] Started GET /api/raft-follower-health-report/57cb32ae/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 831.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.328025ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 878.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.17551ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.548316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.009405ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20541ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.151319ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 874.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28691ms [martini] Started GET /api/lb-check for 10.1.1.81:35882 [martini] Completed 200 OK in 656.103µs [martini] Started GET /api/raft-health for 10.1.1.81:35912 [martini] Completed 200 OK in 930.704µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.127919ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 894.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.17021ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 13.09906ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 914.705µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.09311ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.776527ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.071505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23611ms 2018-11-29 07:10:55 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/c46dedde/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 768.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.036418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 985.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.046409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.33902ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.031605ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.32781ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.447416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 948.004µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.747812ms [martini] Started GET /api/lb-check for 10.1.1.81:36062 [martini] Completed 200 OK in 556.103µs [martini] Started GET /api/raft-health for 10.1.1.81:36076 [martini] Completed 200 OK in 727.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.259833ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 902.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.057609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.347615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.002505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.989009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.086715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.123405ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.06001ms [martini] Started GET /api/raft-follower-health-report/ca906e58/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 892.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.836118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 915.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.250119ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.999027ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 809.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29541ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.268414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 823.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.075609ms [martini] Started GET /api/lb-check for 10.1.1.81:36224 [martini] Completed 200 OK in 856.404µs [martini] Started GET /api/raft-health for 10.1.1.81:36236 [martini] Completed 200 OK in 746.604µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.465016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 894.704µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.300015ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.150514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 892.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.797908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.451416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.049704ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.98331ms 2018-11-29 07:11:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/99730919/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 887.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.539116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 937.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.14481ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.229315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 911.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.814808ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.549616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 903.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.892908ms [martini] Started GET /api/lb-check for 10.1.1.81:36380 [martini] Completed 200 OK in 743.904µs [martini] Started GET /api/raft-health for 10.1.1.81:36398 [martini] Completed 200 OK in 2.669312ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.817217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.068205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21511ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.39252ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 960.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19421ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.466643ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.394007ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.331811ms 2018-11-29 07:11:25 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/ae0bb1e7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 682.903µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.858518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.412111ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.863213ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.442716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 862.604µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.812308ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.651017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 989.205µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.023809ms [martini] Started GET /api/lb-check for 10.1.1.81:36556 [martini] Completed 200 OK in 591.103µs [martini] Started GET /api/raft-health for 10.1.1.81:36582 [martini] Completed 200 OK in 885.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.563216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 943.505µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.264111ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.712817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 911.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.204633ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.604217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 739.104µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.07501ms 2018-11-29 07:11:37 ERROR ReadTopologyInstance(production-cluster-mysql-0.production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/ba9eb001/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 801.803µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.734017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.047805ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25261ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.399016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 912.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.957809ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.347615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 976.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.442839ms [martini] Started GET /api/lb-check for 10.1.1.81:36730 [martini] Completed 200 OK in 620.802µs [martini] Started GET /api/raft-health for 10.1.1.81:36740 [martini] Completed 200 OK in 1.040305ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.017519ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 934.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.36701ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.346115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 913.905µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.887608ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.180214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 779.403µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.827108ms [martini] Started GET /api/raft-follower-health-report/83b3cd5a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.333906ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.648916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 900.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19401ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.607017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 955.105µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.899508ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.083814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 907.804µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.949209ms [martini] Started GET /api/lb-check for 10.1.1.81:36878 [martini] Completed 200 OK in 814.003µs [martini] Started GET /api/raft-health for 10.1.1.81:36896 [martini] Completed 200 OK in 863.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.879522ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.125005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27501ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.407025ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.009605ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.234415ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.695035ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 941.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.956309ms [martini] Started GET /api/raft-follower-health-report/8c39ad18/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 806.704µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.625016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 996.205µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.12241ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.607116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.966208ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.772321ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.43982ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 868.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.815708ms [martini] Started GET /api/lb-check for 10.1.1.81:37042 [martini] Completed 200 OK in 514.902µs [martini] Started GET /api/raft-health for 10.1.1.81:37056 [martini] Completed 200 OK in 965.604µs 2018-11-29 07:12:01 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.960718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.022405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22671ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.545417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.071205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.035409ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.312115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 959.305µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.719917ms [martini] Started GET /api/raft-follower-health-report/6591b527/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 776.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.847617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.008505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.00271ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.583216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 995.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.011209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.192214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 874.304µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.018709ms [martini] Started GET /api/lb-check for 10.1.1.81:37200 [martini] Completed 200 OK in 894.204µs [martini] Started GET /api/raft-health for 10.1.1.81:37228 [martini] Completed 200 OK in 727.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.876418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.085405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.486312ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.268615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 805.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.984209ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.129314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 918.904µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.043609ms 2018-11-29 07:12:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/c23bc02e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 841.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.833518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.328411ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.433411ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.400816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 877.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.850713ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.902322ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.015105ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22911ms [martini] Started GET /api/lb-check for 10.1.1.81:37372 [martini] Completed 200 OK in 774.803µs [martini] Started GET /api/raft-health for 10.1.1.81:37390 [martini] Completed 200 OK in 849.604µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.726917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.002205ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27781ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.799318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.087005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.397811ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.894318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 943.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.14601ms 2018-11-29 07:12:25 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/52e9bf2f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 785.003µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.809517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 879.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.988909ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.332716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.051604ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23161ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.040718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 906.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29841ms [martini] Started GET /api/lb-check for 10.1.1.81:37542 [martini] Completed 200 OK in 2.18641ms [martini] Started GET /api/raft-health for 10.1.1.81:37554 [martini] Completed 200 OK in 676.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.36192ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.007004ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18881ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.314615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 884.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29521ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.017914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 935.404µs [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28641ms [martini] Started GET /api/raft-follower-health-report/c04297df/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.727308ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.043419ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.004605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.349811ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.340615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.024105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.002009ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.136415ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.971213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.069505ms [martini] Started GET /api/forget/production-cluster-mysql-0.production-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:37698 [martini] Completed 200 OK in 575.102µs [martini] Completed 200 OK in 66.924706ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.14581ms [martini] Started GET /api/raft-health for 10.1.1.81:37714 [martini] Completed 200 OK in 606.003µs [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 2018-11-29 07:12:45 ERROR Unable to determine cluster name. clusterHint=production-cluster.default [martini] Completed 500 Internal Server Error in 17.366279ms [martini] Started GET /api/cluster/production-cluster.default for 10.1.1.163:56044 2018-11-29 07:12:45 ERROR Unable to determine cluster name. clusterHint=production-cluster.default [martini] Completed 500 Internal Server Error in 6.239029ms [martini] Started GET /api/audit-recovery/production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.802908ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.219914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 886.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.08461ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.974013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 875.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.964609ms [martini] Started GET /api/raft-follower-health-report/e456778c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 855.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.529316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.128805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.051609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.431216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.031705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.119528ms [martini] Started GET /api/lb-check for 10.1.1.81:37856 [martini] Completed 200 OK in 541.203µs [martini] Started GET /api/raft-health for 10.1.1.81:37890 [martini] Completed 200 OK in 826.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.30442ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 887.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22421ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.535521ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.358106ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.033418ms [martini] Started GET /api/raft-follower-health-report/2d959b81/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 945.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.286915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 897.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.916345ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.236428ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 860.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.097409ms [martini] Started GET /api/lb-check for 10.1.1.81:38044 [martini] Completed 200 OK in 627.702µs [martini] Started GET /api/raft-health for 10.1.1.81:38056 [martini] Completed 200 OK in 585.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.736617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 885.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21731ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.504116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 948.205µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.875009ms 2018-11-29 07:13:07 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/38ee9af4/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 684.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.543016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 826.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.010109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.993318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.016505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.12821ms [martini] Started GET /api/lb-check for 10.1.1.81:38200 [martini] Completed 200 OK in 839.404µs [martini] Started GET /api/raft-health for 10.1.1.81:38212 [martini] Completed 200 OK in 896.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.828318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.154906ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21831ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.611317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.369706ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.036009ms 2018-11-29 07:13:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/2268bc36/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 678.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.915118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27061ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.381611ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.309016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.089105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.315911ms [martini] Started GET /api/lb-check for 10.1.1.81:38362 [martini] Completed 200 OK in 885.004µs [martini] Started GET /api/raft-health for 10.1.1.81:38392 [martini] Completed 200 OK in 746.004µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.510734ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.164019ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.12211ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.736822ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 978.205µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.944309ms [martini] Started GET /api/raft-follower-health-report/ea497b1e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 757.103µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.077718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.285906ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.033509ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.772917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.106405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.894109ms [martini] Started GET /api/lb-check for 10.1.1.81:38530 [martini] Completed 200 OK in 750.303µs [martini] Started GET /api/raft-health for 10.1.1.81:38556 [martini] Completed 200 OK in 2.926213ms 2018-11-29 07:13:31 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.173923ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.143305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.09011ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.481916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.106105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.09521ms [martini] Started GET /api/raft-follower-health-report/b2212797/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 886.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.724317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.021705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.13931ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.393715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.454411ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.563516ms [martini] Started GET /api/lb-check for 10.1.1.81:38692 [martini] Completed 200 OK in 730.003µs [martini] Started GET /api/raft-health for 10.1.1.81:38704 [martini] Completed 200 OK in 664.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.296529ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.186405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.979609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.994914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 916.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.147509ms [martini] Started GET /api/raft-follower-health-report/a37c23b1/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 723.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.800218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.508911ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.214714ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.961513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 996.505µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16271ms [martini] Started GET /api/lb-check for 10.1.1.81:38838 [martini] Completed 200 OK in 665.803µs [martini] Started GET /api/raft-health for 10.1.1.81:38870 [martini] Completed 200 OK in 887.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.674717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.009804ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20921ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.48943ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 958.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.095709ms [martini] Started GET /api/raft-follower-health-report/dd0d3d24/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 753.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.025718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 979.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.13611ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.007214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.864009ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.849209ms [martini] Started GET /api/lb-check for 10.1.1.81:39012 [martini] Completed 200 OK in 516.402µs [martini] Started GET /api/raft-health for 10.1.1.81:39028 [martini] Completed 200 OK in 592.002µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.130828ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.523907ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.303315ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.241815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 801.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.135918ms 2018-11-29 07:14:07 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/fe836197/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 665.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.318616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 961.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.066309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.324515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 889.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.037509ms [martini] Started GET /api/lb-check for 10.1.1.81:39176 [martini] Completed 200 OK in 668.403µs [martini] Started GET /api/raft-health for 10.1.1.81:39190 [martini] Completed 200 OK in 871.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.748117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.107205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.573717ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.457621ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 891.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.997809ms 2018-11-29 07:14:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/60acbdf9/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.138305ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.665917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.787708ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.11241ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.613017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 859.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19081ms [martini] Started GET /api/lb-check for 10.1.1.81:39334 [martini] Completed 200 OK in 998.404µs [martini] Started GET /api/raft-health for 10.1.1.81:39352 [martini] Completed 200 OK in 885.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.084333ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 871.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.967709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.786717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 860.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16671ms [martini] Started GET /api/raft-follower-health-report/a3285e0d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 741.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.395415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 939.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.022209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.709726ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.114105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.153709ms [martini] Started GET /api/lb-check for 10.1.1.81:39510 [martini] Completed 200 OK in 637.503µs [martini] Started GET /api/raft-health for 10.1.1.81:39538 [martini] Completed 200 OK in 682.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.665316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.139005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.14491ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.954814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 925.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26831ms 2018-11-29 07:14:37 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/38a21b97/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 894.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.398715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.062805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.158115ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.599721ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 742.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.99291ms [martini] Started GET /api/lb-check for 10.1.1.81:39714 [martini] Completed 200 OK in 687.003µs [martini] Started GET /api/raft-health for 10.1.1.81:39726 [martini] Completed 200 OK in 697.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.009619ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.089405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.056409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.122415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 878.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.778008ms [martini] Started GET /api/raft-follower-health-report/0992de21/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 810.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.894918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 837.603µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20231ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.287515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.750208ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.875109ms [martini] Started GET /api/lb-check for 10.1.1.81:39870 [martini] Completed 200 OK in 608.803µs [martini] Started GET /api/raft-health for 10.1.1.81:39886 [martini] Completed 200 OK in 835.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.840117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 872.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.12221ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.320715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.761708ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.563916ms [martini] Started GET /api/raft-follower-health-report/575426da/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 721.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.892727ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 960.705µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.929809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.104333ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 774.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.078609ms [martini] Started GET /api/lb-check for 10.1.1.81:40036 [martini] Completed 200 OK in 611.503µs [martini] Started GET /api/raft-health for 10.1.1.81:40050 [martini] Completed 200 OK in 1.059105ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.913218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 887.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.066914ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.905718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 935.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.898809ms 2018-11-29 07:15:07 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/9a132791/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 962.304µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.035919ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 859.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21011ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.393915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 892.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.915108ms [martini] Started GET /api/lb-check for 10.1.1.81:40194 [martini] Completed 200 OK in 702.403µs [martini] Started GET /api/raft-health for 10.1.1.81:40224 [martini] Completed 200 OK in 956.005µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.904218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.236005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.12011ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.047714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 963.605µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.017309ms 2018-11-29 07:15:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/8b58cd24/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 688.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.829617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.074705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.852608ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.728217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.068205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.240015ms [martini] Started GET /api/lb-check for 10.1.1.81:40364 [martini] Completed 200 OK in 2.718713ms [martini] Started GET /api/raft-health for 10.1.1.81:40382 [martini] Completed 200 OK in 942.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.20812ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 986.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.03391ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.578017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.375006ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.285511ms [martini] Started GET /api/raft-follower-health-report/05faccde/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 815.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.827417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.084109ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.972409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.382343ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.160619ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.01201ms [martini] Started GET /api/lb-check for 10.1.1.81:40530 [martini] Completed 200 OK in 589.202µs [martini] Started GET /api/raft-health for 10.1.1.81:40544 [martini] Completed 200 OK in 747.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.359615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.063005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.890609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.485916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 853.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.950709ms [martini] Started GET /api/raft-follower-health-report/64b6dc1c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 811.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.928222ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 904.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.950918ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.388716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 885.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.724108ms [martini] Started GET /api/lb-check for 10.1.1.81:40688 [martini] Completed 200 OK in 803.003µs [martini] Started GET /api/raft-health for 10.1.1.81:40706 [martini] Completed 200 OK in 1.557207ms 2018-11-29 07:15:43 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.519716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.051005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.828308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.087514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 877.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.771708ms [martini] Started GET /api/raft-follower-health-report/f8c128b8/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 813.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.939918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 945.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.15971ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.032118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 820.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.059009ms [martini] Started GET /api/lb-check for 10.1.1.81:40852 [martini] Completed 200 OK in 671.103µs [martini] Started GET /api/raft-health for 10.1.1.81:40884 [martini] Completed 200 OK in 729.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.584916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.157805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18181ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.192415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.558316ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.338215ms [martini] Started GET /api/raft-follower-health-report/2093682f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 795.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.952018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 991.905µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23251ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.36452ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 921.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.085814ms [martini] Started GET /api/lb-check for 10.1.1.81:41020 [martini] Completed 200 OK in 659.603µs [martini] Started GET /api/raft-health for 10.1.1.81:41032 [martini] Completed 200 OK in 882.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.483416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.035414ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.743312ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.639816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 760.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.988109ms [martini] Started GET /api/raft-follower-health-report/82ea66ec/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.151005ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.556216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.150605ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.982009ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.394916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 872.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16641ms [martini] Started GET /api/lb-check for 10.1.1.81:41182 [martini] Completed 200 OK in 750.404µs [martini] Started GET /api/raft-health for 10.1.1.81:41192 [martini] Completed 200 OK in 846.504µs 2018-11-29 07:16:13 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.936018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.668417ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.12951ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.215615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 845.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20441ms 2018-11-29 07:16:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/2c4c7496/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 903.705µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.627116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.639807ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.050609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.254515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.624712ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.13851ms [martini] Started GET /api/lb-check for 10.1.1.81:41336 [martini] Completed 200 OK in 644.703µs [martini] Started GET /api/raft-health for 10.1.1.81:41366 [martini] Completed 200 OK in 824.304µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.935118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.569207ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.042109ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.996313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.013705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.882608ms [martini] Started GET /api/raft-follower-health-report/70f0c7b3/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.145305ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.618217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 822.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.154224ms [martini] Started GET /api/lb-check for 10.1.1.81:41500 [martini] Completed 200 OK in 794.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.404121ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 990.305µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.974209ms [martini] Started GET /api/raft-health for 10.1.1.81:41526 [martini] Completed 200 OK in 864.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.45112ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 937.005µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.13911ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.230614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.726608ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.970218ms [martini] Started GET /api/raft-follower-health-report/ee82dfd7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 758.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.148019ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.146905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18941ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.647016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.047805ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.119009ms [martini] Started GET /api/lb-check for 10.1.1.81:41672 [martini] Completed 200 OK in 562.003µs [martini] Started GET /api/raft-health for 10.1.1.81:41686 [martini] Completed 200 OK in 749.703µs 2018-11-29 07:16:43 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.158719ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 949.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.046309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.600717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.793222ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.14731ms [martini] Started GET /api/raft-follower-health-report/18585791/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 679.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.684131ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 873.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.949409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.676417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 899.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18081ms [martini] Started GET /api/lb-check for 10.1.1.81:41824 [martini] Completed 200 OK in 644.303µs [martini] Started GET /api/raft-health for 10.1.1.81:41840 [martini] Completed 200 OK in 688.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.758422ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 912.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23701ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.388816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 840.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.12221ms [martini] Started GET /api/raft-follower-health-report/fa718e08/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 793.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.577016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.058905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.018209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.033014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.132405ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.972009ms [martini] Started GET /api/lb-check for 10.1.1.81:41980 [martini] Completed 200 OK in 564.102µs [martini] Started GET /api/raft-health for 10.1.1.81:42008 [martini] Completed 200 OK in 682.603µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.667316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.174406ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21151ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.191115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 864.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.12661ms [martini] Started GET /api/raft-follower-health-report/cf85f12f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 779.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.279124ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 933.205µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.886208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.311316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.532812ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.234115ms [martini] Started GET /api/lb-check for 10.1.1.81:42146 [martini] Completed 200 OK in 699.603µs [martini] Started GET /api/raft-health for 10.1.1.81:42166 [martini] Completed 200 OK in 773.404µs 2018-11-29 07:17:13 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.798018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.006104ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.303911ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.668717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 964.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.08311ms 2018-11-29 07:17:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/5e5dacc9/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 844.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.713917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 5.216224ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.256119ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.905517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.072205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.11611ms [martini] Started GET /api/lb-check for 10.1.1.81:42306 [martini] Completed 200 OK in 699.403µs [martini] Started GET /api/raft-health for 10.1.1.81:42328 [martini] Completed 200 OK in 980.505µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.064419ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.143106ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.403711ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.593621ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.088005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22171ms [martini] Started GET /api/raft-follower-health-report/c17c39e7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 2.049609ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.621326ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 929.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.696813ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.785927ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 818.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.534611ms [martini] Started GET /api/lb-check for 10.1.1.81:42470 [martini] Completed 200 OK in 529.202µs [martini] Started GET /api/raft-health for 10.1.1.81:42482 [martini] Completed 200 OK in 695.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.094519ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.154805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.949409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.292715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 930.505µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16611ms [martini] Started GET /api/raft-follower-health-report/e8a31067/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 948.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.992318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 861.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.067009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.368515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.983014ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.17221ms [martini] Started GET /api/lb-check for 10.1.1.81:42630 [martini] Completed 200 OK in 618.703µs [martini] Started GET /api/raft-health for 10.1.1.81:42656 [martini] Completed 200 OK in 726.804µs 2018-11-29 07:17:43 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.179319ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 953.705µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.249647ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.896718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.107605ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22531ms [martini] Started GET /api/raft-follower-health-report/595a0c75/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.263606ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.857018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.079205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.02521ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.348916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 865.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.13441ms [martini] Started GET /api/lb-check for 10.1.1.81:42782 [martini] Completed 200 OK in 636.302µs [martini] Started GET /api/raft-health for 10.1.1.81:42816 [martini] Completed 200 OK in 873.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.571517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 977.405µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28711ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.928718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 867.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.800009ms [martini] Started GET /api/raft-follower-health-report/321c9c42/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 625.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.324715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.490407ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.004009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.405616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.125805ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.53063ms [martini] Started GET /api/lb-check for 10.1.1.81:42956 [martini] Completed 200 OK in 578.203µs [martini] Started GET /api/raft-health for 10.1.1.81:42970 [martini] Completed 200 OK in 752.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.087928ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.397807ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.374111ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.497016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 843.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.032109ms [martini] Started GET /api/raft-follower-health-report/08b8b656/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.321506ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.448116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.255915ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.413011ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.377915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 932.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.088209ms [martini] Started GET /api/lb-check for 10.1.1.81:43112 [martini] Completed 200 OK in 498.402µs [martini] Started GET /api/raft-health for 10.1.1.81:43126 [martini] Completed 200 OK in 877.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.877917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.155105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.219611ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.444216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.049305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.935609ms 2018-11-29 07:18:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/2d8cfcdc/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 9.115841ms 2018-11-29 07:18:19 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.771618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.175205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28151ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.376116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 988.305µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22431ms [martini] Started GET /api/lb-check for 10.1.1.81:43270 [martini] Completed 200 OK in 990.505µs [martini] Started GET /api/raft-health for 10.1.1.81:43292 [martini] Completed 200 OK in 706.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.834618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.052804ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.10621ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.616017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.803513ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.961723ms [martini] Started GET /api/raft-follower-health-report/36fe78e4/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 835.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.604516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 885.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19111ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.558416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 887.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.878909ms [martini] Started GET /api/lb-check for 10.1.1.81:43432 [martini] Completed 200 OK in 686.803µs [martini] Started GET /api/raft-health for 10.1.1.81:43460 [martini] Completed 200 OK in 841.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.708117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.777817ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.906514ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.017514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 913.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.13031ms [martini] Started GET /api/raft-follower-health-report/bbc958e4/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 900.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.704517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 932.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.932809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.282015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 836.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.857908ms [martini] Started GET /api/lb-check for 10.1.1.81:43600 [martini] Completed 200 OK in 519.502µs [martini] Started GET /api/raft-health for 10.1.1.81:43614 [martini] Completed 200 OK in 802.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.375621ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.025705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.955109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.979014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.091705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.891809ms [martini] Started GET /api/raft-follower-health-report/2cd81244/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 753.003µs 2018-11-29 07:18:49 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.620817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 972.105µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.990809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.156014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.033405ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.263115ms [martini] Started GET /api/lb-check for 10.1.1.81:43748 [martini] Completed 200 OK in 654.103µs [martini] Started GET /api/raft-health for 10.1.1.81:43764 [martini] Completed 200 OK in 1.133305ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.455316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.540007ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.301411ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.279615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 843.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23891ms [martini] Started GET /api/raft-follower-health-report/e04c36d4/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 765.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.384015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 957.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.008109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.706549ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 873.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.13321ms [martini] Started GET /api/lb-check for 10.1.1.81:43908 [martini] Completed 200 OK in 618.403µs [martini] Started GET /api/raft-health for 10.1.1.81:43922 [martini] Completed 200 OK in 1.163605ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.670517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 995.305µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.980709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.307315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 800.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.898709ms [martini] Started GET /api/raft-follower-health-report/eb918ea3/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.629607ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.483416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 817.503µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25941ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.416716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.098606ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.062609ms [martini] Started GET /api/lb-check for 10.1.1.81:44070 [martini] Completed 200 OK in 656.103µs [martini] Started GET /api/raft-health for 10.1.1.81:44098 [martini] Completed 200 OK in 882.804µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.438616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.122005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.987009ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.981714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.137205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.10941ms 2018-11-29 07:19:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/b64072af/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 817.004µs 2018-11-29 07:19:19 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.686817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.079705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.244711ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.847027ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 861.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.12841ms [martini] Started GET /api/lb-check for 10.1.1.81:44236 [martini] Completed 200 OK in 725.603µs [martini] Started GET /api/raft-health for 10.1.1.81:44254 [martini] Completed 200 OK in 781.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.822917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 968.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.107919ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.781531ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 964.705µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.938509ms [martini] Started GET /api/raft-follower-health-report/0fbf34cb/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 672.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.420415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.134205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.732008ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.56352ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.033205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.573521ms [martini] Started GET /api/lb-check for 10.1.1.81:44400 [martini] Completed 200 OK in 654.603µs [martini] Started GET /api/raft-health for 10.1.1.81:44412 [martini] Completed 200 OK in 790.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.795217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 822.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.002909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.896418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.012304ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.981509ms [martini] Started GET /api/raft-follower-health-report/0691e5f1/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.058205ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.693117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.243905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.02431ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.359716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.091605ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.738812ms [martini] Started GET /api/lb-check for 10.1.1.81:44554 [martini] Completed 200 OK in 6.72703ms [martini] Started GET /api/raft-health for 10.1.1.81:44568 [martini] Completed 200 OK in 903.005µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.832717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 861.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.060709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.20852ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.037704ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.863709ms [martini] Started GET /api/raft-follower-health-report/00302ca4/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 768.604µs 2018-11-29 07:19:49 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.408316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.090705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28851ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.437634ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 690.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.950109ms [martini] Started GET /api/lb-check for 10.1.1.81:44704 [martini] Completed 200 OK in 526.102µs [martini] Started GET /api/raft-health for 10.1.1.81:44734 [martini] Completed 200 OK in 606.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.463116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 901.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23751ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.45852ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 863.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.457011ms [martini] Started GET /api/raft-follower-health-report/701fb196/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 895.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 12.540857ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 995.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.004209ms [martini] Started GET /api/lb-check for 10.1.1.81:44880 [martini] Completed 200 OK in 651.103µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.863622ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 952.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28701ms [martini] Started GET /api/raft-health for 10.1.1.81:44894 [martini] Completed 200 OK in 797.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.084319ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.668908ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.312111ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.090219ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.029005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.867909ms [martini] Started GET /api/raft-follower-health-report/9ec8ae40/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 870.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.503616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 860.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.06321ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.418715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 778.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.155109ms [martini] Started GET /api/lb-check for 10.1.1.81:45036 [martini] Completed 200 OK in 638.003µs [martini] Started GET /api/raft-health for 10.1.1.81:45052 [martini] Completed 200 OK in 803.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.708217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 992.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.064528ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.488316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 877.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.892308ms 2018-11-29 07:20:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/642a6d5a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 715.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.496916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.099505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.403011ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.201719ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 889.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.938309ms [martini] Started GET /api/lb-check for 10.1.1.81:45214 [martini] Completed 200 OK in 797.903µs [martini] Started GET /api/raft-health for 10.1.1.81:45240 [martini] Completed 200 OK in 1.724408ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.545817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.038104ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.17941ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.089524ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 929.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.917409ms 2018-11-29 07:20:25 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/28305a33/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.016705ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.571216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 888.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.14081ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.661922ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 850.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.884717ms [martini] Started GET /api/lb-check for 10.1.1.81:45388 [martini] Completed 200 OK in 4.258519ms [martini] Started GET /api/raft-health for 10.1.1.81:45412 [martini] Completed 200 OK in 831.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.537216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 935.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22631ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.221015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 817.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.881809ms [martini] Started GET /api/raft-follower-health-report/933cb9f7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.065305ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.758117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 766.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.727817ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.806217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 923.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.954009ms [martini] Started GET /api/lb-check for 10.1.1.81:45560 [martini] Completed 200 OK in 685.203µs [martini] Started GET /api/raft-health for 10.1.1.81:45578 [martini] Completed 200 OK in 1.122905ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.583016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 856.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.116209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.047423ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 808.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.08021ms [martini] Started GET /api/raft-follower-health-report/067a1b85/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 925.705µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.900418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 937.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.368811ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.777817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 878.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.077309ms [martini] Started GET /api/lb-check for 10.1.1.81:45720 [martini] Completed 200 OK in 621.603µs [martini] Started GET /api/raft-health for 10.1.1.81:45736 [martini] Completed 200 OK in 695.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.998818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.033705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21791ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.980527ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.379515ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.055414ms 2018-11-29 07:20:55 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/465395a2/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 621.603µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.623817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 880.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16281ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.113419ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 869.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.025109ms [martini] Started GET /api/lb-check for 10.1.1.81:45876 [martini] Completed 200 OK in 475.403µs [martini] Started GET /api/raft-health for 10.1.1.81:45902 [martini] Completed 200 OK in 705.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.450416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 972.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.330016ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.375216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.033305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.853908ms [martini] Started GET /api/raft-follower-health-report/349cd199/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.006205ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.540916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.114305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22671ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.240215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 735.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.914313ms [martini] Started GET /api/lb-check for 10.1.1.81:46026 [martini] Completed 200 OK in 596.102µs [martini] Started GET /api/raft-health for 10.1.1.81:46052 [martini] Completed 200 OK in 715.103µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.485916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 907.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.441311ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.307515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 861.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.812609ms 2018-11-29 07:21:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/20246de8/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 767.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.395216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 960.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25401ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.394716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.048105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.057809ms [martini] Started GET /api/lb-check for 10.1.1.81:46202 [martini] Completed 200 OK in 5.818227ms [martini] Started GET /api/raft-health for 10.1.1.81:46220 [martini] Completed 200 OK in 848.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.498616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 936.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.039209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.172515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.028105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.724327ms [martini] Started GET /api/raft-follower-health-report/d0ab23ba/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.057204ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.732517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 945.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.408116ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.439615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 852.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.899909ms [martini] Started GET /api/lb-check for 10.1.1.81:46376 [martini] Completed 200 OK in 638.503µs [martini] Started GET /api/raft-health for 10.1.1.81:46392 [martini] Completed 200 OK in 933.804µs 2018-11-29 07:21:31 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.442615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 754.703µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.11361ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.155114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 882.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.11971ms [martini] Started GET /api/raft-follower-health-report/f5caf3b7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.139006ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.702017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 986.505µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.301311ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.813417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 885.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.795308ms [martini] Started GET /api/lb-check for 10.1.1.81:46526 [martini] Completed 200 OK in 806.204µs [martini] Started GET /api/raft-health for 10.1.1.81:46554 [martini] Completed 200 OK in 864.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.344215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.459707ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.339611ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.205415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.141506ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.057909ms [martini] Started GET /api/raft-follower-health-report/000407d9/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 691.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.37592ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.177505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.342611ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.487916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.080305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.037709ms [martini] Started GET /api/lb-check for 10.1.1.81:46700 [martini] Completed 200 OK in 687.003µs [martini] Started GET /api/raft-health for 10.1.1.81:46716 [martini] Completed 200 OK in 985.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.604117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 780.003µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.051714ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.645349ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 957.405µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.10301ms [martini] Started GET /api/raft-follower-health-report/5d2effc6/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 692.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.483016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.056305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.975009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.76074ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 863.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.196611ms [martini] Started GET /api/lb-check for 10.1.1.81:46868 [martini] Completed 200 OK in 666.803µs [martini] Started GET /api/raft-health for 10.1.1.81:46884 [martini] Completed 200 OK in 616.603µs 2018-11-29 07:22:01 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.612916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.165406ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.07461ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.202414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 949.105µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.019609ms [martini] Started GET /api/raft-follower-health-report/c34b5913/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 689.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.45413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.134305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27341ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.644116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.473007ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.861718ms [martini] Started GET /api/lb-check for 10.1.1.81:47042 [martini] Completed 200 OK in 492.202µs [martini] Started GET /api/raft-health for 10.1.1.81:47054 [martini] Completed 200 OK in 925.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.195219ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.114406ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.027109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.253315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 949.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.881108ms 2018-11-29 07:22:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/3400961e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 869.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.738717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 974.705µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.885046ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.638916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 976.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.036609ms [martini] Started GET /api/lb-check for 10.1.1.81:47226 [martini] Completed 200 OK in 821.904µs [martini] Started GET /api/raft-health for 10.1.1.81:47260 [martini] Completed 200 OK in 712.703µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.757122ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.046405ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.10751ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.396415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.025104ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21331ms [martini] Started GET /api/raft-follower-health-report/96d789bb/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 2.31941ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.780618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 949.405µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.367411ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.34192ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 782.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.994609ms [martini] Started GET /api/lb-check for 10.1.1.81:47422 [martini] Completed 200 OK in 557.903µs [martini] Started GET /api/raft-health for 10.1.1.81:47434 [martini] Completed 200 OK in 796.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.754617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.143605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.019909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.445116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 965.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19161ms 2018-11-29 07:22:37 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/f8ca629d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 804.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.795417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.142405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.362111ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.323616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 946.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.413234ms [martini] Started GET /api/lb-check for 10.1.1.81:47576 [martini] Completed 200 OK in 596.803µs [martini] Started GET /api/raft-health for 10.1.1.81:47586 [martini] Completed 200 OK in 801.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.120019ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 967.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.649726ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.244715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 989.805µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.063109ms [martini] Started GET /api/raft-follower-health-report/1888ce97/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 591.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.526921ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.097905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.05141ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.262215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 797.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.833709ms [martini] Started GET /api/lb-check for 10.1.1.81:47740 [martini] Completed 200 OK in 633.003µs [martini] Started GET /api/raft-health for 10.1.1.81:47758 [martini] Completed 200 OK in 675.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.760818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.054505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.16261ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.148528ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.475807ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.510116ms [martini] Started GET /api/raft-follower-health-report/f18abe38/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 711.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.604216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 905.205µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.112809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.341624ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.081905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.270615ms [martini] Started GET /api/lb-check for 10.1.1.81:47904 [martini] Completed 200 OK in 555.102µs [martini] Started GET /api/raft-health for 10.1.1.81:47932 [martini] Completed 200 OK in 1.139105ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.751218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 891.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.351511ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.284015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 828.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20551ms 2018-11-29 07:23:07 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/622b37f1/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 839.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.523816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.167705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.35012ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.312724ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 907.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.962809ms [martini] Started GET /api/lb-check for 10.1.1.81:48092 [martini] Completed 200 OK in 547.502µs [martini] Started GET /api/raft-health for 10.1.1.81:48104 [martini] Completed 200 OK in 811.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.722717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 955.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.196911ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.127619ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 943.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.928209ms 2018-11-29 07:23:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/99b08b89/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 644.803µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.569826ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.060305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.241324ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.143224ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 930.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.02401ms [martini] Started GET /api/lb-check for 10.1.1.81:48254 [martini] Completed 200 OK in 693.003µs [martini] Started GET /api/raft-health for 10.1.1.81:48268 [martini] Completed 200 OK in 837.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.32042ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 854.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.012609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.385216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.008205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.121009ms [martini] Started GET /api/raft-follower-health-report/e5b24e41/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 840.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.430416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.060205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.98741ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.29572ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 869.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.819708ms [martini] Started GET /api/lb-check for 10.1.1.81:48426 [martini] Completed 200 OK in 679.503µs [martini] Started GET /api/raft-health for 10.1.1.81:48452 [martini] Completed 200 OK in 667.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.984818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.043305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.280915ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.35082ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.035805ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.901209ms 2018-11-29 07:23:37 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/baf1fc3a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.004105ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.887118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.099905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.32781ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.166415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 917.905µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.08591ms [martini] Started GET /api/lb-check for 10.1.1.81:48578 [martini] Completed 200 OK in 674.303µs [martini] Started GET /api/raft-health for 10.1.1.81:48610 [martini] Completed 200 OK in 882.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.536116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 930.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.315811ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.19292ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.060505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.002509ms [martini] Started GET /api/raft-follower-health-report/27649e6f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 699.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.042519ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 992.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.029009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.422016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.204405ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.07201ms [martini] Started GET /api/lb-check for 10.1.1.81:48752 [martini] Completed 200 OK in 2.579412ms [martini] Started GET /api/raft-health for 10.1.1.81:48766 [martini] Completed 200 OK in 919.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.750717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.105605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.434011ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.324315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 918.405µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.231015ms [martini] Started GET /api/raft-follower-health-report/2516aeb9/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 971.004µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.840822ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.212506ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.788108ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.725622ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 7.318634ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.864808ms [martini] Started GET /api/lb-check for 10.1.1.81:48918 [martini] Completed 200 OK in 631.203µs [martini] Started GET /api/raft-health for 10.1.1.81:48930 [martini] Completed 200 OK in 738.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.414616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.166006ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.107809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.169915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 858.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.101909ms [martini] Started GET /api/raft-follower-health-report/52df841a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 721.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.334415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 847.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.013009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.327415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 986.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.243915ms [martini] Started GET /api/lb-check for 10.1.1.81:49070 [martini] Completed 200 OK in 776.704µs [martini] Started GET /api/raft-health for 10.1.1.81:49102 [martini] Completed 200 OK in 937.905µs 2018-11-29 07:24:13 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.676917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.002705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20421ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.499116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 988.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28271ms 2018-11-29 07:24:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/af6d0d96/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.045705ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.057223ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.371106ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.081409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.251915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 990.205µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.09251ms [martini] Started GET /api/lb-check for 10.1.1.81:49252 [martini] Completed 200 OK in 677.603µs [martini] Started GET /api/raft-health for 10.1.1.81:49270 [martini] Completed 200 OK in 819.504µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.638717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 936.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.388611ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.897518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 922.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.042209ms [martini] Started GET /api/raft-follower-health-report/f31d60a0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 817.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.346915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 780.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.848009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.155415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 847.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.003509ms [martini] Started GET /api/lb-check for 10.1.1.81:49418 [martini] Completed 200 OK in 521.602µs [martini] Started GET /api/raft-health for 10.1.1.81:49432 [martini] Completed 200 OK in 721.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.899118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.172705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.10911ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.179614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 885.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.075909ms 2018-11-29 07:24:37 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/cf440f98/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 812.203µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.675917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 931.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.02051ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.856913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.174206ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.955009ms [martini] Started GET /api/lb-check for 10.1.1.81:49580 [martini] Completed 200 OK in 2.066509ms [martini] Started GET /api/raft-health for 10.1.1.81:49592 [martini] Completed 200 OK in 598.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.681317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 948.105µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.869109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.228015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.120505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.984109ms [martini] Started GET /api/raft-follower-health-report/e8efca3d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 886.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.479716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 785.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.01431ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.176138ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 880.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.04961ms [martini] Started GET /api/lb-check for 10.1.1.81:49738 [martini] Completed 200 OK in 667.603µs [martini] Started GET /api/raft-health for 10.1.1.81:49774 [martini] Completed 200 OK in 639.503µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.067618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 927.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.344111ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.38792ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 5.812227ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.08991ms [martini] Started GET /api/raft-follower-health-report/bbe8a1bf/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 791.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.619449ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 945.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.072409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.106614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.213506ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:49922 [martini] Completed 200 OK in 529.802µs [martini] Completed 200 OK in 3.673117ms [martini] Started GET /api/raft-health for 10.1.1.81:49938 [martini] Completed 200 OK in 852.004µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.884018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.003904ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18271ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.867717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 759.803µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.988109ms [martini] Started GET /api/raft-follower-health-report/ec9a5fcb/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 991.405µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.455316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.113505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.15861ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.486416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 784.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.918409ms [martini] Started GET /api/lb-check for 10.1.1.81:50080 [martini] Completed 200 OK in 597.803µs [martini] Started GET /api/raft-health for 10.1.1.81:50092 [martini] Completed 200 OK in 764.704µs 2018-11-29 07:25:13 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.586417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.642808ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.220814ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.281815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 875.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.907108ms 2018-11-29 07:25:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/ae8d16ce/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.786508ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.960418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 997.405µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.364611ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.588116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 897.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.035609ms [martini] Started GET /api/lb-check for 10.1.1.81:50234 [martini] Completed 200 OK in 757.304µs [martini] Started GET /api/raft-health for 10.1.1.81:50254 [martini] Completed 200 OK in 729.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.739317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.115105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.061409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.558621ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.027005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.048314ms [martini] Started GET /api/raft-follower-health-report/f4dbfaa3/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 840.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.873823ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 821.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.007909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.929232ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 995.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.659612ms [martini] Started GET /api/lb-check for 10.1.1.81:50402 [martini] Completed 200 OK in 2.413011ms [martini] Started GET /api/raft-health for 10.1.1.81:50428 [martini] Completed 200 OK in 728.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.353715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 756.803µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.854009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.249415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 773.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.818408ms [martini] Started GET /api/raft-follower-health-report/f3e40a35/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 740.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.410116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 964.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.05611ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.983727ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 849.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.13101ms [martini] Started GET /api/lb-check for 10.1.1.81:50566 [martini] Completed 200 OK in 522.603µs [martini] Started GET /api/raft-health for 10.1.1.81:50580 [martini] Completed 200 OK in 831.903µs 2018-11-29 07:25:43 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.887718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 962.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.748618ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.781217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.171406ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.03571ms [martini] Started GET /api/raft-follower-health-report/48ff934b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 828.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.341715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.166106ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.946309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.400316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 943.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.005709ms [martini] Started GET /api/lb-check for 10.1.1.81:50724 [martini] Completed 200 OK in 720.803µs [martini] Started GET /api/raft-health for 10.1.1.81:50742 [martini] Completed 200 OK in 795.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.667417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 895.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.15371ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.676945ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 875.305µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.103409ms [martini] Started GET /api/raft-follower-health-report/9290e9d5/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 843.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.740717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.057805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.338811ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.798117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.066805ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.049209ms [martini] Started GET /api/lb-check for 10.1.1.81:50882 [martini] Completed 200 OK in 591.803µs [martini] Started GET /api/raft-health for 10.1.1.81:50898 [martini] Completed 200 OK in 630.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.248519ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.332211ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.664422ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.022514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.303606ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.02941ms [martini] Started GET /api/raft-follower-health-report/a9016f04/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 817.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.665617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 929.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.08461ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.180114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 999.505µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.981009ms [martini] Started GET /api/lb-check for 10.1.1.81:51034 [martini] Completed 200 OK in 518.603µs [martini] Started GET /api/raft-health for 10.1.1.81:51062 [martini] Completed 200 OK in 826.304µs 2018-11-29 07:26:13 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.813618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 937.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.958109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.227514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.014705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.863709ms 2018-11-29 07:26:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/e0f51f3b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 858.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.558716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.152305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.874809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.180515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 857.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.565716ms [martini] Started GET /api/lb-check for 10.1.1.81:51206 [martini] Completed 200 OK in 584.503µs [martini] Started GET /api/raft-health for 10.1.1.81:51228 [martini] Completed 200 OK in 769.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.306312ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 893.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.944207ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.208313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 870.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.264709ms [martini] Started GET /api/raft-follower-health-report/03e2ed73/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 820.103µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.898514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 834.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.871207ms [martini] Started GET /api/lb-check for 10.1.1.81:51366 [martini] Completed 200 OK in 4.965219ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.250812ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 796.003µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.288713ms [martini] Started GET /api/raft-health for 10.1.1.81:51388 [martini] Completed 200 OK in 662.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.356713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 989.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.977512ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.261612ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 942.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.828007ms [martini] Started GET /api/raft-follower-health-report/fca99853/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 885.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.620829ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 932.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.246208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.227116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 990.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.954107ms [martini] Started GET /api/lb-check for 10.1.1.81:51534 [martini] Completed 200 OK in 568.102µs [martini] Started GET /api/raft-health for 10.1.1.81:51562 [martini] Completed 200 OK in 885.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.605517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.117005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.086708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.331113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 900.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.997208ms [martini] Started GET /api/raft-follower-health-report/b747d5f8/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 834.303µs 2018-11-29 07:26:49 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.725014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.639907ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.896307ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.282013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 868.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.988907ms [martini] Started GET /api/lb-check for 10.1.1.81:51700 [martini] Completed 200 OK in 672.802µs [martini] Started GET /api/raft-health for 10.1.1.81:51734 [martini] Completed 200 OK in 823.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.627014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.000104ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.350009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.951542ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 835.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.978108ms [martini] Started GET /api/raft-follower-health-report/6b1e93f5/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 749.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.207513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 928.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.937607ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.718815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.013004ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:51884 [martini] Completed 200 OK in 699.702µs [martini] Completed 200 OK in 3.888515ms [martini] Started GET /api/raft-health for 10.1.1.81:51898 [martini] Completed 200 OK in 1.145605ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.568414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.034204ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.872507ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.426213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 736.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.917707ms [martini] Started GET /api/raft-follower-health-report/29fd2009/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 611.102µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.117512ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 848.703µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.797707ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.448414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 976.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.876707ms [martini] Started GET /api/lb-check for 10.1.1.81:52040 [martini] Completed 200 OK in 2.45211ms [martini] Started GET /api/raft-health for 10.1.1.81:52054 [martini] Completed 200 OK in 758.203µs 2018-11-29 07:27:13 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.620714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.094304ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.695611ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.044912ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 961.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.956708ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 2018-11-29 07:27:15 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 8.649334ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.169008ms 2018-11-29 07:27:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/c1174c97/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 802.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.19342ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.563206ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.610211ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.553814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 998.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.966108ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 2018-11-29 07:27:20 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 6.603626ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.928611ms [martini] Started GET /api/lb-check for 10.1.1.81:52200 [martini] Completed 200 OK in 595.602µs [martini] Started GET /api/raft-health for 10.1.1.81:52232 [martini] Completed 200 OK in 785.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.548013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 838.303µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.978307ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.742615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.189805ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.54791ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 2018-11-29 07:27:25 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 18.565372ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.088008ms [martini] Started GET /api/raft-follower-health-report/4218081e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 730.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.545814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 887.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.202208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.19332ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.734406ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.429009ms [martini] Started GET /api/lb-check for 10.1.1.81:52376 [martini] Completed 200 OK in 541.902µs [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 2018-11-29 07:27:30 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 11.576545ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.056808ms [martini] Started GET /api/raft-health for 10.1.1.81:52398 [martini] Completed 200 OK in 860.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.413713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 875.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.107108ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.143312ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 860.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.936008ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 2018-11-29 07:27:35 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 6.297025ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.44524ms [martini] Started GET /api/raft-follower-health-report/f2991113/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 758.003µs [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 2018-11-29 07:27:40 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 6.960427ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.841508ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.366913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.778411ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.312609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.680115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 949.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.173408ms [martini] Started GET /api/lb-check for 10.1.1.81:52544 [martini] Completed 200 OK in 609.002µs [martini] Started GET /api/raft-health for 10.1.1.81:52560 [martini] Completed 200 OK in 830.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.625914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.053204ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.44261ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.941415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 942.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.291509ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 2018-11-29 07:27:45 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 7.65163ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.000008ms [martini] Started GET /api/raft-follower-health-report/19cc7c05/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.446306ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.563614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.017204ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.137008ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.307613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 986.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.756207ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 2018-11-29 07:27:50 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 5.623322ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.57131ms [martini] Started GET /api/lb-check for 10.1.1.81:52690 [martini] Completed 200 OK in 827.903µs [martini] Started GET /api/raft-health for 10.1.1.81:52722 [martini] Completed 200 OK in 793.303µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.237025ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.596906ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.972308ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 2018-11-29 07:27:55 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 6.811226ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.770207ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.136312ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 896.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.225408ms 2018-11-29 07:27:55 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/e09a1b73/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.100804ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.780215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 818.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.005008ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:52862 [martini] Completed 200 OK in 980.804µs [martini] Completed 200 OK in 8.035532ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.338605ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.64473ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 2018-11-29 07:28:00 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 11.177544ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.234209ms [martini] Started GET /api/raft-health for 10.1.1.81:52892 [martini] Completed 200 OK in 866.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.433914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 810.303µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.949008ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.258317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 948.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 2018-11-29 07:28:05 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 200 OK in 2.46101ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 500 Internal Server Error in 6.738427ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.064508ms [martini] Started GET /api/raft-follower-health-report/97f4e2f9/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 885.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.293917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 916.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.825007ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.320913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.210505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.913508ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 2018-11-29 07:28:10 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 5.904224ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.459414ms [martini] Started GET /api/lb-check for 10.1.1.81:53036 [martini] Completed 200 OK in 484.402µs [martini] Started GET /api/raft-health for 10.1.1.81:53050 [martini] Completed 200 OK in 853.703µs 2018-11-29 07:28:13 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 2018-11-29 07:28:15 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 7.106328ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.266209ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.510129ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 911.503µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.067008ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.919212ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 930.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.848507ms 2018-11-29 07:28:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/master/prod-ain-cluster.default for 10.1.1.145:39490 2018-11-29 07:28:17 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 6.888527ms [martini] Started GET /api/raft-follower-health-report/17391051/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 832.403µs [martini] Started GET /api/master/prod-ain-cluster.default for 10.1.1.145:39524 2018-11-29 07:28:19 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 18.884974ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.619318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 951.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.639911ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 2018-11-29 07:28:20 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 6.536825ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.160312ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.431213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.233505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.898007ms [martini] Started GET /api/lb-check for 10.1.1.81:53200 [martini] Completed 200 OK in 646.403µs [martini] Started GET /api/raft-health for 10.1.1.81:53218 [martini] Completed 200 OK in 786.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.806919ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 936.703µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.069708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.599622ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.124404ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.306709ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 2018-11-29 07:28:25 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 10.438541ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.595811ms [martini] Started GET /api/raft-follower-health-report/97e26281/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 905.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.327617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.000604ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.214613ms [martini] Started GET /api/lb-check for 10.1.1.81:53378 [martini] Completed 200 OK in 603.302µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.611438ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.380206ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.215313ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 2018-11-29 07:28:30 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 8.491533ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.268109ms [martini] Started GET /api/raft-health for 10.1.1.81:53424 [martini] Completed 200 OK in 774.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.130112ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 805.603µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.130032ms 2018-11-29 07:28:35 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.103412ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 807.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.350909ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 500 Internal Server Error in 6.116524ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.025608ms [martini] Started GET /api/raft-follower-health-report/a87ddd0e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.144904ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.563714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 920.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.51451ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 12.126048ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 815.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.957208ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:53594 [martini] Completed 200 OK in 4.195716ms 2018-11-29 07:28:40 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 22.057488ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.886407ms [martini] Started GET /api/raft-health for 10.1.1.81:53612 [martini] Completed 200 OK in 2.060208ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.494614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 909.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.098108ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.096712ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.235405ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.184309ms 2018-11-29 07:28:45 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 500 Internal Server Error in 6.834027ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.250009ms [martini] Started GET /api/raft-follower-health-report/387ba327/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 683.502µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.690214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.124804ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.073813ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.574722ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 891.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.111112ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 2018-11-29 07:28:50 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 6.716327ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.30361ms [martini] Started GET /api/lb-check for 10.1.1.81:53782 [martini] Completed 200 OK in 619.902µs [martini] Started GET /api/raft-health for 10.1.1.81:53804 [martini] Completed 200 OK in 660.503µs [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 2018-11-29 07:28:55 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 5.617522ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.976908ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.499114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.975308ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.876211ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.154417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.945808ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.48531ms 2018-11-29 07:28:55 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/ad66dcbd/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 807.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.580414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.086504ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.014708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.293341ms [martini] Started GET /api/lb-check for 10.1.1.81:53996 [martini] Completed 200 OK in 749.203µs [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.009512ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.99702ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 2018-11-29 07:29:00 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 10.952144ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 13.236252ms [martini] Started GET /api/raft-health for 10.1.1.81:54016 [martini] Completed 200 OK in 756.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.579814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.029904ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.055008ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.427014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 933.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.971208ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 2018-11-29 07:29:05 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 6.249925ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.135709ms [martini] Started GET /api/raft-follower-health-report/00eec82c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 827.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.896319ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.061612ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.112709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.582914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 740.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.990207ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 2018-11-29 07:29:10 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 5.979424ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.908507ms [martini] Started GET /api/lb-check for 10.1.1.81:54190 [martini] Completed 200 OK in 796.603µs [martini] Started GET /api/raft-health for 10.1.1.81:54220 [martini] Completed 200 OK in 931.304µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.890616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.163605ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.203109ms 2018-11-29 07:29:15 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 500 Internal Server Error in 6.269925ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.042608ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.794819ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 774.203µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.017108ms 2018-11-29 07:29:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/4517eea8/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 901.704µs 2018-11-29 07:29:19 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 2018-11-29 07:29:20 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 6.491426ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.271709ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.159812ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 939.203µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.932308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.473814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.105604ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.344909ms [martini] Started GET /api/lb-check for 10.1.1.81:54394 [martini] Completed 200 OK in 849.203µs [martini] Started GET /api/raft-health for 10.1.1.81:54414 [martini] Completed 200 OK in 868.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.318213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 843.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.137309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.444721ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.053104ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.127208ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 2018-11-29 07:29:25 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 8.271833ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.370509ms [martini] Started GET /api/raft-follower-health-report/00b84ce0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 708.103µs [martini] Started GET /api/master/prod-ain-cluster.default for 10.1.1.145:40760 [martini] Completed 500 Internal Server Error in 6.628627ms 2018-11-29 07:29:29 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Started GET /api/master/prod-ain-cluster.default for 10.1.1.145:40760 2018-11-29 07:29:29 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 7.143229ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.775423ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 979.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.274309ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 2018-11-29 07:29:30 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 6.547026ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.47711ms [martini] Started GET /api/lb-check for 10.1.1.81:54588 [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.42331ms [martini] Completed 200 OK in 3.450114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 913.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.860807ms [martini] Started GET /api/raft-health for 10.1.1.81:54612 [martini] Completed 200 OK in 678.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.664915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 883.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.138109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.317013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.027904ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.465414ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 2018-11-29 07:29:35 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 9.91054ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.687711ms [martini] Started GET /api/raft-follower-health-report/b8a827cd/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 818.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.599315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.462506ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.165308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.424413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 906.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.41131ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 2018-11-29 07:29:40 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 5.959523ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.862507ms [martini] Started GET /api/lb-check for 10.1.1.81:54764 [martini] Completed 200 OK in 629.602µs [martini] Started GET /api/raft-health for 10.1.1.81:54778 [martini] Completed 200 OK in 888.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.527414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.045404ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.799607ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.683615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 994.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.203709ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 2018-11-29 07:29:45 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 6.387626ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.036208ms [martini] Started GET /api/raft-follower-health-report/66f6557d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 774.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.584315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 929.503µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.467814ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.596919ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 912.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.329409ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 2018-11-29 07:29:50 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 6.755027ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.168409ms [martini] Started GET /api/lb-check for 10.1.1.81:54930 [martini] Completed 200 OK in 570.502µs [martini] Started GET /api/raft-health for 10.1.1.81:54964 [martini] Completed 200 OK in 959.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.631015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 925.003µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.101609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.120813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 804.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.871508ms 2018-11-29 07:29:55 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 500 Internal Server Error in 5.651823ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.595019ms [martini] Started GET /api/raft-follower-health-report/92ab6a17/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 870.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.759515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.020804ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.039408ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.102813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.076904ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.132709ms [martini] Started GET /api/lb-check for 10.1.1.81:55132 [martini] Completed 200 OK in 689.603µs [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 2018-11-29 07:30:00 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 8.043732ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.063308ms [martini] Started GET /api/raft-health for 10.1.1.81:55148 [martini] Completed 200 OK in 929.704µs 2018-11-29 07:30:01 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.228129ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 871.203µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.037508ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.349113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 881.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.061708ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 2018-11-29 07:30:05 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 5.693423ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.965508ms [martini] Started GET /api/raft-follower-health-report/f17e947c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 776.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.679615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.083604ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.42081ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.569415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.073804ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.253709ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 2018-11-29 07:30:10 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 6.390326ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.017808ms [martini] Started GET /api/lb-check for 10.1.1.81:55302 [martini] Completed 200 OK in 506.702µs [martini] Started GET /api/raft-health for 10.1.1.81:55316 [martini] Completed 200 OK in 1.075604ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.443414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 897.303µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.916208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.279913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 870.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.918308ms 2018-11-29 07:30:15 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 500 Internal Server Error in 5.705323ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.843108ms 2018-11-29 07:30:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/a2195d3f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.370905ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.478514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 884.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.141109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.295613ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.035704ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.218509ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 2018-11-29 07:30:20 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 5.693123ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.978608ms [martini] Started GET /api/lb-check for 10.1.1.81:55470 [martini] Completed 200 OK in 688.202µs [martini] Started GET /api/raft-health for 10.1.1.81:55504 [martini] Completed 200 OK in 836.303µs [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 2018-11-29 07:30:25 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 11.971749ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.153413ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.591619ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 758.203µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.400113ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.619614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 865.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.007308ms 2018-11-29 07:30:25 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/6e2c7c13/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 732.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.410914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 926.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.036008ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:55648 [martini] Completed 200 OK in 612.402µs [martini] Completed 200 OK in 4.109716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 831.003µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.841408ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 2018-11-29 07:30:30 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 9.138037ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.613219ms [martini] Started GET /api/raft-health for 10.1.1.81:55688 [martini] Completed 200 OK in 753.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.925416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.032705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.285609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.558314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 890.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.187909ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 2018-11-29 07:30:35 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 5.999225ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.826007ms [martini] Started GET /api/raft-follower-health-report/8df42035/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 864.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.577735ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 970.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.169009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.255014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 830.003µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.868407ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 2018-11-29 07:30:40 ERROR Unable to determine cluster name. clusterHint=prod-ain-cluster.default [martini] Completed 500 Internal Server Error in 6.003124ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-0.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:55856 [martini] Completed 200 OK in 502.802µs 2018-11-29 07:30:40 ERROR ReadTopologyInstance(prod-ain-cluster-mysql-0.prod-ain-cluster-mysql-nodes.default:3306) ReplicationLagQuery: Error 1146: Table 'sys_operator.heartbeat' doesn't exist [martini] Completed 200 OK in 162.555061ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.290609ms [martini] Started GET /api/raft-health for 10.1.1.81:55874 [martini] Completed 200 OK in 841.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.473314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.046404ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.126817ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.088917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.140505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.113209ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.099213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 941.404µs [martini] Started GET /api/set-writeable/prod-ain-cluster-mysql-0.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 57.154032ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.808612ms [martini] Started GET /api/raft-follower-health-report/db00b738/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 930.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.444614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 841.703µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.189109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.759716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 880.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.771116ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.143517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.004304ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.899708ms [martini] Started GET /api/lb-check for 10.1.1.81:56036 [martini] Completed 200 OK in 552.203µs [martini] Started GET /api/raft-health for 10.1.1.81:56056 [martini] Completed 200 OK in 725.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.367514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 863.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.925007ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.610947ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 954.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.181509ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.418522ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.333005ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.336109ms [martini] Started GET /api/raft-follower-health-report/765695fc/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 818.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.781516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 989.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.271609ms [martini] Started GET /api/lb-check for 10.1.1.81:56254 [martini] Completed 200 OK in 613.102µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.687923ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 892.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.860607ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.74292ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.59541ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.45511ms [martini] Started GET /api/raft-health for 10.1.1.81:56270 [martini] Completed 200 OK in 691.803µs 2018-11-29 07:31:01 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.654319ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.162305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.990608ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.842415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 976.604µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.844208ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.384014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 908.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.968708ms [martini] Started GET /api/raft-follower-health-report/7ea07899/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 866.504µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.944716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 991.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.448914ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.261026ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 980.704µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.054808ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.056113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 888.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.840208ms [martini] Started GET /api/lb-check for 10.1.1.81:56436 [martini] Completed 200 OK in 558.002µs [martini] Started GET /api/raft-health for 10.1.1.81:56452 [martini] Completed 200 OK in 909.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.667815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 763.303µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.089109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.302014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 829.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.031909ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.939741ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 944.604µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.963708ms 2018-11-29 07:31:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/07621902/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 744.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.286814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 904.603µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.45801ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.521615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.155004ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.939408ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.348313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.088905ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.955608ms [martini] Started GET /api/lb-check for 10.1.1.81:56626 [martini] Completed 200 OK in 2.061008ms [martini] Started GET /api/raft-health for 10.1.1.81:56648 [martini] Completed 200 OK in 909.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.499519ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 970.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.160509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.440819ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.42461ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.059108ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.359514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 969.604µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.149909ms [martini] Started GET /api/master/prod-ain-cluster.default for 10.1.0.153:57626 [martini] Completed 200 OK in 4.70572ms [martini] Started GET /api/raft-follower-health-report/2ea7c16d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 2.070209ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.715215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 993.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.103909ms [martini] Started GET /api/lb-check for 10.1.1.81:56822 [martini] Completed 200 OK in 568.202µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.338813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 784.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.817508ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.72004ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 886.504µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.252914ms [martini] Started GET /api/raft-health for 10.1.1.81:56862 [martini] Completed 200 OK in 922.404µs [martini] Started GET /api/master/prod-ain-cluster.default for 10.1.0.153:57680 [martini] Completed 200 OK in 3.670415ms 2018-11-29 07:31:31 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.629315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.314318ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.146017ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.409914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 853.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.921808ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.102113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 870.403µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.910507ms [martini] Started GET /api/raft-follower-health-report/b2271793/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 925.204µs [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.623415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.105205ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.39541ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.131313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 849.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.002625ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.034917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 756.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.952708ms [martini] Started GET /api/lb-check for 10.1.1.81:57032 [martini] Completed 200 OK in 590.802µs [martini] Started GET /api/raft-health for 10.1.1.81:57046 [martini] Completed 200 OK in 958.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.678615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.170105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.045209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.173813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.017104ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.886008ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.078113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 906.204µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.303009ms 2018-11-29 07:31:45 ERROR ReadTopologyInstance(prod-ain-cluster-mysql-0.prod-ain-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/f426937c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.003404ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.343813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 940.403µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.282509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.513915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 979.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.791812ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.017212ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 780.203µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.948309ms [martini] Started GET /api/lb-check for 10.1.1.81:57204 [martini] Completed 200 OK in 574.803µs [martini] Started GET /api/raft-health for 10.1.1.81:57224 [martini] Completed 200 OK in 714.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.998417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.193804ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.160709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.568423ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.028204ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.134109ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.079317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 992.204µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.050208ms [martini] Started GET /api/raft-follower-health-report/7c3ce304/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 699.503µs [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.504015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.018104ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.617515ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.325218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 825.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.973909ms [martini] Started GET /api/lb-check for 10.1.1.81:57390 [martini] Completed 200 OK in 627.102µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.058216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 957.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.38601ms [martini] Started GET /api/raft-health for 10.1.1.81:57404 [martini] Completed 200 OK in 859.003µs 2018-11-29 07:32:01 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.299414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.038604ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.953808ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.420214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 887.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.944308ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.912936ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 851.303µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.897707ms [martini] Started GET /api/raft-follower-health-report/f479edeb/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.450006ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.757415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 790.103µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.053809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.529415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.018304ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.155009ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.612215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 915.103µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.102909ms [martini] Started GET /api/lb-check for 10.1.1.81:57564 [martini] Completed 200 OK in 2.35961ms [martini] Started GET /api/master/prod-ain-cluster.default for 10.1.0.153:58626 [martini] Completed 200 OK in 4.026417ms [martini] Started GET /api/master/prod-ain-cluster.default for 10.1.0.153:58626 [martini] Completed 200 OK in 3.575415ms [martini] Started GET /api/master/prod-ain-cluster.default for 10.1.0.153:58626 [martini] Completed 200 OK in 3.921916ms [martini] Started GET /api/raft-health for 10.1.1.81:57592 [martini] Completed 200 OK in 812.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.766016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 997.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.998508ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.250214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 824.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.089009ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.673616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 871.203µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.159809ms 2018-11-29 07:32:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/6d2de97f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 924.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.564114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 972.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.124513ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.301313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 895.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.047309ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.205213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 801.104µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.955408ms [martini] Started GET /api/lb-check for 10.1.1.81:57752 [martini] Completed 200 OK in 614.303µs [martini] Started GET /api/raft-health for 10.1.1.81:57768 [martini] Completed 200 OK in 768.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.716015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.254905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.136409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.032121ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 971.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.027309ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.464322ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 801.303µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.801608ms [martini] Started GET /api/raft-follower-health-report/6da7f4b6/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 825.303µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.469414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.052704ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.546815ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.309718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.031604ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.075309ms [martini] Started GET /api/lb-check for 10.1.1.81:57932 [martini] Completed 200 OK in 2.786011ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.533615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.006304ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.954008ms [martini] Started GET /api/raft-health for 10.1.1.81:57960 [martini] Completed 200 OK in 799.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.639515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 892.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.252209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.698416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 839.703µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.146509ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.452027ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.006204ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.945808ms 2018-11-29 07:32:37 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/6902d2b3/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 700.603µs [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.560915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.270005ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:58130 [martini] Completed 200 OK in 526.402µs [martini] Completed 200 OK in 122.701709ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.040908ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.456318ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 823.603µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.964908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.157113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.240214ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.739032ms [martini] Started GET /api/raft-health for 10.1.1.81:58170 [martini] Completed 200 OK in 818.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.864816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 928.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.182909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.215314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 948.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.837507ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.261814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 975.904µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 74.094008ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.39591ms [martini] Started GET /api/raft-follower-health-report/c86ca1c4/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 973.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.498015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.278305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.061909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.285614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 771.703µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.495211ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.361314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 987.305µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:58314 [martini] Completed 200 OK in 543.502µs [martini] Completed 200 OK in 118.112791ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.435947ms [martini] Started GET /api/raft-health for 10.1.1.81:58354 [martini] Completed 200 OK in 755.403µs 2018-11-29 07:32:51 ERROR ReadTopologyInstance(prod-ain-cluster-mysql-0.prod-ain-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.055317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 905.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.816616ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.682219ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 991.105µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 109.540156ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.037408ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.015413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 870.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.903808ms [martini] Started GET /api/raft-follower-health-report/25ab93f2/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 805.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.004237ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 895.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.911408ms [martini] Started GET /api/lb-check for 10.1.1.81:58524 [martini] Completed 200 OK in 612.403µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.90902ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 902.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.865108ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.935721ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.000604ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 120.741003ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.32961ms [martini] Started GET /api/raft-health for 10.1.1.81:58542 [martini] Completed 200 OK in 835.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.314018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.890221ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.985008ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.554615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.064904ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.978708ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.684616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.096204ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 130.485843ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.322109ms 2018-11-29 07:33:07 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/6284944b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 952.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.643815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.445906ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.238417ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.679716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 906.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.001509ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.306714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.023005ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:58692 [martini] Completed 200 OK in 669.403µs [martini] Completed 200 OK in 112.281568ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.235009ms [martini] Started GET /api/raft-health for 10.1.1.81:58720 [martini] Completed 200 OK in 1.129404ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.816016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 924.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.064109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.410814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.446515ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.759011ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.182914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 970.504µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 127.587033ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.947108ms 2018-11-29 07:33:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/529f7c4b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 815.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.812121ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 982.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.203009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.229813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 841.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25191ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.206022ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 982.604µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:58878 [martini] Completed 200 OK in 551.703µs [martini] Completed 200 OK in 82.600345ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.088034ms [martini] Started GET /api/raft-health for 10.1.1.81:58906 [martini] Completed 200 OK in 928.604µs [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.872016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 946.604µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 109.362457ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.032009ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.246214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 914.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.945008ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.624724ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.011504ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.947425ms [martini] Started GET /api/raft-follower-health-report/6a3649d7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 934.704µs [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.771124ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.166305ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:59068 [martini] Completed 200 OK in 1.220405ms [martini] Completed 200 OK in 86.287661ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.816912ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.126913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.065304ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.186314ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.622249ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 8.140934ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.497711ms [martini] Started GET /api/raft-health for 10.1.1.81:59090 [martini] Completed 200 OK in 694.502µs [martini] Started GET /api/master/prod-ain-cluster.default for 10.1.0.236:40568 [martini] Completed 200 OK in 3.865116ms [martini] Started GET /api/master/prod-ain-cluster.default for 10.1.0.236:40590 [martini] Completed 200 OK in 3.690416ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.484219ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 929.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.35351ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.337714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 951.604µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 82.011343ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.025109ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.070112ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 993.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.286113ms 2018-11-29 07:33:37 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/50363ca8/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 863.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.974116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.067405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.197109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.701316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 888.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.981608ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.126513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.008405ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:59264 [martini] Completed 200 OK in 690.603µs [martini] Completed 200 OK in 80.237935ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25201ms [martini] Started GET /api/raft-health for 10.1.1.81:59278 [martini] Completed 200 OK in 1.360606ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.797416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 854.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.883308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.364714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.048005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.004008ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.358914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 904.303µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 77.472525ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.109409ms [martini] Started GET /api/raft-follower-health-report/4262a765/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 696.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.991117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 841.303µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.131009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.304314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 770.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.920208ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.803212ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 836.504µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:59444 [martini] Completed 200 OK in 604.002µs [martini] Completed 200 OK in 106.453546ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.057212ms [martini] Started GET /api/raft-health for 10.1.1.81:59476 [martini] Completed 200 OK in 769.803µs 2018-11-29 07:33:51 ERROR ReadTopologyInstance(prod-ain-cluster-mysql-0.prod-ain-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.053734ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 990.904µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 79.692835ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.054008ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.139813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 931.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.008009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.287914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.102004ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23221ms [martini] Started GET /api/raft-follower-health-report/6bf8fb1f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 770.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.961216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 858.803µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.493827ms [martini] Started GET /api/lb-check for 10.1.1.81:59644 [martini] Completed 200 OK in 514.003µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.608528ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.105205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.125209ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 12.662753ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 930.604µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 89.471176ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.065213ms [martini] Started GET /api/raft-health for 10.1.1.81:59672 [martini] Completed 200 OK in 1.062904ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.093325ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 865.403µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19931ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.949642ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 851.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.108709ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.202813ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 863.904µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 77.701126ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.249109ms [martini] Started GET /api/raft-follower-health-report/560283e7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 784.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.993817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.128805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.989308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.459514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 889.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.038925ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:59826 [martini] Completed 200 OK in 534.802µs [martini] Completed 200 OK in 4.265518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 865.404µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 84.925057ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.40031ms [martini] Started GET /api/raft-health for 10.1.1.81:59840 [martini] Completed 200 OK in 804.404µs 2018-11-29 07:34:13 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/master/prod-ain-cluster.default for 10.1.0.236:41146 [martini] Completed 200 OK in 3.678915ms [martini] Started GET /api/master/prod-ain-cluster.default for 10.1.0.236:41146 [martini] Completed 200 OK in 3.424114ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.986317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.870707ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.267714ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.770416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 799.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.870208ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.190114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.591907ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Started GET /api/master/prod-ain-cluster.default for 10.1.0.236:41146 [martini] Completed 200 OK in 3.848416ms [martini] Completed 200 OK in 74.800214ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21201ms 2018-11-29 07:34:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/0ccf1c02/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 796.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.937917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 849.103µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.067408ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.430115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.970308ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.879808ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.067113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 891.504µs [martini] Started GET /api/lb-check for 10.1.1.81:59996 [martini] Completed 200 OK in 1.077805ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 76.08272ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.414318ms [martini] Started GET /api/raft-health for 10.1.1.81:60022 [martini] Completed 200 OK in 846.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.526515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 881.103µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.249109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.392236ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 943.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.723124ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.100439ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.794016ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 78.932532ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 30.930231ms [martini] Started GET /api/raft-follower-health-report/f282ccc7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 771.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.315313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 923.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.063009ms [martini] Started GET /api/lb-check for 10.1.1.81:60186 [martini] Completed 200 OK in 570.002µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.513415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 881.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.974908ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.453127ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.273906ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 84.189954ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.142109ms [martini] Started GET /api/raft-health for 10.1.1.81:60218 [martini] Completed 200 OK in 1.034005ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.593715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.034004ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.907908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.020413ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.075204ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.786008ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.072313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 913.704µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 94.431598ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28321ms [martini] Started GET /api/raft-follower-health-report/eb8d6205/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 611.202µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.547115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 870.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.161409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.286214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 749.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.804608ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.043113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 788.404µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:60410 [martini] Completed 200 OK in 671.302µs [martini] Completed 200 OK in 92.063488ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.148709ms [martini] Started GET /api/raft-health for 10.1.1.81:60424 [martini] Completed 200 OK in 1.926108ms 2018-11-29 07:34:43 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.588016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 949.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.001708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.555915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 954.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.35731ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.321314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 915.304µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 82.373348ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 145.998317ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.35971ms [martini] Started GET /api/raft-follower-health-report/b5a95622/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 795.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.945617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 888.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.134809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.869616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 875.103µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.067809ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:60588 [martini] Completed 200 OK in 644.903µs [martini] Completed 200 OK in 3.718116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 873.504µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 87.46347ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 89.761779ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.946913ms [martini] Started GET /api/raft-health for 10.1.1.81:60610 [martini] Completed 200 OK in 5.220022ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.528515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.146904ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.986608ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.587016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.968813ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.913509ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.084213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 906.004µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 107.805456ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 140.986696ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.690515ms 2018-11-29 07:34:57 ERROR ReadTopologyInstance(prod-ain-cluster-mysql-0.prod-ain-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/86126562/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 853.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.291718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 837.203µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.059213ms [martini] Started GET /api/lb-check for 10.1.1.81:60780 [martini] Completed 200 OK in 640.202µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.865125ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 829.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.839308ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.523915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.027704ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 88.699575ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 94.835501ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.839308ms [martini] Started GET /api/raft-health for 10.1.1.81:60798 [martini] Completed 200 OK in 2.643612ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.961817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.195905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27961ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.396414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 779.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.084109ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.155513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 927.404µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 80.903042ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 76.351023ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.017109ms [martini] Started GET /api/raft-follower-health-report/2a976735/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 852.704µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.488319ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.320306ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.046109ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.579115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 974.504µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:60960 [martini] Completed 200 OK in 483.602µs [martini] Completed 200 OK in 84.364857ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 85.286361ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.126213ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 20.649387ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 804.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.098609ms [martini] Started GET /api/raft-health for 10.1.1.81:60988 [martini] Completed 200 OK in 2.887712ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.439223ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.087005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.132809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.746916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.100304ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27731ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.411515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 892.604µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 107.280454ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 70.134597ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.936913ms 2018-11-29 07:35:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/ee4779f0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 692.503µs 2018-11-29 07:35:19 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.187526ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.074105ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:32916 [martini] Completed 200 OK in 657.903µs [martini] Completed 200 OK in 80.555042ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 97.105311ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.319409ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.910612ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 726.403µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.117809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.378314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 960.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.807708ms [martini] Started GET /api/raft-health for 10.1.1.81:32934 [martini] Completed 200 OK in 2.25871ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.010517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.213205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.03303ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.853616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 18.211577ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.046408ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.349427ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.046704ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 81.417845ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 127.655141ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19501ms [martini] Started GET /api/raft-follower-health-report/20e68087/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 667.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.575016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.102705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.35451ms [martini] Started GET /api/lb-check for 10.1.1.81:33182 [martini] Completed 200 OK in 648.402µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.929617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 887.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.126009ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.28234ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 904.904µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 72.194006ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 82.864952ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.30791ms [martini] Started GET /api/raft-health for 10.1.1.81:33198 [martini] Completed 200 OK in 908.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.886217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 883.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.70682ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.669015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.519611ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.049809ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.624719ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 974.104µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 81.763347ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 95.864406ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.686628ms [martini] Started GET /api/raft-follower-health-report/e6494ab7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 763.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.662916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.149205ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.112709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.814816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 917.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.926208ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.864916ms [martini] Started GET /api/lb-check for 10.1.1.81:33374 [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.013804ms [martini] Completed 200 OK in 1.379906ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 74.402416ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 156.823666ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.869925ms [martini] Started GET /api/raft-health for 10.1.1.81:33390 [martini] Completed 200 OK in 697.103µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.119618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.070804ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.739011ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.273614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.085705ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 78.337633ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 75.36402ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.24091ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 19.777784ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.064605ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.876513ms [martini] Started GET /api/raft-follower-health-report/a2b7eb83/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 882.303µs 2018-11-29 07:35:49 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.654616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 906.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.185609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.653115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 909.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.101709ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:33552 [martini] Completed 200 OK in 3.521815ms [martini] Completed 200 OK in 779.503µs [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 716.703µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 97.228313ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 169.178019ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.446615ms [martini] Started GET /api/raft-health for 10.1.1.81:33576 [martini] Completed 200 OK in 714.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.659815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.737908ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.994608ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.720924ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 842.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21571ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.570919ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.171705ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 87.269771ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 117.179399ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27251ms [martini] Started GET /api/raft-follower-health-report/527709c5/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.222406ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.901317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 966.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.176009ms [martini] Started GET /api/lb-check for 10.1.1.81:33704 [martini] Completed 200 OK in 616.503µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.410618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.748012ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.114409ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.421431ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.537619ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 108.918464ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 89.643481ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.026509ms [martini] Started GET /api/raft-health for 10.1.1.81:33720 [martini] Completed 200 OK in 2.939312ms 2018-11-29 07:36:03 ERROR ReadTopologyInstance(prod-ain-cluster-mysql-0.prod-ain-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.501619ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.064804ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.081413ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.452614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 817.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.074508ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.750816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.579007ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 76.242024ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 79.70474ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.853312ms [martini] Started GET /api/raft-follower-health-report/8803f3d9/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 690.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.737016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 893.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.085909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.189013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 947.405µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.047608ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.952913ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:33938 [martini] Completed 200 OK in 458.002µs [martini] Completed 200 OK in 1.505206ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 117.066799ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 119.72661ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.099714ms [martini] Started GET /api/raft-health for 10.1.1.81:33966 [martini] Completed 200 OK in 7.05393ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.405018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 943.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.023508ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.312514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 922.004µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 148.388732ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 87.419672ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.153809ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.845216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 849.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.813908ms 2018-11-29 07:36:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 07:36:19 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/95dfb0d0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 692.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.075718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.063704ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.089608ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.912217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 934.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.024808ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:34108 [martini] Completed 200 OK in 634.803µs [martini] Completed 200 OK in 3.704215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 929.804µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 112.63238ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 92.868896ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.942708ms [martini] Started GET /api/raft-health for 10.1.1.81:34126 [martini] Completed 200 OK in 2.32661ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.800716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.171505ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 79.183338ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 74.324417ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.50581ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.115313ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 900.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.952509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.165522ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 985.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.993708ms [martini] Started GET /api/raft-follower-health-report/750571c9/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 915.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.203618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 865.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.063109ms [martini] Started GET /api/lb-check for 10.1.1.81:34258 [martini] Completed 200 OK in 539.502µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.234631ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.400106ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.949008ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.101513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 772.203µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 78.660135ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 103.757842ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21341ms [martini] Started GET /api/raft-health for 10.1.1.81:34276 [martini] Completed 200 OK in 693.903µs [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.490015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.094005ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 75.051621ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 79.61114ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.38131ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.033013ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 828.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.960708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.280714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 804.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.996508ms [martini] Started GET /api/raft-follower-health-report/d95ed01d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 711.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.651815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 982.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.35801ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.326614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 921.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.40091ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:34432 [martini] Completed 200 OK in 664.203µs [martini] Completed 200 OK in 4.68412ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 813.703µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 81.290947ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 75.663523ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.239809ms [martini] Started GET /api/raft-health for 10.1.1.81:34466 [martini] Completed 200 OK in 673.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.896217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 948.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.028408ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.389514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 803.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.131809ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.633815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 827.303µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 75.826224ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 70.2624ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27901ms [martini] Started GET /api/raft-follower-health-report/cd3dd1c1/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.841308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.970717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 970.605µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.977009ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.020713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 895.504µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:34636 [martini] Completed 200 OK in 2.885613ms [martini] Completed 200 OK in 84.492061ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 87.244074ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.214131ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.028617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.292705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.711725ms [martini] Started GET /api/raft-health for 10.1.1.81:34654 [martini] Completed 200 OK in 735.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.237918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.679107ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.519611ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.115621ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 895.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.985108ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.560319ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.162304ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 103.770544ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 2018-11-29 07:36:55 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Completed 200 OK in 114.717791ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.99163ms [martini] Started GET /api/raft-follower-health-report/a6f48058/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 793.503µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.833116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 996.705µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19141ms [martini] Started GET /api/lb-check for 10.1.1.81:34814 [martini] Completed 200 OK in 581.603µs [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.504715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.340006ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 111.732878ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 88.88548ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.998809ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.498515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.124305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.636937ms [martini] Started GET /api/raft-health for 10.1.1.81:34828 [martini] Completed 200 OK in 734.704µs 2018-11-29 07:37:03 ERROR ReadTopologyInstance(prod-ain-cluster-mysql-0.prod-ain-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.708016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.087905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.084909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.520715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 971.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20941ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.214113ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 916.303µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 84.236661ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 113.770587ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.260639ms [martini] Started GET /api/raft-follower-health-report/a6a84381/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 689.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.961717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.079805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.136609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.656616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 909.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.30721ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.293414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:34994 [martini] Completed 200 OK in 779.504µs [martini] Completed 200 OK in 1.041205ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 199.303954ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 86.895772ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.464711ms [martini] Started GET /api/raft-health for 10.1.1.81:35022 [martini] Completed 200 OK in 854.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.942417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.016005ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.35551ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.041917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.078805ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.933108ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.118213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 880.604µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 113.897088ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 128.20185ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.126926ms 2018-11-29 07:37:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/f5f3c6a3/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 753.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.111218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 905.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.598011ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.551219ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.059905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:35180 [martini] Completed 200 OK in 3.074613ms [martini] Completed 200 OK in 542.502µs [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.751925ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 923.004µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 119.886814ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 112.204081ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.130818ms [martini] Started GET /api/raft-health for 10.1.1.81:35214 [martini] Completed 200 OK in 914.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.074218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 953.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.016009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.806724ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.312306ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29391ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.639615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.202505ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 80.323945ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 2018-11-29 07:37:25 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Completed 200 OK in 123.634731ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.482919ms [martini] Started GET /api/raft-follower-health-report/395fe7cd/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 849.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.664115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 830.203µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.30701ms [martini] Started GET /api/lb-check for 10.1.1.81:35374 [martini] Completed 200 OK in 1.207105ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.049417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 821.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.006609ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.597516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.045804ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 120.966419ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 78.206136ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.43381ms [martini] Started GET /api/raft-health for 10.1.1.81:35388 [martini] Completed 200 OK in 4.127618ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.954917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 858.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21121ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.402614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 802.703µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.838008ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.377715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.066705ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 70.961105ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 118.210507ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.594733ms [martini] Started GET /api/raft-follower-health-report/7c818017/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 700.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.918017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 889.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28761ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.514115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 901.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.899408ms [martini] Started GET /api/lb-check for 10.1.1.81:35572 [martini] Completed 200 OK in 594.302µs [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.382815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 890.804µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 80.332545ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 121.176221ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.750421ms [martini] Started GET /api/raft-health for 10.1.1.81:35586 [martini] Completed 200 OK in 800.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.053518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 928.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.531411ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.552815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 873.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.922008ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.193213ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 748.603µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 88.243879ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 86.316871ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.82273ms [martini] Started GET /api/raft-follower-health-report/b3f8bb8b/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 715.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.014417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 943.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.823507ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.353414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 913.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.005109ms [martini] Started GET /api/lb-check for 10.1.1.81:35758 [martini] Completed 200 OK in 514.703µs [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.210714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 915.904µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 99.765629ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 88.317579ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.234514ms [martini] Started GET /api/raft-health for 10.1.1.81:35790 [martini] Completed 200 OK in 690.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.881217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 964.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.17931ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.895621ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 862.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.884308ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.258014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.325306ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 144.883123ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 118.257309ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.423832ms [martini] Started GET /api/raft-follower-health-report/d16fd3e1/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 788.004µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.090518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.342606ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.953708ms [martini] Started GET /api/lb-check for 10.1.1.81:35942 [martini] Completed 200 OK in 546.102µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.182818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 863.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.059709ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.118513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.580907ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 76.840131ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 106.418658ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.392011ms [martini] Started GET /api/raft-health for 10.1.1.81:35968 [martini] Completed 200 OK in 4.56452ms 2018-11-29 07:38:01 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.097017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.367606ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18631ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.443215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 843.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.152409ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.287914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 857.704µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 123.584532ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 80.356946ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.710812ms [martini] Started GET /api/raft-follower-health-report/fb588162/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 743.103µs 2018-11-29 07:38:09 ERROR ReadTopologyInstance(prod-ain-cluster-mysql-0.prod-ain-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.203918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 955.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.059709ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.417215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.129405ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:36130 [martini] Completed 200 OK in 443.001µs [martini] Completed 200 OK in 76.974831ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 82.049953ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.17861ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.198814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 939.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 22.105195ms [martini] Started GET /api/raft-health for 10.1.1.81:36140 [martini] Completed 200 OK in 2.31421ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.417428ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 892.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.263019ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.305431ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.374605ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.896608ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.921617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.242105ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 106.927461ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 100.206931ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.691712ms 2018-11-29 07:38:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/a696397d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.197406ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.686016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.050304ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.928208ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.527215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 938.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:36306 [martini] Completed 200 OK in 554.902µs [martini] Completed 200 OK in 3.106114ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.237814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 868.904µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 96.771517ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 87.871978ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.175409ms [martini] Started GET /api/raft-health for 10.1.1.81:36322 [martini] Completed 200 OK in 4.514019ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.569715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.012004ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 86.435972ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 2018-11-29 07:38:25 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Completed 200 OK in 112.572886ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.568746ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.240114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.076813ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 25.44631ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 43.692189ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 879.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.866526ms [martini] Started GET /api/raft-follower-health-report/9423f99c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 664.103µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.744916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.043505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.056708ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.226314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 901.004µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:36534 [martini] Completed 200 OK in 492.502µs [martini] Completed 200 OK in 131.074865ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 85.750369ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.161109ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.982418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 856.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29621ms [martini] Started GET /api/raft-health for 10.1.1.81:36562 [martini] Completed 200 OK in 2.715512ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.201635ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 854.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.971809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.844425ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 779.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.910809ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.914321ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 999.605µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 107.144462ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 115.688399ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20211ms [martini] Started GET /api/raft-follower-health-report/7f75160f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 10.662846ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.896517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.018805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.150709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.385514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 922.904µs [martini] Started GET /api/lb-check for 10.1.1.81:36734 [martini] Completed 200 OK in 686.703µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.931009ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.234914ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 955.004µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 WARNING: NamedStopwatch.Stop("instance") IsRunning is false 2018-11-29 07:38:41 ERROR dial tcp: lookup prod-ain-cluster-mysql-0.prod-ain-cluster-mysql-nodes.defaul on 10.100.0.10:53: no such host 2018-11-29 07:38:41 ERROR ReadTopologyInstance(prod-ain-cluster-mysql-0.prod-ain-cluster-mysql-nodes.defaul:3306): dial tcp: lookup prod-ain-cluster-mysql-0.prod-ain-cluster-mysql-nodes.defaul on 10.100.0.10:53: no such host [martini] Completed 200 OK in 593.985063ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 78.915941ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.864912ms [martini] Started GET /api/raft-health for 10.1.1.81:36748 [martini] Completed 200 OK in 650.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.184618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.089204ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.264809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.414514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 914.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.051309ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.326014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.258105ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 81.547952ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 110.652078ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.269949ms [martini] Started GET /api/raft-follower-health-report/372ce26c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 829.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.719416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 917.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.590711ms [martini] Started GET /api/lb-check for 10.1.1.81:36878 [martini] Completed 200 OK in 886.703µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.322532ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 10.651346ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.932208ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.803217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.184106ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 327.428513ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 75.739327ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25651ms [martini] Started GET /api/raft-health for 10.1.1.81:36894 [martini] Completed 200 OK in 7.510433ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.657216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 918.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.120009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.028117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 981.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.496611ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.117618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 961.404µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 80.319347ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 85.207468ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.413845ms [martini] Started GET /api/raft-follower-health-report/daf1476c/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 817.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.949717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 920.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.30481ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:37018 [martini] Completed 200 OK in 3.977217ms [martini] Completed 200 OK in 729.104µs [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 828.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.15091ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.091422ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.139305ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 95.346812ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 109.886275ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.037317ms [martini] Started GET /api/raft-health for 10.1.1.81:37030 [martini] Completed 200 OK in 836.003µs 2018-11-29 07:39:01 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.031517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.043204ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.084913ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.944221ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.148605ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 105.534856ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 72.998716ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.587211ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.531316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.168905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.088309ms [martini] Started GET /api/raft-follower-health-report/1e9bb7f6/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 899.504µs 2018-11-29 07:39:09 ERROR ReadTopologyInstance(prod-ain-cluster-mysql-0.prod-ain-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.755416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.151905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.43031ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.208514ms [martini] Started GET /api/lb-check for 10.1.1.81:37156 [martini] Completed 200 OK in 620.902µs [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 785.703µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.898608ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.256414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 905.804µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 92.696101ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 88.344782ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.132627ms [martini] Started GET /api/raft-health for 10.1.1.81:37174 [martini] Completed 200 OK in 818.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.670416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.039904ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23821ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.530615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.006305ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.918408ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.137713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 856.104µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 80.365848ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 119.731918ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.066739ms 2018-11-29 07:39:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/c61bddec/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.033804ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.538216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.220805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.052208ms [martini] Started GET /api/lb-check for 10.1.1.81:37328 [martini] Completed 200 OK in 466.602µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.444032ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 977.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.577511ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.635237ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 880.504µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 110.825079ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 117.526208ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.136809ms [martini] Started GET /api/raft-health for 10.1.1.81:37360 [martini] Completed 200 OK in 684.203µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.020518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.111905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.10081ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.254014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 880.504µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 84.188464ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 151.412856ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.202709ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.676816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 956.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.547716ms 2018-11-29 07:39:26 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/af60a46e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 729.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.879717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 900.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26131ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.662016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.028504ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:37520 [martini] Completed 200 OK in 2.025209ms [martini] Completed 200 OK in 2.541011ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.344315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.123405ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 119.350117ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 78.332639ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.27181ms [martini] Started GET /api/raft-health for 10.1.1.81:37532 [martini] Completed 200 OK in 4.994022ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.030117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 930.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.532711ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.487215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.041904ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.15921ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.522015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 918.904µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 77.203634ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 94.78141ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.162923ms [martini] Started GET /api/raft-follower-health-report/c81e3173/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 760.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.952917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.041705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.009308ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.600215ms [martini] Started GET /api/lb-check for 10.1.1.81:37698 [martini] Completed 200 OK in 1.187905ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 841.403µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.945308ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.353414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 829.303µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 85.28667ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 85.666071ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.438619ms [martini] Started GET /api/raft-health for 10.1.1.81:37712 [martini] Completed 200 OK in 662.602µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.795616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.116905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.933708ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.224314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.012004ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.807208ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.394215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.039305ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 95.370813ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 82.155957ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.35201ms [martini] Started GET /api/raft-follower-health-report/051b2082/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 732.503µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.913217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.135905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.034709ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:37886 [martini] Completed 200 OK in 499.902µs [martini] Completed 200 OK in 4.356019ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 904.404µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 74.337022ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 102.920146ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.691616ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.345928ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 987.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.818216ms [martini] Started GET /api/raft-health for 10.1.1.81:37920 [martini] Completed 200 OK in 794.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.859817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 962.205µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.128309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.473924ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.134905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.35101ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.357819ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.005404ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 81.047752ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 119.025116ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.039309ms [martini] Started GET /api/raft-follower-health-report/8d170d82/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 820.704µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.439419ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 952.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.132809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.569115ms [martini] Started GET /api/lb-check for 10.1.1.81:38070 [martini] Completed 200 OK in 469.502µs [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 949.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.986509ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.519915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 988.204µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 95.331313ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 97.143721ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.23641ms [martini] Started GET /api/raft-health for 10.1.1.81:38098 [martini] Completed 200 OK in 2.31241ms 2018-11-29 07:40:01 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.940017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.161205ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.14251ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.315415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 903.804µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 83.810663ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 97.932525ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.085409ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.379515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 967.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.066609ms [martini] Started GET /api/raft-follower-health-report/78fac6e8/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 825.204µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.922817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.000304ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.117509ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:38270 [martini] Completed 200 OK in 882.603µs [martini] Completed 200 OK in 4.017218ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 935.804µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 83.245561ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 77.958939ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 33.923447ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.791621ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 851.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.257114ms [martini] Started GET /api/raft-health for 10.1.1.81:38282 [martini] Completed 200 OK in 774.904µs [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.416223ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 905.704µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 77.412936ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 79.248444ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.994508ms 2018-11-29 07:40:15 ERROR ReadTopologyInstance(prod-ain-cluster-mysql-0.prod-ain-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.283219ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.082905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.714311ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.779016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.040905ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.987508ms 2018-11-29 07:40:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/e217b31a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 894.204µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.654516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 950.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.930909ms [martini] Started GET /api/lb-check for 10.1.1.81:38460 [martini] Completed 200 OK in 707.904µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.118223ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 956.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.32441ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.511215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 975.105µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 106.830664ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 92.705703ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.027939ms [martini] Started GET /api/raft-health for 10.1.1.81:38476 [martini] Completed 200 OK in 789.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.167919ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.043804ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.054808ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.643716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.671907ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.986209ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.789316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 911.304µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 112.371589ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 76.109431ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.211809ms [martini] Started GET /api/raft-follower-health-report/0d7dd5ed/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 887.304µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.017817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.171705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.117409ms [martini] Started GET /api/lb-check for 10.1.1.81:38638 [martini] Completed 200 OK in 1.398706ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.044822ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 933.105µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.997209ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.436519ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.066505ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 74.511224ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 81.595254ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.362919ms [martini] Started GET /api/raft-health for 10.1.1.81:38668 [martini] Completed 200 OK in 792.103µs 2018-11-29 07:40:32 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.023022ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 943.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.001709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.843416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 846.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.990209ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.224414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 837.504µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 80.643151ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 140.628211ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19221ms [martini] Started GET /api/raft-follower-health-report/7a94b12e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 885.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.567315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.760207ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.763112ms [martini] Started GET /api/lb-check for 10.1.1.81:38838 [martini] Completed 200 OK in 1.470706ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.065017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 842.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.927908ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.199114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 952.304µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 80.64405ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 115.710203ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.807938ms [martini] Started GET /api/raft-health for 10.1.1.81:38854 [martini] Completed 200 OK in 806.504µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.761716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.021304ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.903308ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.266315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 803.903µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 79.850247ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 128.590259ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.785021ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.389037ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.032105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.973826ms [martini] Started GET /api/raft-follower-health-report/a228c018/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 842.904µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.927117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.033805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.145709ms [martini] Started GET /api/lb-check for 10.1.1.81:39024 [martini] Completed 200 OK in 698.603µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.740446ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 957.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.200909ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.575533ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 852.303µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 101.495342ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 113.750795ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.998213ms [martini] Started GET /api/raft-health for 10.1.1.81:39042 [martini] Completed 200 OK in 913.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.930417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.820808ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25061ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.049122ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 906.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.169109ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.444915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.041404ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 98.284928ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 96.870622ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.968817ms [martini] Started GET /api/raft-follower-health-report/c303378d/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 741.403µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.152019ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 980.305µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18761ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:39216 [martini] Completed 200 OK in 879.604µs [martini] Completed 200 OK in 3.796116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 788.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.909408ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.756421ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 888.404µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 93.852409ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 81.775556ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.546011ms [martini] Started GET /api/raft-health for 10.1.1.81:39230 [martini] Completed 200 OK in 873.303µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.679616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.173305ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.074309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.617316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 883.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.883308ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.243814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 802.203µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 114.383798ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 135.45079ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.113109ms 2018-11-29 07:41:07 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/f6f3854e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 749.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.719216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 928.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.235709ms [martini] Started GET /api/lb-check for 10.1.1.81:39400 [martini] Completed 200 OK in 509.502µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.463215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 872.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.060809ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.126713ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 826.104µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 77.163236ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 71.981613ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.30321ms [martini] Started GET /api/raft-health for 10.1.1.81:39426 [martini] Completed 200 OK in 902.604µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.760316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 879.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31811ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.843217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 891.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.720507ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.284414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 974.104µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 79.218345ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 91.8154ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 2018-11-29 07:41:15 ERROR ReadTopologyInstance(prod-ain-cluster-mysql-0.prod-ain-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Completed 200 OK in 11.952052ms 2018-11-29 07:41:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/f1b0ce79/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 823.104µs [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.583416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.064604ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:39586 [martini] Completed 200 OK in 607.802µs [martini] Completed 200 OK in 81.287355ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 106.817066ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.147409ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.050922ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.062505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.048409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.569016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.953113ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.918017ms [martini] Started GET /api/raft-health for 10.1.1.81:39602 [martini] Completed 200 OK in 786.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.621216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 845.103µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.182309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.466415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 970.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.095609ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.565425ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.310105ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 80.29855ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 107.324968ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.943052ms [martini] Started GET /api/raft-follower-health-report/60c9de95/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 743.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.562316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 883.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.124409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.591416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 983.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.971608ms [martini] Started GET /api/lb-check for 10.1.1.81:39768 [martini] Completed 200 OK in 674.303µs [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.216014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 816.204µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 77.216437ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 84.541869ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.203219ms [martini] Started GET /api/raft-health for 10.1.1.81:39780 [martini] Completed 200 OK in 750.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.610616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.251105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.17781ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.484815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.008404ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.902409ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.322315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.006504ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 78.06734ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 92.307503ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.44041ms 2018-11-29 07:41:38 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/694e1f80/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 797.003µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.147418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.002904ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:39948 [martini] Completed 200 OK in 708.403µs [martini] Completed 200 OK in 4.468219ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.132814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 755.603µs [martini] Started GET /api/discover/prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 82.029858ms [martini] Started GET /api/discover/prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default/3306 for 10.1.1.163:56044 [martini] Completed 200 OK in 90.922496ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.799816ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.648516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 927.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.709129ms [martini] Started GET /api/raft-health for 10.1.1.81:39960 [martini] Completed 200 OK in 719.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.878417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.101405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31001ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.443015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.012105ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.100209ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.367314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.065005ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.905108ms 2018-11-29 07:41:46 ERROR Error 1053: Server shutdown in progress 2018-11-29 07:41:46 ERROR ReadTopologyInstance(prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default:3306) show variables like 'maxscale%': Error 1053: Server shutdown in progress [mysql] 2018/11/29 07:41:46 packets.go:36: unexpected EOF [mysql] 2018/11/29 07:41:46 packets.go:36: unexpected EOF [mysql] 2018/11/29 07:41:46 connection.go:372: invalid connection 2018-11-29 07:41:46 ERROR invalid connection 2018-11-29 07:41:46 ERROR invalid connection [mysql] 2018/11/29 07:41:46 packets.go:36: unexpected EOF 2018-11-29 07:41:46 ERROR invalid connection 2018-11-29 07:41:46 ERROR dial tcp: lookup prod-ain-cluster-mysql-0.prod-ain-cluster-mysql-nodes.defaul on 10.100.0.10:53: no such host 2018-11-29 07:41:46 ERROR ReadTopologyInstance(prod-ain-cluster-mysql-0.prod-ain-cluster-mysql-nodes.defaul:3306): dial tcp: lookup prod-ain-cluster-mysql-0.prod-ain-cluster-mysql-nodes.defaul on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/raft-follower-health-report/39f387b7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 769.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.905517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.012204ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.233309ms [martini] Started GET /api/lb-check for 10.1.1.81:40128 [martini] Completed 200 OK in 1.648407ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.030931ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.219705ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.764825ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.899822ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 927.404µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.837908ms [martini] Started GET /api/raft-health for 10.1.1.81:40158 [martini] Completed 200 OK in 1.050705ms 2018-11-29 07:41:52 ERROR dial tcp: lookup prod-ain-cluster-mysql-0.prod-ain-cluster-mysql-nodes.defaul on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.975717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.078905ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.696612ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.602516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.341206ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.040209ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.199722ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.228305ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.053309ms [mysql] 2018/11/29 07:41:57 connection.go:372: invalid connection [mysql] 2018/11/29 07:41:57 connection.go:372: invalid connection WARNING: NamedStopwatch.Stop("instance") IsRunning is false 2018-11-29 07:41:57 ERROR dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host 2018-11-29 07:41:58 ERROR dial tcp: lookup prod-ain-cluster-mysql-0.prod-ain-cluster-mysql-nodes.defaul on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/raft-follower-health-report/8ea3b355/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 813.604µs [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.870421ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 904.104µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.055518ms [martini] Started GET /api/lb-check for 10.1.1.81:40336 [martini] Completed 200 OK in 519.502µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.534419ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 949.504µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.166209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.575015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 909.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.011509ms [martini] Started GET /api/raft-health for 10.1.1.81:40350 [martini] Completed 200 OK in 864.704µs 2018-11-29 07:42:04 ERROR dial tcp: lookup prod-ain-cluster-mysql-0.prod-ain-cluster-mysql-nodes.defaul on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.090423ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.257606ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.019109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.952417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 938.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.887508ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.243545ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.021205ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.860008ms 2018-11-29 07:42:08 ERROR dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/raft-follower-health-report/96fe71a6/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.069805ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.734816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 836.003µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:40530 [martini] Completed 200 OK in 794.003µs [martini] Completed 200 OK in 4.63232ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.673229ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.223605ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.930908ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.439819ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.817308ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.941009ms WARNING: NamedStopwatch.Stop("instance") IsRunning is false 2018-11-29 07:42:10 ERROR dial tcp: lookup prod-ain-cluster-mysql-0.prod-ain-cluster-mysql-nodes.defaul on 10.100.0.10:53: no such host [martini] Started GET /api/raft-health for 10.1.1.81:40542 [martini] Completed 200 OK in 786.703µs 2018-11-29 07:42:13 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.713316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 835.104µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.413011ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.301923ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.104904ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.719417ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.541115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 831.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.49251ms 2018-11-29 07:42:16 ERROR dial tcp: lookup prod-ain-cluster-mysql-0.prod-ain-cluster-mysql-nodes.defaul on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false 2018-11-29 07:42:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/14c64bce/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 824.704µs 2018-11-29 07:42:19 ERROR dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.023717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 919.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.899908ms [martini] Started GET /api/lb-check for 10.1.1.81:40704 [martini] Completed 200 OK in 481.502µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.705351ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.558407ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.929417ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 19.264785ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.57662ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.411611ms [martini] Started GET /api/raft-health for 10.1.1.81:40732 [martini] Completed 200 OK in 1.208305ms 2018-11-29 07:42:21 ERROR ReadTopologyInstance(prod-ain-cluster-mysql-0.prod-ain-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [mysql] 2018/11/29 07:42:22 packets.go:36: unexpected EOF 2018-11-29 07:42:22 ERROR invalid connection 2018-11-29 07:42:22 ERROR ReadTopologyInstance(prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default:3306) show variables like 'maxscale%': invalid connection [mysql] 2018/11/29 07:42:22 packets.go:36: unexpected EOF [mysql] 2018/11/29 07:42:22 packets.go:36: unexpected EOF [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.558315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.004105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.37391ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.154536ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.597007ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26031ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.334114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.022104ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.864708ms [martini] Started GET /api/raft-follower-health-report/450ed953/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 792.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.684216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.126805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:40892 [martini] Completed 200 OK in 543.302µs [martini] Completed 200 OK in 3.598615ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.290214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 862.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.886809ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.145344ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.971313ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.11341ms [martini] Started GET /api/raft-health for 10.1.1.81:40920 [martini] Completed 200 OK in 759.403µs WARNING: NamedStopwatch.Stop("instance") IsRunning is false 2018-11-29 07:42:32 ERROR dial tcp: i/o timeout [mysql] 2018/11/29 07:42:33 connection.go:372: invalid connection [mysql] 2018/11/29 07:42:33 connection.go:372: invalid connection WARNING: NamedStopwatch.Stop("instance") IsRunning is false 2018-11-29 07:42:33 ERROR dial tcp: lookup prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.609116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 931.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.11631ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.996818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 731.903µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.782008ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.307614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 849.004µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.795908ms 2018-11-29 07:42:38 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 07:42:38 ERROR dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/raft-follower-health-report/403ff4f9/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 780.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.938717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 903.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:41088 [martini] Completed 200 OK in 677.703µs [martini] Completed 200 OK in 2.17271ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.528516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 816.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.084309ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.705016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 842.804µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.793308ms [martini] Started GET /api/raft-health for 10.1.1.81:41100 [martini] Completed 200 OK in 784.903µs [mysql] 2018/11/29 07:42:44 connection.go:372: invalid connection 2018-11-29 07:42:44 ERROR dial tcp: lookup prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.289332ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.583811ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.955408ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.945117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.156805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.511911ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.558116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 939.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.067209ms [martini] Started GET /api/raft-follower-health-report/d842d679/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 813.504µs 2018-11-29 07:42:49 ERROR dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host 2018-11-29 07:42:49 ERROR ReadTopologyInstance(prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default:3306): dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.311719ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 990.004µs [martini] Started GET /api/lb-check for 10.1.1.81:41292 [martini] Completed 200 OK in 929.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.935509ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.479229ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.000804ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.957808ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 39.653774ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.804908ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.518715ms [martini] Started GET /api/raft-health for 10.1.1.81:41308 [martini] Completed 200 OK in 667.003µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.891017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 930.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.088309ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.045122ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.056504ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.510211ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.245745ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 824.103µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.947208ms 2018-11-29 07:42:55 ERROR dial tcp: lookup prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/raft-follower-health-report/707dde55/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 898.304µs [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.784117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:41482 [martini] Completed 200 OK in 1.599107ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.089905ms [martini] Completed 200 OK in 2.27011ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.531515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 768.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.992609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.575815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.916613ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.754712ms 2018-11-29 07:43:00 ERROR dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/raft-health for 10.1.1.81:41516 [martini] Completed 200 OK in 699.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.098718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.313306ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21211ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.944618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 948.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.144509ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.116513ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 888.804µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.054709ms 2018-11-29 07:43:06 ERROR dial tcp: lookup prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/raft-follower-health-report/c760fda7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 885.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:41690 [martini] Completed 200 OK in 826.904µs [martini] Completed 200 OK in 7.053831ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.161505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.043209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.472519ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 742.603µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.733812ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.812917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.105705ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.740912ms [martini] Started GET /api/raft-health for 10.1.1.81:41710 [martini] Completed 200 OK in 773.403µs 2018-11-29 07:43:11 ERROR dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.369019ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.126205ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.06051ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.994022ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.024604ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.093509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.507215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.117505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.12801ms 2018-11-29 07:43:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 07:43:17 ERROR dial tcp: lookup prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/raft-follower-health-report/d23ffc2f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 682.703µs 2018-11-29 07:43:19 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.851917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:41870 [martini] Completed 200 OK in 906.004µs [martini] Completed 200 OK in 1.592407ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.010609ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.194235ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.351106ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.064809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 22.371698ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 4.965821ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.732117ms [martini] Started GET /api/raft-health for 10.1.1.81:41900 [martini] Completed 200 OK in 745.204µs 2018-11-29 07:43:21 ERROR ReadTopologyInstance(prod-ain-cluster-mysql-0.prod-ain-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 07:43:22 ERROR dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.664938ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.923318ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.922908ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.442315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.166605ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.24981ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.832817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.107205ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.095813ms [martini] Started GET /api/raft-follower-health-report/839e15a3/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 915.404µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.719817ms [martini] Started GET /api/lb-check for 10.1.1.81:42050 [martini] Completed 200 OK in 508.103µs [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.167105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.38291ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 10.634447ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 937.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.095709ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.465115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.018605ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.176809ms WARNING: NamedStopwatch.Stop("instance") IsRunning is false 2018-11-29 07:43:30 ERROR dial tcp: i/o timeout 2018-11-29 07:43:30 ERROR ReadTopologyInstance(prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default:3306): dial tcp: i/o timeout [martini] Started GET /api/raft-health for 10.1.1.81:42078 [martini] Completed 200 OK in 759.403µs 2018-11-29 07:43:33 ERROR dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.830417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 964.105µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.065209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.583316ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 811.803µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.511716ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.311815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 887.803µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.993609ms 2018-11-29 07:43:36 ERROR dial tcp: lookup prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false 2018-11-29 07:43:38 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/a5890391/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 911.504µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:42252 [martini] Completed 200 OK in 4.278819ms [martini] Completed 200 OK in 784.203µs [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.099105ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.092709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.908717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 935.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.046909ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.313315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.053314ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.148813ms [martini] Started GET /api/raft-health for 10.1.1.81:42270 [martini] Completed 200 OK in 767.703µs 2018-11-29 07:43:44 ERROR dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.470816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 994.605µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20381ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.418615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 750.303µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.033609ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.193814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 816.204µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.007809ms 2018-11-29 07:43:47 ERROR dial tcp: lookup prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/raft-follower-health-report/3e68a71e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.221306ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.760617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:42440 [martini] Completed 200 OK in 638.802µs [martini] Completed 200 OK in 1.714007ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.25251ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 20.67699ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.319406ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.786512ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.705016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.486307ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.29311ms [martini] Started GET /api/raft-health for 10.1.1.81:42458 [martini] Completed 200 OK in 950.105µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.070718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 934.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.931108ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.760034ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 809.103µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.552915ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.61372ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 824.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.060609ms 2018-11-29 07:43:55 ERROR dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host 2018-11-29 07:43:55 ERROR ReadTopologyInstance(prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default:3306): dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false 2018-11-29 07:43:58 ERROR dial tcp: lookup prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/raft-follower-health-report/31457444/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 898.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:42626 [martini] Completed 200 OK in 10.697647ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 946.405µs [martini] Completed 200 OK in 7.304933ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.135909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.406215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.039804ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.11181ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.255714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.019304ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.121009ms [martini] Started GET /api/raft-health for 10.1.1.81:42654 [martini] Completed 200 OK in 844.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.547016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.313406ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.142209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.964518ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.026404ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.889208ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.530515ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 958.604µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.984709ms 2018-11-29 07:44:06 ERROR dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/raft-follower-health-report/da1bcda6/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 952.704µs 2018-11-29 07:44:09 ERROR dial tcp: lookup prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.082618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:42816 [martini] Completed 200 OK in 1.021405ms [martini] Completed 200 OK in 1.473207ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.982208ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.515129ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 954.104µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.28101ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.426215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 948.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.37141ms [martini] Started GET /api/raft-health for 10.1.1.81:42828 [martini] Completed 200 OK in 658.203µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.687916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.102705ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.074009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.454215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 966.605µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.512915ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.780117ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.013204ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.079609ms 2018-11-29 07:44:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 07:44:17 ERROR dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/raft-follower-health-report/1b6602b7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 828.703µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.771726ms [martini] Started GET /api/lb-check for 10.1.1.81:42994 [martini] Completed 200 OK in 1.087705ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.288906ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.41951ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.640638ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.030404ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.477524ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.84553ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 7.991536ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.378328ms 2018-11-29 07:44:20 ERROR dial tcp: lookup prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/raft-health for 10.1.1.81:43012 [martini] Completed 200 OK in 1.538407ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.42012ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 998.704µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.044809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.639125ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 894.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.045214ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.461124ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.065904ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.42211ms 2018-11-29 07:44:25 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 07:44:27 ERROR ReadTopologyInstance(prod-ain-cluster-mysql-0.prod-ain-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 07:44:28 ERROR dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/raft-follower-health-report/1ca69369/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 733.903µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:43178 [martini] Completed 200 OK in 1.245505ms [martini] Completed 200 OK in 4.346719ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 917.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.107309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.552616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 890.104µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.904108ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.579416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 890.804µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.095414ms [martini] Started GET /api/raft-health for 10.1.1.81:43190 [martini] Completed 200 OK in 620.103µs 2018-11-29 07:44:31 ERROR dial tcp: lookup prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host 2018-11-29 07:44:31 ERROR ReadTopologyInstance(prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default:3306): dial tcp: lookup prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.036217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 973.604µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.023209ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.711016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 931.604µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.058009ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.874912ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 823.803µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.980009ms [martini] Started GET /api/raft-follower-health-report/07f6d562/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 972.705µs 2018-11-29 07:44:39 ERROR dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:43364 [martini] Completed 200 OK in 4.181318ms [martini] Completed 200 OK in 973.204µs [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 930.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.11801ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.378915ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 824.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.921408ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.305814ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 782.903µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.939508ms [martini] Started GET /api/raft-health for 10.1.1.81:43392 [martini] Completed 200 OK in 697.603µs 2018-11-29 07:44:42 ERROR dial tcp: lookup prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false 2018-11-29 07:44:44 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018/11/29 07:44:45 [INFO] raft: Starting snapshot up to 439162 2018/11/29 07:44:45 [INFO] snapshot: Creating new snapshot at /var/lib/orchestrator/snapshots/9352-439162-1543477485289.tmp 2018/11/29 07:44:45 [INFO] snapshot: reaping snapshot /var/lib/orchestrator/snapshots/9352-435853-1543451888993 2018/11/29 07:44:45 [INFO] raft: Compacting logs from 428483 to 428922 2018/11/29 07:44:45 [INFO] raft: Snapshot to 439162 complete [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.699216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.042104ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.062909ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.251332ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 935.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.005309ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.585116ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 975.804µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.942709ms [martini] Started GET /api/raft-follower-health-report/0dc30d73/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 644.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:43558 [martini] Completed 200 OK in 3.724317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.778808ms [martini] Completed 200 OK in 2.898913ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.701616ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 25.626312ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.981213ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.251515ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.561015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.036104ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.975709ms 2018-11-29 07:44:50 ERROR dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/raft-health for 10.1.1.81:43578 [martini] Completed 200 OK in 757.403µs WARNING: NamedStopwatch.Stop("instance") IsRunning is false 2018-11-29 07:44:53 ERROR dial tcp: lookup prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.251118ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.021604ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18111ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.235823ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.719112ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.120909ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.492729ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 834.103µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.932108ms [martini] Started GET /api/raft-follower-health-report/692fda75/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 752.104µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:43748 [martini] Completed 200 OK in 3.697816ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.713608ms [martini] Completed 200 OK in 864.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18231ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.457716ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.138005ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.804708ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.32925ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 943.104µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.026309ms [martini] Started GET /api/raft-health for 10.1.1.81:43770 [martini] Completed 200 OK in 1.124405ms 2018-11-29 07:45:01 ERROR dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host 2018-11-29 07:45:01 ERROR ReadTopologyInstance(prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default:3306): dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false 2018-11-29 07:45:04 ERROR dial tcp: lookup prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.999017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.027504ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18241ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.866217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 805.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.973608ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.568215ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 888.204µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.593929ms [martini] Started GET /api/raft-follower-health-report/08ab4d00/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 907.804µs [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Started GET /api/lb-check for 10.1.1.81:43942 [martini] Completed 200 OK in 555.302µs [martini] Completed 200 OK in 3.905718ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 813.504µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.033009ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.216514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 892.904µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.964509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.587016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 939.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.124909ms [martini] Started GET /api/raft-health for 10.1.1.81:43958 [martini] Completed 200 OK in 735.304µs 2018-11-29 07:45:12 ERROR dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.084618ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.089404ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.032409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.505815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.266406ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.18931ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.281214ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 885.104µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.34921ms 2018-11-29 07:45:15 ERROR dial tcp: lookup prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false 2018-11-29 07:45:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/3e9965e0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 881.304µs [martini] Started GET /api/lb-check for 10.1.1.81:44118 [martini] Completed 200 OK in 1.926709ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.407724ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 937.304µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.137809ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.469138ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 889.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.855813ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.61143ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.999408ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.071509ms [martini] Started GET /api/raft-health for 10.1.1.81:44150 [martini] Completed 200 OK in 751.203µs 2018-11-29 07:45:23 ERROR dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.832417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 962.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31191ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.573238ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 985.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.030709ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.669234ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.000105ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.043909ms 2018-11-29 07:45:25 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 07:45:26 ERROR dial tcp: lookup prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false 2018-11-29 07:45:27 ERROR ReadTopologyInstance(prod-ain-cluster-mysql-0.prod-ain-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/353464c1/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 767.503µs [martini] Started GET /api/lb-check for 10.1.1.81:44324 [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.410207ms [martini] Completed 200 OK in 8.209136ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 813.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.878808ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.441516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 796.003µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.26241ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.230127ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.281506ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.601411ms [martini] Started GET /api/raft-health for 10.1.1.81:44338 [martini] Completed 200 OK in 835.404µs 2018-11-29 07:45:34 ERROR dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.133323ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.051304ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.22991ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.372542ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 815.404µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.475911ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.426815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 862.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.11631ms 2018-11-29 07:45:37 ERROR dial tcp: lookup prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host 2018-11-29 07:45:37 ERROR ReadTopologyInstance(prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default:3306): dial tcp: lookup prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/raft-follower-health-report/f07eadd3/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 678.603µs [martini] Started GET /api/lb-check for 10.1.1.81:44528 [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.249006ms [martini] Completed 200 OK in 4.451419ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.142805ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.118014ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.845817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.184514ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.37212ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.753517ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 886.203µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.980309ms [martini] Started GET /api/raft-health for 10.1.1.81:44540 [martini] Completed 200 OK in 663.803µs 2018-11-29 07:45:44 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.793017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 909.304µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.032309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.604416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 863.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.919508ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.436115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.236015ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.114614ms 2018-11-29 07:45:45 ERROR dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false 2018-11-29 07:45:48 ERROR dial tcp: lookup prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/raft-follower-health-report/e08273cc/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 851.404µs [martini] Started GET /api/lb-check for 10.1.1.81:44708 [martini] Completed 200 OK in 1.446306ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.027818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.014704ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.048709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 13.199758ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 947.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.548312ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.632016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.168605ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.917231ms [martini] Started GET /api/raft-health for 10.1.1.81:44738 [martini] Completed 200 OK in 4.961522ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.972417ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 928.904µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.086909ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.483415ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 928.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.051109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.636317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 947.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.041709ms 2018-11-29 07:45:56 ERROR dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/raft-follower-health-report/ac3c5e80/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 854.404µs 2018-11-29 07:45:59 ERROR dial tcp: lookup prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/lb-check for 10.1.1.81:44896 [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.729217ms [martini] Completed 200 OK in 5.762226ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 913.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.089809ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.816017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 867.503µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.893708ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.100522ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.153605ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.21331ms [martini] Started GET /api/raft-health for 10.1.1.81:44926 [martini] Completed 200 OK in 673.903µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.087018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.102505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.168509ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.283114ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 901.204µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.979908ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.229715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 822.903µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.024209ms 2018-11-29 07:46:07 ERROR dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host 2018-11-29 07:46:07 ERROR ReadTopologyInstance(prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default:3306): dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/raft-follower-health-report/bdce9ac0/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 661.303µs [martini] Started GET /api/lb-check for 10.1.1.81:45090 [martini] Completed 200 OK in 994.305µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.981927ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.159214ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.092009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.378714ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 924.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.06781ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.791917ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.157705ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.951909ms 2018-11-29 07:46:10 ERROR dial tcp: lookup prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/raft-health for 10.1.1.81:45104 [martini] Completed 200 OK in 833.504µs [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.905317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.112005ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.15821ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.375128ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.562411ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.37631ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.581616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 805.504µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.012209ms 2018-11-29 07:46:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none 2018-11-29 07:46:18 ERROR dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/raft-follower-health-report/63dd8d9a/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 910.004µs [martini] Started GET /api/lb-check for 10.1.1.81:45260 [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.011909ms [martini] Completed 200 OK in 4.71592ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 962.804µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.982309ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.986235ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 949.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.933127ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.651625ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 865.904µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.900908ms [martini] Started GET /api/raft-health for 10.1.1.81:45280 [martini] Completed 200 OK in 823.803µs 2018-11-29 07:46:21 ERROR dial tcp: lookup prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.652916ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 967.505µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.045609ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.181018ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.145505ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.670221ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.020931ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.068004ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.31871ms 2018-11-29 07:46:25 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 07:46:27 ERROR ReadTopologyInstance(prod-ain-cluster-mysql-0.prod-ain-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-follower-health-report/f930d522/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 883.104µs 2018-11-29 07:46:29 ERROR dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/lb-check for 10.1.1.81:45450 [martini] Completed 200 OK in 682.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.621416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.037104ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.09621ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.428615ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 939.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.800008ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.314315ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.408706ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.464911ms [martini] Started GET /api/raft-health for 10.1.1.81:45478 [martini] Completed 200 OK in 966.604µs 2018-11-29 07:46:32 ERROR dial tcp: lookup prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.927918ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 905.804µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.073509ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.504715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 946.004µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.960108ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.362815ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 839.503µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.15651ms [martini] Started GET /api/raft-follower-health-report/93b2a135/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.064505ms [martini] Started GET /api/lb-check for 10.1.1.81:45650 [martini] Completed 200 OK in 889.804µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.886317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.144405ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.19071ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.691017ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 962.805µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.386411ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.944617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 950.005µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.618111ms 2018-11-29 07:46:40 ERROR dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/raft-health for 10.1.1.81:45666 [martini] Completed 200 OK in 790.404µs 2018-11-29 07:46:43 ERROR dial tcp: lookup prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host 2018-11-29 07:46:43 ERROR ReadTopologyInstance(prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default:3306): dial tcp: lookup prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.672729ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.668007ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.177009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.357115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 895.004µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.864008ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.199414ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 793.604µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.963909ms [martini] Started GET /api/raft-follower-health-report/2ad876e7/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 1.036104ms [martini] Started GET /api/lb-check for 10.1.1.81:45832 [martini] Completed 200 OK in 807.104µs [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.63663ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.925313ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.747912ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 18.438482ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.073604ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.110309ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.445115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 938.805µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.660212ms 2018-11-29 07:46:50 ERROR ReadTopologyInstance(ain-production-cluster-mysql-0.ain-production-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/raft-health for 10.1.1.81:45850 [martini] Completed 200 OK in 808.304µs 2018-11-29 07:46:51 ERROR dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false 2018-11-29 07:46:54 ERROR dial tcp: lookup prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.711234ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.248006ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.42371ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 11.057049ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 2.544111ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 23.216303ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.870326ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.058905ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.222214ms [martini] Started GET /api/raft-follower-health-report/5d42c822/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 632.603µs [martini] Started GET /api/lb-check for 10.1.1.81:46034 [martini] Completed 200 OK in 690.003µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.423715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 795.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.880717ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.537015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.354606ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.17771ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 9.955644ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 929.804µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.10011ms [martini] Started GET /api/raft-health for 10.1.1.81:46044 [martini] Completed 200 OK in 806.703µs 2018-11-29 07:47:02 ERROR dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.044818ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 888.904µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.04821ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.682317ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.056005ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.006108ms [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.629216ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 908.204µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.364611ms 2018-11-29 07:47:05 ERROR dial tcp: lookup prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/raft-follower-health-report/ae0559ab/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 692.503µs [martini] Started GET /api/lb-check for 10.1.1.81:46216 [martini] Completed 200 OK in 708.103µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.795217ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.044204ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.137409ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.339015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 781.203µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.857508ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.384015ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 988.305µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.059709ms [martini] Started GET /api/raft-health for 10.1.1.81:46242 [martini] Completed 200 OK in 2.018309ms 2018-11-29 07:47:13 ERROR dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host 2018-11-29 07:47:13 ERROR ReadTopologyInstance(prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default:3306): dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.245919ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.466607ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.36461ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.701616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 978.304µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.996509ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.790617ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 993.404µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.936109ms 2018-11-29 07:47:16 ERROR dial tcp: lookup prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false 2018-11-29 07:47:17 ERROR FlushNontrivialResolveCacheToDatabase() called, but HostnameResolveMethod is none [martini] Started GET /api/raft-follower-health-report/68c55f8e/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 881.504µs [martini] Started GET /api/lb-check for 10.1.1.81:46418 [martini] Completed 200 OK in 656.803µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.567016ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 887.004µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.910808ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 8.97054ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.015004ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.683929ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 13.054258ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.161705ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.57292ms [martini] Started GET /api/raft-health for 10.1.1.81:46436 [martini] Completed 200 OK in 678.603µs 2018-11-29 07:47:24 ERROR dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.461833ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 885.404µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.007109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.634225ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 957.704µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.953508ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.442115ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.530607ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.871612ms 2018-11-29 07:47:25 ERROR ReadTopologyInstance(dev-cluster-mysql-1.dev-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set 2018-11-29 07:47:27 ERROR dial tcp: lookup prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/raft-follower-health-report/18c5824f/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 688.804µs [martini] Started GET /api/lb-check for 10.1.1.81:46604 [martini] Completed 200 OK in 712.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.834717ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.962709ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.212709ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.558416ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 948.105µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.070009ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.410616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 983.504µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.029409ms [martini] Started GET /api/raft-health for 10.1.1.81:46618 [martini] Completed 200 OK in 679.503µs 2018-11-29 07:47:33 ERROR ReadTopologyInstance(prod-ain-cluster-mysql-0.prod-ain-cluster-mysql-nodes.default:3306) ReplicationLagQuery: sql: no rows in result set [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.700516ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.102204ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.984109ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.239014ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 3.327715ms [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.983509ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.148314ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 951.904µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.011309ms 2018-11-29 07:47:35 ERROR dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false 2018-11-29 07:47:38 ERROR dial tcp: lookup prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host WARNING: NamedStopwatch.Stop("instance") IsRunning is false [martini] Started GET /api/raft-follower-health-report/c7c6bea5/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 778.804µs [martini] Started GET /api/lb-check for 10.1.1.81:46788 [martini] Completed 200 OK in 992.305µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.105418ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.161505ms [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.125009ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.525616ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 894.404µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 1.939508ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 6.79633ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 995.704µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.698212ms [martini] Started GET /api/raft-health for 10.1.1.81:46802 [martini] Completed 200 OK in 678.603µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.155423ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 892.104µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.20881ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.191614ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 929.805µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.075709ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.146514ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 923.804µs [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 5.509824ms WARNING: NamedStopwatch.Stop("instance") IsRunning is false 2018-11-29 07:47:46 ERROR dial tcp: lookup prod-ain-cluster-mysql-2.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host [martini] Started GET /api/raft-follower-health-report/cdb5c4a4/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless/ain-mysql-operator-orchestrator-0.ain-mysql-operator-orchestrator-headless for 10.1.1.144:34906 [martini] Completed 200 OK in 717.403µs WARNING: NamedStopwatch.Stop("instance") IsRunning is false 2018-11-29 07:47:49 ERROR dial tcp: lookup prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host 2018-11-29 07:47:49 ERROR ReadTopologyInstance(prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default:3306): dial tcp: lookup prod-ain-cluster-mysql-1.prod-ain-cluster-mysql-nodes.default on 10.100.0.10:53: no such host [martini] Started GET /api/lb-check for 10.1.1.81:46966 [martini] Completed 200 OK in 767.503µs [martini] Started GET /api/cluster/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.436715ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 819.303µs [martini] Started GET /api/audit-recovery/ain-production-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.001509ms [martini] Started GET /api/cluster/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 7.558733ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 966.204µs [martini] Started GET /api/audit-recovery/dev-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 4.976322ms [martini] Started GET /api/cluster/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 3.972817ms [martini] Started GET /api/maintenance for 10.1.1.163:56044 [martini] Completed 200 OK in 1.216206ms [martini] Started GET /api/audit-recovery/prod-ain-cluster.default for 10.1.1.163:56044 [martini] Completed 200 OK in 2.040709ms [martini] Started GET /api/raft-health for 10.1.1.81:47000 [martini] Completed 200 OK in 701.303µs