[0.9.2] panic: runtime error: invalid memory address or nil pointer dereference after start

[vovencij]

After getting timeouts and 500 errors on writes (no continuous queries) and restarting influxd 0.9.2 on Ubuntu 14.04.2 LTS (GNU/Linux 3.13.0-61-generic x86_64) it panicked and crashed. After next restart is started working again. Following is the log with the last events before restart and the crash log itself:

[retention] 2015/08/10 06:31:03 retention policy shard deletion check commencing
[retention] 2015/08/10 06:31:03 retention policy enforcement check commencing
[metastore] 2015/08/10 06:31:31 new shard group 4630 successfully created for database abc, retention policy default
[retention] 2015/08/10 06:41:03 retention policy shard deletion check commencing
[retention] 2015/08/10 06:41:03 retention policy enforcement check commencing
[metastore] 2015/08/10 06:41:33 new shard group 4631 successfully created for database abc, retention policy default
[run] 2015/08/10 06:41:53 signal received, initializing clean shutdown...
[run] 2015/08/10 06:41:53 waiting for clean shutdown...
[tcp] 2015/08/10 06:41:53 cluster service accept error: network connection closed
[snapshot] 2015/08/10 06:41:53 snapshot listener closed
[metastore] 2015/08/10 06:41:55 [INFO] raft: Node at 127.0.0.1:8088 [Follower] entering Follower state
[metastore] 2015/08/10 06:41:55 read local node id: 1
[metastore] 2015/08/10 06:41:56 [WARN] raft: Heartbeat timeout reached, starting election
[metastore] 2015/08/10 06:41:56 [INFO] raft: Node at 127.0.0.1:8088 [Candidate] entering Candidate state
[metastore] 2015/08/10 06:41:56 [DEBUG] raft: Votes needed: 1
[metastore] 2015/08/10 06:41:56 [DEBUG] raft: Vote granted. Tally: 1
[metastore] 2015/08/10 06:41:56 [INFO] raft: Election won. Tally: 1
[metastore] 2015/08/10 06:41:56 [INFO] raft: Node at 127.0.0.1:8088 [Leader] entering Leader state
[metastore] 2015/08/10 06:41:56 [INFO] raft: Disabling EnableSingleNode (bootstrap)
[metastore] 2015/08/10 06:41:56 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:41:56 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:41:56 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:41:56 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:41:56 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:41:57 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:41:57 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:41:57 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:41:57 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:41:57 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:41:57 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:41:58 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:41:58 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:41:58 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:41:58 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:41:58 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:41:58 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:41:58 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:41:58 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:41:58 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[run] 2015/08/10 06:42:23 time limit reached, initializing hard shutdown
[shard] 2015/08/10 06:42:24 flush 14905 points in 0.159s
[shard] 2015/08/10 06:42:24 flush 10635 points in 0.162s
[shard] 2015/08/10 06:42:25 flush 12768 points in 0.189s
[shard] 2015/08/10 06:42:25 flush 11075 points in 0.168s
[shard] 2015/08/10 06:42:25 flush 10987 points in 0.186s
[shard] 2015/08/10 06:42:25 flush 8926 points in 0.186s
[shard] 2015/08/10 06:42:25 flush 12935 points in 0.190s
[shard] 2015/08/10 06:42:26 flush 10717 points in 0.187s
[admin] 2015/08/10 06:42:26 listening on HTTP: [::]:8083
[httpd] 2015/08/10 06:42:26 authentication enabled: true
[httpd] 2015/08/10 06:42:26 listening on HTTP: [::]:8086
2015/08/10 06:42:26 InfluxDB starting, version 0.9.2, commit 6c0a91f775f9fc0e625d17ffa04a3fe86945ba09
2015/08/10 06:42:26 GOMAXPROCS set to 2
[run] 2015/08/10 06:42:26 listening for signals
panic: runtime error: invalid memory address or nil pointer dereference
[signal 0xb code=0x1 addr=0x0 pc=0x70e5f8]

goroutine 99 [running]:
github.com/boltdb/bolt.(*DB).beginTx(0x0, 0x0, 0x0, 0x0)
    /root/go/src/github.com/boltdb/bolt/db.go:422 +0x358
github.com/boltdb/bolt.(*DB).Begin(0x0, 0x410a00, 0x3000000000000d0, 0x0, 0x0)
    /root/go/src/github.com/boltdb/bolt/db.go:415 +0x6d
github.com/influxdb/influxdb/tsdb.(*RawMapper).Open(0xc209ce1760, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/tsdb/mapper.go:73 +0x5a
github.com/influxdb/influxdb/tsdb.(*RawExecutor).execute(0xc20a67a210, 0xc20a01a7e0)
    /root/go/src/github.com/influxdb/influxdb/tsdb/engine.go:103 +0xd4
created by github.com/influxdb/influxdb/tsdb.(*RawExecutor).Execute
    /root/go/src/github.com/influxdb/influxdb/tsdb/engine.go:93 +0x5a

goroutine 1 [chan receive]:
main.(*Main).Run(0xc20808fa80, 0xc20800a010, 0x4, 0x4, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/cmd/influxd/main.go:86 +0x73b
main.main()
    /root/go/src/github.com/influxdb/influxdb/cmd/influxd/main.go:38 +0xdc

goroutine 6 [syscall]:
os/signal.loop()
    /root/.gvm/gos/go1.4.2/src/os/signal/signal_unix.go:21 +0x1f
created by os/signal.init·1
    /root/.gvm/gos/go1.4.2/src/os/signal/signal_unix.go:27 +0x35

goroutine 17 [syscall, locked to thread]:
runtime.goexit()
    /root/.gvm/gos/go1.4.2/src/runtime/asm_amd64.s:2232 +0x1

goroutine 8 [IO wait]:
net.(*pollDesc).Wait(0xc208010370, 0x72, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc208010370, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).accept(0xc208010310, 0x0, 0x7fdca916ccc8, 0xc2080de000)
    /root/.gvm/gos/go1.4.2/src/net/fd_unix.go:419 +0x40b
net.(*TCPListener).AcceptTCP(0xc208038c40, 0x0, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/tcpsock_posix.go:234 +0x4e
net.(*TCPListener).Accept(0xc208038c40, 0x0, 0x0, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/tcpsock_posix.go:244 +0x4c
github.com/influxdb/influxdb/tcp.(*Mux).Serve(0xc2080c1920, 0x7fdca916f220, 0xc208038c40, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/tcp/mux.go:45 +0x57
created by github.com/influxdb/influxdb/cmd/influxd/run.func·003
    /root/go/src/github.com/influxdb/influxdb/cmd/influxd/run/server.go:298 +0x7a8

goroutine 9 [chan receive]:
github.com/influxdb/influxdb/tcp.(*listener).Accept(0xc208038c48, 0x0, 0x0, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/tcp/mux.go:117 +0x80
github.com/influxdb/influxdb/meta.(*raftLayer).Accept(0xc2080c1950, 0x0, 0x0, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/meta/store.go:1855 +0x64
github.com/hashicorp/raft.(*NetworkTransport).listen(0xc2080103f0)
    /root/go/src/github.com/hashicorp/raft/net_transport.go:346 +0x50
created by github.com/hashicorp/raft.NewNetworkTransport
    /root/go/src/github.com/hashicorp/raft/net_transport.go:138 +0x2c4

goroutine 10 [select]:
github.com/hashicorp/raft.(*Raft).leaderLoop(0xc2080be1c0)
    /root/go/src/github.com/hashicorp/raft/raft.go:807 +0xc7c
github.com/hashicorp/raft.(*Raft).runLeader(0xc2080be1c0)
    /root/go/src/github.com/hashicorp/raft/raft.go:779 +0x74e
github.com/hashicorp/raft.(*Raft).run(0xc2080be1c0)
    /root/go/src/github.com/hashicorp/raft/raft.go:576 +0xc9
github.com/hashicorp/raft.*Raft.(github.com/hashicorp/raft.run)·fm()
    /root/go/src/github.com/hashicorp/raft/raft.go:241 +0x27
github.com/hashicorp/raft.func·011()
    /root/go/src/github.com/hashicorp/raft/state.go:152 +0x51
created by github.com/hashicorp/raft.(*raftState).goFunc
    /root/go/src/github.com/hashicorp/raft/state.go:153 +0xe3

goroutine 11 [select]:
github.com/hashicorp/raft.(*Raft).runFSM(0xc2080be1c0)
    /root/go/src/github.com/hashicorp/raft/raft.go:490 +0xf74
github.com/hashicorp/raft.*Raft.(github.com/hashicorp/raft.runFSM)·fm()
    /root/go/src/github.com/hashicorp/raft/raft.go:242 +0x27
github.com/hashicorp/raft.func·011()
    /root/go/src/github.com/hashicorp/raft/state.go:152 +0x51
created by github.com/hashicorp/raft.(*raftState).goFunc
    /root/go/src/github.com/hashicorp/raft/state.go:153 +0xe3

goroutine 12 [select]:
github.com/hashicorp/raft.(*Raft).runSnapshots(0xc2080be1c0)
    /root/go/src/github.com/hashicorp/raft/raft.go:1594 +0x466
github.com/hashicorp/raft.*Raft.(github.com/hashicorp/raft.runSnapshots)·fm()
    /root/go/src/github.com/hashicorp/raft/raft.go:243 +0x27
github.com/hashicorp/raft.func·011()
    /root/go/src/github.com/hashicorp/raft/state.go:152 +0x51
created by github.com/hashicorp/raft.(*raftState).goFunc
    /root/go/src/github.com/hashicorp/raft/state.go:153 +0xe3

goroutine 13 [chan receive]:
github.com/influxdb/influxdb/tcp.(*listener).Accept(0xc208038c50, 0x0, 0x0, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/tcp/mux.go:117 +0x80
github.com/influxdb/influxdb/meta.(*Store).serveExecListener(0xc20802c000)
    /root/go/src/github.com/influxdb/influxdb/meta/store.go:470 +0x8f
created by github.com/influxdb/influxdb/meta.(*Store).Open
    /root/go/src/github.com/influxdb/influxdb/meta/store.go:205 +0x1c2

goroutine 14 [select]:
github.com/influxdb/influxdb/cmd/influxd/run.(*Server).monitorErrorChan(0xc2080aa0e0, 0xc20800c2a0)
    /root/go/src/github.com/influxdb/influxdb/cmd/influxd/run/server.go:421 +0x14a
created by github.com/influxdb/influxdb/cmd/influxd/run.func·003
    /root/go/src/github.com/influxdb/influxdb/cmd/influxd/run/server.go:304 +0x919

goroutine 15 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc20805c9a0, 0xc2080ed1a0)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 16 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc2080ce9a0, 0xc2080edce0)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 34 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc2080ceb00, 0xc2082eec00)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 35 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc2080cec60, 0xc2082ef680)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 36 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc2080cedc0, 0xc2083de2a0)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 37 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc2080cef20, 0xc2083df980)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 38 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc2080cf080, 0xc20832b500)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 39 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc2080ce8f0, 0xc2083decc0)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 40 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc2080cebb0, 0xc208329080)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 41 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc2080cee70, 0xc2083e6780)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 42 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc2080cea50, 0xc2083de7e0)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 43 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc2080cefd0, 0xc20832a780)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 44 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc2080cf1e0, 0xc20832b740)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 45 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc2080cf340, 0xc20832be00)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 46 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc2080cf4a0, 0xc208329200)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 47 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc2080cf600, 0xc2081f2300)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 48 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc2080ced10, 0xc2081ceb40)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 49 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc2080cf290, 0xc2082eef60)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 50 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc2080cf550, 0xc2080ed680)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 51 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc2080cf130, 0xc2080d3920)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 52 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc2080cf3f0, 0xc2080d3da0)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 53 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc2080cf6b0, 0xc2082e3f20)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 54 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc2080cf760, 0xc2081c0cc0)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 55 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc2080cf8c0, 0xc208444ae0)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 56 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc2080cf810, 0xc2085ae780)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 57 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc2080cf970, 0xc2082a08a0)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 58 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc2080cfad0, 0xc208445920)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 59 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc2080cfa20, 0xc2082ef7a0)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 60 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc2080cfc30, 0xc208170d80)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 61 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc2080cfd90, 0xc2082a0f00)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 62 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc2080cfb80, 0xc2083402a0)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 63 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc20805cdc0, 0xc208317aa0)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 64 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc20805dd90, 0xc208395f80)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 65 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc20805ca50, 0xc20824fc80)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 66 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc20805cb00, 0xc20844e420)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 67 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc20805cbb0, 0xc2085ab560)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 68 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc20805cd10, 0xc2085ab800)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 69 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc20805ce70, 0xc208661800)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 70 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc20805cc60, 0xc208c4b260)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 71 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc20805cf20, 0xc208280960)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 72 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc20805cfd0, 0xc208652c60)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 73 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc20805d130, 0xc2086fa960)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 74 [select]:
github.com/influxdb/influxdb/tsdb.(*Shard).autoflusher(0xc20805d290, 0xc208266d20)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:468 +0x39d
created by github.com/influxdb/influxdb/tsdb.func·010
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:149 +0x611

goroutine 19 [select]:
github.com/influxdb/influxdb/services/hh.(*Service).retryWrites(0xc208037360)
    /root/go/src/github.com/influxdb/influxdb/services/hh/service.go:98 +0x2e7
created by github.com/influxdb/influxdb/services/hh.(*Service).Open
    /root/go/src/github.com/influxdb/influxdb/services/hh/service.go:62 +0xef

goroutine 20 [select]:
github.com/influxdb/influxdb/services/hh.(*Service).expireWrites(0xc208037360)
    /root/go/src/github.com/influxdb/influxdb/services/hh/service.go:116 +0x2a4
created by github.com/influxdb/influxdb/services/hh.(*Service).Open
    /root/go/src/github.com/influxdb/influxdb/services/hh/service.go:63 +0x109

goroutine 21 [chan receive]:
github.com/influxdb/influxdb/tcp.(*listener).Accept(0xc208038c58, 0x0, 0x0, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/tcp/mux.go:117 +0x80
github.com/influxdb/influxdb/cluster.(*Service).serve(0xc208010230)
    /root/go/src/github.com/influxdb/influxdb/cluster/service.go:79 +0x102
created by github.com/influxdb/influxdb/cluster.(*Service).Open
    /root/go/src/github.com/influxdb/influxdb/cluster/service.go:56 +0x67

goroutine 22 [select]:
github.com/influxdb/influxdb/services/precreator.(*Service).runPrecreation(0xc20800adc0)
    /root/go/src/github.com/influxdb/influxdb/services/precreator/service.go:72 +0x407
created by github.com/influxdb/influxdb/services/precreator.(*Service).Open
    /root/go/src/github.com/influxdb/influxdb/services/precreator/service.go:50 +0xcb

goroutine 23 [chan receive]:
github.com/influxdb/influxdb/tcp.(*listener).Accept(0xc208038c60, 0x0, 0x0, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/tcp/mux.go:117 +0x80
github.com/influxdb/influxdb/services/snapshotter.(*Service).serve(0xc20800aeb0)
    /root/go/src/github.com/influxdb/influxdb/services/snapshotter/service.go:68 +0xad
created by github.com/influxdb/influxdb/services/snapshotter.(*Service).Open
    /root/go/src/github.com/influxdb/influxdb/services/snapshotter/service.go:46 +0x62

goroutine 24 [IO wait]:
net.(*pollDesc).Wait(0xc209fb0060, 0x72, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc209fb0060, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).accept(0xc209fb0000, 0x0, 0x7fdca916ccc8, 0xc209202298)
    /root/.gvm/gos/go1.4.2/src/net/fd_unix.go:419 +0x40b
net.(*TCPListener).AcceptTCP(0xc209c2e008, 0xc2080f2380, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/tcpsock_posix.go:234 +0x4e
net.(*TCPListener).Accept(0xc209c2e008, 0x0, 0x0, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/tcpsock_posix.go:244 +0x4c
net/http.(*Server).Serve(0xc209c2d4a0, 0x7fdca916f220, 0xc209c2e008, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1728 +0x92
net/http.Serve(0x7fdca916f220, 0xc209c2e008, 0x7fdca407d238, 0xc2092023c0, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1606 +0xa1
github.com/influxdb/influxdb/services/admin.(*Service).serve(0xc20800af50)
    /root/go/src/github.com/influxdb/influxdb/services/admin/service.go:105 +0x147
created by github.com/influxdb/influxdb/services/admin.(*Service).Open
    /root/go/src/github.com/influxdb/influxdb/services/admin/service.go:68 +0x431

goroutine 25 [select]:
github.com/influxdb/influxdb/services/continuous_querier.(*Service).backgroundLoop(0xc2080102a0)
    /root/go/src/github.com/influxdb/influxdb/services/continuous_querier/service.go:151 +0x301
created by github.com/influxdb/influxdb/services/continuous_querier.(*Service).Open
    /root/go/src/github.com/influxdb/influxdb/services/continuous_querier/service.go:87 +0x1ed

goroutine 26 [runnable]:
net.(*pollDesc).Wait(0xc209fb00d0, 0x72, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc209fb00d0, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).accept(0xc209fb0070, 0x0, 0x7fdca916ccc8, 0xc2091ee318)
    /root/.gvm/gos/go1.4.2/src/net/fd_unix.go:419 +0x40b
net.(*TCPListener).AcceptTCP(0xc209c2e010, 0xc2080dddc8, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/tcpsock_posix.go:234 +0x4e
net.(*TCPListener).Accept(0xc209c2e010, 0x0, 0x0, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/tcpsock_posix.go:244 +0x4c
net/http.(*Server).Serve(0xc209c2d560, 0x7fdca916f220, 0xc209c2e010, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1728 +0x92
net/http.Serve(0x7fdca916f220, 0xc209c2e010, 0x7fdca407d260, 0xc2080ac980, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1606 +0xa1
github.com/influxdb/influxdb/services/httpd.(*Service).serve(0xc20800b090)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/service.go:107 +0x79
created by github.com/influxdb/influxdb/services/httpd.(*Service).Open
    /root/go/src/github.com/influxdb/influxdb/services/httpd/service.go:75 +0x590

goroutine 27 [select]:
github.com/influxdb/influxdb/services/retention.(*Service).deleteShardGroups(0xc20800c9c0)
    /root/go/src/github.com/influxdb/influxdb/services/retention/service.go:67 +0x433
created by github.com/influxdb/influxdb/services/retention.(*Service).Open
    /root/go/src/github.com/influxdb/influxdb/services/retention/service.go:44 +0x67

goroutine 28 [select]:
github.com/influxdb/influxdb/services/retention.(*Service).deleteShards(0xc20800c9c0)
    /root/go/src/github.com/influxdb/influxdb/services/retention/service.go:101 +0x821
created by github.com/influxdb/influxdb/services/retention.(*Service).Open
    /root/go/src/github.com/influxdb/influxdb/services/retention/service.go:45 +0x81

goroutine 29 [select]:
github.com/influxdb/influxdb/cmd/influxd/run.(*Command).monitorServerErrors(0xc208011b90)
    /root/go/src/github.com/influxdb/influxdb/cmd/influxd/run/command.go:125 +0x2da
created by github.com/influxdb/influxdb/cmd/influxd/run.(*Command).Run
    /root/go/src/github.com/influxdb/influxdb/cmd/influxd/run/command.go:107 +0xbb4

goroutine 75 [select]:
github.com/influxdb/influxdb/cluster.(*PointsWriter).WritePoints(0xc2080101c0, 0xc2089d0a40, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/cluster/points_writer.go:210 +0x634
github.com/influxdb/influxdb/services/httpd.(*Handler).serveWriteLine(0xc2080ac980, 0x7fdca407d518, 0xc209bb2780, 0xc20920c1a0, 0xc20a066000, 0x92e, 0xe00, 0xc208112120)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:568 +0xdb9
github.com/influxdb/influxdb/services/httpd.(*Handler).serveWrite(0xc2080ac980, 0x7fdca407d518, 0xc209bb2780, 0xc20920c1a0, 0xc208112120)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:418 +0x69d
github.com/influxdb/influxdb/services/httpd.*Handler.(github.com/influxdb/influxdb/services/httpd.serveWrite)·fm(0x7fdca407d518, 0xc209bb2780, 0xc20920c1a0, 0xc208112120)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:107 +0x4f
github.com/influxdb/influxdb/services/httpd.func·001(0x7fdca407d518, 0xc209bb2780, 0xc20920c1a0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:726 +0x395
net/http.HandlerFunc.ServeHTTP(0xc208057b20, 0x7fdca407d518, 0xc209bb2780, 0xc20920c1a0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·002(0x7fdca407d440, 0xc209bb2720, 0xc20920c1a0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:754 +0x288
net/http.HandlerFunc.ServeHTTP(0xc20805a660, 0x7fdca407d440, 0xc209bb2720, 0xc20920c1a0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·003(0x7fdca407d440, 0xc209bb2720, 0xc20920c1a0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:763 +0xba
net/http.HandlerFunc.ServeHTTP(0xc208057b40, 0x7fdca407d440, 0xc209bb2720, 0xc20920c1a0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·004(0x7fdca407d440, 0xc209bb2720, 0xc20920c1a0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:796 +0x31a
net/http.HandlerFunc.ServeHTTP(0xc20805a690, 0x7fdca407d440, 0xc209bb2720, 0xc20920c1a0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·005(0x7fdca407d440, 0xc209bb2720, 0xc20920c1a0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:806 +0x179
net/http.HandlerFunc.ServeHTTP(0xc20805a6b0, 0x7fdca407d440, 0xc209bb2720, 0xc20920c1a0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·006(0x7fdca407d440, 0xc209bb2700, 0xc20920c1a0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:814 +0x123
net/http.HandlerFunc.ServeHTTP(0xc208057b60, 0x7fdca407d440, 0xc209bb2700, 0xc20920c1a0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·007(0x7fdca407d408, 0xc2091a6000, 0xc20920c1a0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:824 +0x12c
net/http.HandlerFunc.ServeHTTP(0xc208057b80, 0x7fdca407d408, 0xc2091a6000, 0xc20920c1a0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/bmizerany/pat.(*PatternServeMux).ServeHTTP(0xc208038b48, 0x7fdca407d408, 0xc2091a6000, 0xc20920c1a0)
    /root/go/src/github.com/bmizerany/pat/mux.go:109 +0x21c
github.com/influxdb/influxdb/services/httpd.(*Handler).ServeHTTP(0xc2080ac980, 0x7fdca407d408, 0xc2091a6000, 0xc20920c1a0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:175 +0x256
net/http.serverHandler.ServeHTTP(0xc209c2d560, 0x7fdca407d408, 0xc2091a6000, 0xc20920c1a0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1703 +0x19a
net/http.(*conn).serve(0xc2091614a0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1204 +0xb57
created by net/http.(*Server).Serve
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1751 +0x35e

goroutine 76 [semacquire]:
sync.(*Mutex).Lock(0xc20802c000)
    /root/.gvm/gos/go1.4.2/src/sync/mutex.go:66 +0xd3
sync.(*RWMutex).Lock(0xc20802c000)
    /root/.gvm/gos/go1.4.2/src/sync/rwmutex.go:82 +0x33
github.com/influxdb/influxdb/meta.func·022(0xc20811c280, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/meta/store.go:1020 +0x78
github.com/influxdb/influxdb/meta.(*Store).read(0xc20802c000, 0xc208f89400, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/meta/store.go:1240 +0x7d
github.com/influxdb/influxdb/meta.(*Store).Authenticate(0xc20802c000, 0xc20a2f350e, 0x6, 0xc20a2f3517, 0xf, 0x0, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/meta/store.go:1059 +0xa5
github.com/influxdb/influxdb/services/httpd.func·001(0x7fdca407d518, 0xc2086006c0, 0xc2091f84e0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:720 +0x2d6
net/http.HandlerFunc.ServeHTTP(0xc208057b20, 0x7fdca407d518, 0xc2086006c0, 0xc2091f84e0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·002(0x7fdca407d440, 0xc208600640, 0xc2091f84e0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:754 +0x288
net/http.HandlerFunc.ServeHTTP(0xc20805a660, 0x7fdca407d440, 0xc208600640, 0xc2091f84e0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·003(0x7fdca407d440, 0xc208600640, 0xc2091f84e0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:763 +0xba
net/http.HandlerFunc.ServeHTTP(0xc208057b40, 0x7fdca407d440, 0xc208600640, 0xc2091f84e0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·004(0x7fdca407d440, 0xc208600640, 0xc2091f84e0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:796 +0x31a
net/http.HandlerFunc.ServeHTTP(0xc20805a690, 0x7fdca407d440, 0xc208600640, 0xc2091f84e0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·005(0x7fdca407d440, 0xc208600640, 0xc2091f84e0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:806 +0x179
net/http.HandlerFunc.ServeHTTP(0xc20805a6b0, 0x7fdca407d440, 0xc208600640, 0xc2091f84e0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·006(0x7fdca407d440, 0xc208600600, 0xc2091f84e0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:814 +0x123
net/http.HandlerFunc.ServeHTTP(0xc208057b60, 0x7fdca407d440, 0xc208600600, 0xc2091f84e0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·007(0x7fdca407d408, 0xc209161720, 0xc2091f84e0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:824 +0x12c
net/http.HandlerFunc.ServeHTTP(0xc208057b80, 0x7fdca407d408, 0xc209161720, 0xc2091f84e0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/bmizerany/pat.(*PatternServeMux).ServeHTTP(0xc208038b48, 0x7fdca407d408, 0xc209161720, 0xc2091f84e0)
    /root/go/src/github.com/bmizerany/pat/mux.go:109 +0x21c
github.com/influxdb/influxdb/services/httpd.(*Handler).ServeHTTP(0xc2080ac980, 0x7fdca407d408, 0xc209161720, 0xc2091f84e0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:175 +0x256
net/http.serverHandler.ServeHTTP(0xc209c2d560, 0x7fdca407d408, 0xc209161720, 0xc2091f84e0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1703 +0x19a
net/http.(*conn).serve(0xc209161680)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1204 +0xb57
created by net/http.(*Server).Serve
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1751 +0x35e

goroutine 77 [semacquire]:
sync.(*Mutex).Lock(0xc20802c000)
    /root/.gvm/gos/go1.4.2/src/sync/mutex.go:66 +0xd3
sync.(*RWMutex).Lock(0xc20802c000)
    /root/.gvm/gos/go1.4.2/src/sync/rwmutex.go:82 +0x33
github.com/influxdb/influxdb/meta.func·022(0xc20811c280, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/meta/store.go:1020 +0x78
github.com/influxdb/influxdb/meta.(*Store).read(0xc20802c000, 0xc2094f9400, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/meta/store.go:1240 +0x7d
github.com/influxdb/influxdb/meta.(*Store).Authenticate(0xc20802c000, 0xc20a1901ed, 0x6, 0xc20a1901f6, 0xf, 0x0, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/meta/store.go:1059 +0xa5
github.com/influxdb/influxdb/services/httpd.func·001(0x7fdca407d518, 0xc2086007e0, 0xc2091f85b0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:720 +0x2d6
net/http.HandlerFunc.ServeHTTP(0xc208057980, 0x7fdca407d518, 0xc2086007e0, 0xc2091f85b0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·002(0x7fdca407d440, 0xc208600740, 0xc2091f85b0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:754 +0x288
net/http.HandlerFunc.ServeHTTP(0xc20805a4a0, 0x7fdca407d440, 0xc208600740, 0xc2091f85b0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·003(0x7fdca407d440, 0xc208600740, 0xc2091f85b0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:763 +0xba
net/http.HandlerFunc.ServeHTTP(0xc2080579a0, 0x7fdca407d440, 0xc208600740, 0xc2091f85b0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·004(0x7fdca407d440, 0xc208600740, 0xc2091f85b0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:796 +0x31a
net/http.HandlerFunc.ServeHTTP(0xc20805a4d0, 0x7fdca407d440, 0xc208600740, 0xc2091f85b0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·005(0x7fdca407d440, 0xc208600740, 0xc2091f85b0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:806 +0x179
net/http.HandlerFunc.ServeHTTP(0xc20805a4f0, 0x7fdca407d440, 0xc208600740, 0xc2091f85b0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·006(0x7fdca407d440, 0xc208600720, 0xc2091f85b0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:814 +0x123
net/http.HandlerFunc.ServeHTTP(0xc2080579c0, 0x7fdca407d440, 0xc208600720, 0xc2091f85b0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·007(0x7fdca407d408, 0xc2091619a0, 0xc2091f85b0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:824 +0x12c
net/http.HandlerFunc.ServeHTTP(0xc2080579e0, 0x7fdca407d408, 0xc2091619a0, 0xc2091f85b0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/bmizerany/pat.(*PatternServeMux).ServeHTTP(0xc208038b48, 0x7fdca407d408, 0xc2091619a0, 0xc2091f85b0)
    /root/go/src/github.com/bmizerany/pat/mux.go:109 +0x21c
github.com/influxdb/influxdb/services/httpd.(*Handler).ServeHTTP(0xc2080ac980, 0x7fdca407d408, 0xc2091619a0, 0xc2091f85b0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:175 +0x256
net/http.serverHandler.ServeHTTP(0xc209c2d560, 0x7fdca407d408, 0xc2091619a0, 0xc2091f85b0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1703 +0x19a
net/http.(*conn).serve(0xc209161900)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1204 +0xb57
created by net/http.(*Server).Serve
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1751 +0x35e

goroutine 78 [semacquire]:
sync.(*Mutex).Lock(0xc20802c000)
    /root/.gvm/gos/go1.4.2/src/sync/mutex.go:66 +0xd3
sync.(*RWMutex).Lock(0xc20802c000)
    /root/.gvm/gos/go1.4.2/src/sync/rwmutex.go:82 +0x33
github.com/influxdb/influxdb/meta.func·022(0xc20811c280, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/meta/store.go:1020 +0x78
github.com/influxdb/influxdb/meta.(*Store).read(0xc20802c000, 0xc2094fb400, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/meta/store.go:1240 +0x7d
github.com/influxdb/influxdb/meta.(*Store).Authenticate(0xc20802c000, 0xc20a1902dd, 0x6, 0xc20a1902e6, 0xf, 0x0, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/meta/store.go:1059 +0xa5
github.com/influxdb/influxdb/services/httpd.func·001(0x7fdca407d518, 0xc208600900, 0xc2091f8680)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:720 +0x2d6
net/http.HandlerFunc.ServeHTTP(0xc208057980, 0x7fdca407d518, 0xc208600900, 0xc2091f8680)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·002(0x7fdca407d440, 0xc208600880, 0xc2091f8680)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:754 +0x288
net/http.HandlerFunc.ServeHTTP(0xc20805a4a0, 0x7fdca407d440, 0xc208600880, 0xc2091f8680)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·003(0x7fdca407d440, 0xc208600880, 0xc2091f8680)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:763 +0xba
net/http.HandlerFunc.ServeHTTP(0xc2080579a0, 0x7fdca407d440, 0xc208600880, 0xc2091f8680)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·004(0x7fdca407d440, 0xc208600880, 0xc2091f8680)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:796 +0x31a
net/http.HandlerFunc.ServeHTTP(0xc20805a4d0, 0x7fdca407d440, 0xc208600880, 0xc2091f8680)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·005(0x7fdca407d440, 0xc208600880, 0xc2091f8680)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:806 +0x179
net/http.HandlerFunc.ServeHTTP(0xc20805a4f0, 0x7fdca407d440, 0xc208600880, 0xc2091f8680)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·006(0x7fdca407d440, 0xc208600840, 0xc2091f8680)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:814 +0x123
net/http.HandlerFunc.ServeHTTP(0xc2080579c0, 0x7fdca407d440, 0xc208600840, 0xc2091f8680)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·007(0x7fdca407d408, 0xc209161c20, 0xc2091f8680)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:824 +0x12c
net/http.HandlerFunc.ServeHTTP(0xc2080579e0, 0x7fdca407d408, 0xc209161c20, 0xc2091f8680)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/bmizerany/pat.(*PatternServeMux).ServeHTTP(0xc208038b48, 0x7fdca407d408, 0xc209161c20, 0xc2091f8680)
    /root/go/src/github.com/bmizerany/pat/mux.go:109 +0x21c
github.com/influxdb/influxdb/services/httpd.(*Handler).ServeHTTP(0xc2080ac980, 0x7fdca407d408, 0xc209161c20, 0xc2091f8680)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:175 +0x256
net/http.serverHandler.ServeHTTP(0xc209c2d560, 0x7fdca407d408, 0xc209161c20, 0xc2091f8680)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1703 +0x19a
net/http.(*conn).serve(0xc209161b80)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1204 +0xb57
created by net/http.(*Server).Serve
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1751 +0x35e

goroutine 79 [chan receive]:
github.com/influxdb/influxdb/services/httpd.(*Handler).serveQuery(0xc2080ac980, 0x7fdca407d518, 0xc208600a20, 0xc2091f8820, 0xc208112120)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:268 +0xa44
github.com/influxdb/influxdb/services/httpd.*Handler.(github.com/influxdb/influxdb/services/httpd.serveQuery)·fm(0x7fdca407d518, 0xc208600a20, 0xc2091f8820, 0xc208112120)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:95 +0x4f
github.com/influxdb/influxdb/services/httpd.func·001(0x7fdca407d518, 0xc208600a20, 0xc2091f8820)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:726 +0x395
net/http.HandlerFunc.ServeHTTP(0xc208057980, 0x7fdca407d518, 0xc208600a20, 0xc2091f8820)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·002(0x7fdca407d440, 0xc208600980, 0xc2091f8820)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:754 +0x288
net/http.HandlerFunc.ServeHTTP(0xc20805a4a0, 0x7fdca407d440, 0xc208600980, 0xc2091f8820)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·003(0x7fdca407d440, 0xc208600980, 0xc2091f8820)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:763 +0xba
net/http.HandlerFunc.ServeHTTP(0xc2080579a0, 0x7fdca407d440, 0xc208600980, 0xc2091f8820)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·004(0x7fdca407d440, 0xc208600980, 0xc2091f8820)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:796 +0x31a
net/http.HandlerFunc.ServeHTTP(0xc20805a4d0, 0x7fdca407d440, 0xc208600980, 0xc2091f8820)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·005(0x7fdca407d440, 0xc208600980, 0xc2091f8820)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:806 +0x179
net/http.HandlerFunc.ServeHTTP(0xc20805a4f0, 0x7fdca407d440, 0xc208600980, 0xc2091f8820)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·006(0x7fdca407d440, 0xc208600960, 0xc2091f8820)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:814 +0x123
net/http.HandlerFunc.ServeHTTP(0xc2080579c0, 0x7fdca407d440, 0xc208600960, 0xc2091f8820)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·007(0x7fdca407d408, 0xc209161ea0, 0xc2091f8820)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:824 +0x12c
net/http.HandlerFunc.ServeHTTP(0xc2080579e0, 0x7fdca407d408, 0xc209161ea0, 0xc2091f8820)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/bmizerany/pat.(*PatternServeMux).ServeHTTP(0xc208038b48, 0x7fdca407d408, 0xc209161ea0, 0xc2091f8820)
    /root/go/src/github.com/bmizerany/pat/mux.go:109 +0x21c
github.com/influxdb/influxdb/services/httpd.(*Handler).ServeHTTP(0xc2080ac980, 0x7fdca407d408, 0xc209161ea0, 0xc2091f8820)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:175 +0x256
net/http.serverHandler.ServeHTTP(0xc209c2d560, 0x7fdca407d408, 0xc209161ea0, 0xc2091f8820)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1703 +0x19a
net/http.(*conn).serve(0xc209161e00)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1204 +0xb57
created by net/http.(*Server).Serve
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1751 +0x35e

goroutine 80 [chan receive]:
github.com/influxdb/influxdb/services/httpd.(*Handler).serveQuery(0xc2080ac980, 0x7fdca407d518, 0xc208600b40, 0xc2091f89c0, 0xc208112120)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:268 +0xa44
github.com/influxdb/influxdb/services/httpd.*Handler.(github.com/influxdb/influxdb/services/httpd.serveQuery)·fm(0x7fdca407d518, 0xc208600b40, 0xc2091f89c0, 0xc208112120)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:95 +0x4f
github.com/influxdb/influxdb/services/httpd.func·001(0x7fdca407d518, 0xc208600b40, 0xc2091f89c0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:726 +0x395
net/http.HandlerFunc.ServeHTTP(0xc208057980, 0x7fdca407d518, 0xc208600b40, 0xc2091f89c0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·002(0x7fdca407d440, 0xc208600ac0, 0xc2091f89c0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:754 +0x288
net/http.HandlerFunc.ServeHTTP(0xc20805a4a0, 0x7fdca407d440, 0xc208600ac0, 0xc2091f89c0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·003(0x7fdca407d440, 0xc208600ac0, 0xc2091f89c0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:763 +0xba
net/http.HandlerFunc.ServeHTTP(0xc2080579a0, 0x7fdca407d440, 0xc208600ac0, 0xc2091f89c0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·004(0x7fdca407d440, 0xc208600ac0, 0xc2091f89c0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:796 +0x31a
net/http.HandlerFunc.ServeHTTP(0xc20805a4d0, 0x7fdca407d440, 0xc208600ac0, 0xc2091f89c0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·005(0x7fdca407d440, 0xc208600ac0, 0xc2091f89c0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:806 +0x179
net/http.HandlerFunc.ServeHTTP(0xc20805a4f0, 0x7fdca407d440, 0xc208600ac0, 0xc2091f89c0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·006(0x7fdca407d440, 0xc208600a80, 0xc2091f89c0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:814 +0x123
net/http.HandlerFunc.ServeHTTP(0xc2080579c0, 0x7fdca407d440, 0xc208600a80, 0xc2091f89c0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·007(0x7fdca407d408, 0xc20919a1e0, 0xc2091f89c0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:824 +0x12c
net/http.HandlerFunc.ServeHTTP(0xc2080579e0, 0x7fdca407d408, 0xc20919a1e0, 0xc2091f89c0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/bmizerany/pat.(*PatternServeMux).ServeHTTP(0xc208038b48, 0x7fdca407d408, 0xc20919a1e0, 0xc2091f89c0)
    /root/go/src/github.com/bmizerany/pat/mux.go:109 +0x21c
github.com/influxdb/influxdb/services/httpd.(*Handler).ServeHTTP(0xc2080ac980, 0x7fdca407d408, 0xc20919a1e0, 0xc2091f89c0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:175 +0x256
net/http.serverHandler.ServeHTTP(0xc209c2d560, 0x7fdca407d408, 0xc20919a1e0, 0xc2091f89c0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1703 +0x19a
net/http.(*conn).serve(0xc20919a000)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1204 +0xb57
created by net/http.(*Server).Serve
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1751 +0x35e

goroutine 81 [runnable]:
sync.(*Mutex).Lock(0xc20802c000)
    /root/.gvm/gos/go1.4.2/src/sync/mutex.go:66 +0xd3
sync.(*RWMutex).Lock(0xc20802c000)
    /root/.gvm/gos/go1.4.2/src/sync/rwmutex.go:82 +0x33
github.com/influxdb/influxdb/meta.func·022(0xc20811c280, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/meta/store.go:1020 +0x78
github.com/influxdb/influxdb/meta.(*Store).read(0xc20802c000, 0xc209d45400, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/meta/store.go:1240 +0x7d
github.com/influxdb/influxdb/meta.(*Store).Authenticate(0xc20802c000, 0xc20802c3cd, 0x6, 0xc20802c3d6, 0xf, 0x0, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/meta/store.go:1059 +0xa5
github.com/influxdb/influxdb/services/httpd.func·001(0x7fdca407d518, 0xc208600cc0, 0xc2091f8a90)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:720 +0x2d6
net/http.HandlerFunc.ServeHTTP(0xc208057980, 0x7fdca407d518, 0xc208600cc0, 0xc2091f8a90)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·002(0x7fdca407d440, 0xc208600c40, 0xc2091f8a90)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:754 +0x288
net/http.HandlerFunc.ServeHTTP(0xc20805a4a0, 0x7fdca407d440, 0xc208600c40, 0xc2091f8a90)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·003(0x7fdca407d440, 0xc208600c40, 0xc2091f8a90)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:763 +0xba
net/http.HandlerFunc.ServeHTTP(0xc2080579a0, 0x7fdca407d440, 0xc208600c40, 0xc2091f8a90)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·004(0x7fdca407d440, 0xc208600c40, 0xc2091f8a90)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:796 +0x31a
net/http.HandlerFunc.ServeHTTP(0xc20805a4d0, 0x7fdca407d440, 0xc208600c40, 0xc2091f8a90)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·005(0x7fdca407d440, 0xc208600c40, 0xc2091f8a90)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:806 +0x179
net/http.HandlerFunc.ServeHTTP(0xc20805a4f0, 0x7fdca407d440, 0xc208600c40, 0xc2091f8a90)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·006(0x7fdca407d440, 0xc208600c00, 0xc2091f8a90)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:814 +0x123
net/http.HandlerFunc.ServeHTTP(0xc2080579c0, 0x7fdca407d440, 0xc208600c00, 0xc2091f8a90)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·007(0x7fdca407d408, 0xc20919a500, 0xc2091f8a90)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:824 +0x12c
net/http.HandlerFunc.ServeHTTP(0xc2080579e0, 0x7fdca407d408, 0xc20919a500, 0xc2091f8a90)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/bmizerany/pat.(*PatternServeMux).ServeHTTP(0xc208038b48, 0x7fdca407d408, 0xc20919a500, 0xc2091f8a90)
    /root/go/src/github.com/bmizerany/pat/mux.go:109 +0x21c
github.com/influxdb/influxdb/services/httpd.(*Handler).ServeHTTP(0xc2080ac980, 0x7fdca407d408, 0xc20919a500, 0xc2091f8a90)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:175 +0x256
net/http.serverHandler.ServeHTTP(0xc209c2d560, 0x7fdca407d408, 0xc20919a500, 0xc2091f8a90)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1703 +0x19a
net/http.(*conn).serve(0xc20919a280)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1204 +0xb57
created by net/http.(*Server).Serve
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1751 +0x35e

goroutine 82 [semacquire]:
sync.(*Mutex).Lock(0xc20802c000)
    /root/.gvm/gos/go1.4.2/src/sync/mutex.go:66 +0xd3
sync.(*RWMutex).Lock(0xc20802c000)
    /root/.gvm/gos/go1.4.2/src/sync/rwmutex.go:82 +0x33
github.com/influxdb/influxdb/meta.func·022(0xc20811c280, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/meta/store.go:1020 +0x78
github.com/influxdb/influxdb/meta.(*Store).read(0xc20802c000, 0xc209d47400, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/meta/store.go:1240 +0x7d
github.com/influxdb/influxdb/meta.(*Store).Authenticate(0xc20802c000, 0xc208099a0d, 0x6, 0xc208099a16, 0xf, 0x0, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/meta/store.go:1059 +0xa5
github.com/influxdb/influxdb/services/httpd.func·001(0x7fdca407d518, 0xc208600de0, 0xc2091f8b60)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:720 +0x2d6
net/http.HandlerFunc.ServeHTTP(0xc208057980, 0x7fdca407d518, 0xc208600de0, 0xc2091f8b60)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·002(0x7fdca407d440, 0xc208600d60, 0xc2091f8b60)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:754 +0x288
net/http.HandlerFunc.ServeHTTP(0xc20805a4a0, 0x7fdca407d440, 0xc208600d60, 0xc2091f8b60)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·003(0x7fdca407d440, 0xc208600d60, 0xc2091f8b60)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:763 +0xba
net/http.HandlerFunc.ServeHTTP(0xc2080579a0, 0x7fdca407d440, 0xc208600d60, 0xc2091f8b60)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·004(0x7fdca407d440, 0xc208600d60, 0xc2091f8b60)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:796 +0x31a
net/http.HandlerFunc.ServeHTTP(0xc20805a4d0, 0x7fdca407d440, 0xc208600d60, 0xc2091f8b60)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·005(0x7fdca407d440, 0xc208600d60, 0xc2091f8b60)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:806 +0x179
net/http.HandlerFunc.ServeHTTP(0xc20805a4f0, 0x7fdca407d440, 0xc208600d60, 0xc2091f8b60)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·006(0x7fdca407d440, 0xc208600d20, 0xc2091f8b60)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:814 +0x123
net/http.HandlerFunc.ServeHTTP(0xc2080579c0, 0x7fdca407d440, 0xc208600d20, 0xc2091f8b60)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·007(0x7fdca407d408, 0xc20919a6e0, 0xc2091f8b60)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:824 +0x12c
net/http.HandlerFunc.ServeHTTP(0xc2080579e0, 0x7fdca407d408, 0xc20919a6e0, 0xc2091f8b60)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/bmizerany/pat.(*PatternServeMux).ServeHTTP(0xc208038b48, 0x7fdca407d408, 0xc20919a6e0, 0xc2091f8b60)
    /root/go/src/github.com/bmizerany/pat/mux.go:109 +0x21c
github.com/influxdb/influxdb/services/httpd.(*Handler).ServeHTTP(0xc2080ac980, 0x7fdca407d408, 0xc20919a6e0, 0xc2091f8b60)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:175 +0x256
net/http.serverHandler.ServeHTTP(0xc209c2d560, 0x7fdca407d408, 0xc20919a6e0, 0xc2091f8b60)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1703 +0x19a
net/http.(*conn).serve(0xc20919a460)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1204 +0xb57
created by net/http.(*Server).Serve
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1751 +0x35e

goroutine 83 [runnable]:
github.com/influxdb/influxdb/services/httpd.(*Handler).serveQuery(0xc2080ac980, 0x7fdca407d518, 0xc208600f00, 0xc2091f8d00, 0xc208112120)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:268 +0xa44
github.com/influxdb/influxdb/services/httpd.*Handler.(github.com/influxdb/influxdb/services/httpd.serveQuery)·fm(0x7fdca407d518, 0xc208600f00, 0xc2091f8d00, 0xc208112120)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:95 +0x4f
github.com/influxdb/influxdb/services/httpd.func·001(0x7fdca407d518, 0xc208600f00, 0xc2091f8d00)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:726 +0x395
net/http.HandlerFunc.ServeHTTP(0xc208057980, 0x7fdca407d518, 0xc208600f00, 0xc2091f8d00)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·002(0x7fdca407d440, 0xc208600e80, 0xc2091f8d00)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:754 +0x288
net/http.HandlerFunc.ServeHTTP(0xc20805a4a0, 0x7fdca407d440, 0xc208600e80, 0xc2091f8d00)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·003(0x7fdca407d440, 0xc208600e80, 0xc2091f8d00)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:763 +0xba
net/http.HandlerFunc.ServeHTTP(0xc2080579a0, 0x7fdca407d440, 0xc208600e80, 0xc2091f8d00)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·004(0x7fdca407d440, 0xc208600e80, 0xc2091f8d00)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:796 +0x31a
net/http.HandlerFunc.ServeHTTP(0xc20805a4d0, 0x7fdca407d440, 0xc208600e80, 0xc2091f8d00)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·005(0x7fdca407d440, 0xc208600e80, 0xc2091f8d00)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:806 +0x179
net/http.HandlerFunc.ServeHTTP(0xc20805a4f0, 0x7fdca407d440, 0xc208600e80, 0xc2091f8d00)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·006(0x7fdca407d440, 0xc208600e40, 0xc2091f8d00)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:814 +0x123
net/http.HandlerFunc.ServeHTTP(0xc2080579c0, 0x7fdca407d440, 0xc208600e40, 0xc2091f8d00)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·007(0x7fdca407d408, 0xc20919a960, 0xc2091f8d00)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:824 +0x12c
net/http.HandlerFunc.ServeHTTP(0xc2080579e0, 0x7fdca407d408, 0xc20919a960, 0xc2091f8d00)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/bmizerany/pat.(*PatternServeMux).ServeHTTP(0xc208038b48, 0x7fdca407d408, 0xc20919a960, 0xc2091f8d00)
    /root/go/src/github.com/bmizerany/pat/mux.go:109 +0x21c
github.com/influxdb/influxdb/services/httpd.(*Handler).ServeHTTP(0xc2080ac980, 0x7fdca407d408, 0xc20919a960, 0xc2091f8d00)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:175 +0x256
net/http.serverHandler.ServeHTTP(0xc209c2d560, 0x7fdca407d408, 0xc20919a960, 0xc2091f8d00)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1703 +0x19a
net/http.(*conn).serve(0xc20919a780)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1204 +0xb57
created by net/http.(*Server).Serve
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1751 +0x35e

goroutine 84 [chan receive]:
github.com/influxdb/influxdb/services/httpd.(*Handler).serveQuery(0xc2080ac980, 0x7fdca407d518, 0xc208601020, 0xc2091f8dd0, 0xc208112120)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:268 +0xa44
github.com/influxdb/influxdb/services/httpd.*Handler.(github.com/influxdb/influxdb/services/httpd.serveQuery)·fm(0x7fdca407d518, 0xc208601020, 0xc2091f8dd0, 0xc208112120)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:95 +0x4f
github.com/influxdb/influxdb/services/httpd.func·001(0x7fdca407d518, 0xc208601020, 0xc2091f8dd0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:726 +0x395
net/http.HandlerFunc.ServeHTTP(0xc208057980, 0x7fdca407d518, 0xc208601020, 0xc2091f8dd0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·002(0x7fdca407d440, 0xc208600fa0, 0xc2091f8dd0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:754 +0x288
net/http.HandlerFunc.ServeHTTP(0xc20805a4a0, 0x7fdca407d440, 0xc208600fa0, 0xc2091f8dd0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·003(0x7fdca407d440, 0xc208600fa0, 0xc2091f8dd0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:763 +0xba
net/http.HandlerFunc.ServeHTTP(0xc2080579a0, 0x7fdca407d440, 0xc208600fa0, 0xc2091f8dd0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·004(0x7fdca407d440, 0xc208600fa0, 0xc2091f8dd0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:796 +0x31a
net/http.HandlerFunc.ServeHTTP(0xc20805a4d0, 0x7fdca407d440, 0xc208600fa0, 0xc2091f8dd0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·005(0x7fdca407d440, 0xc208600fa0, 0xc2091f8dd0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:806 +0x179
net/http.HandlerFunc.ServeHTTP(0xc20805a4f0, 0x7fdca407d440, 0xc208600fa0, 0xc2091f8dd0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·006(0x7fdca407d440, 0xc208600f60, 0xc2091f8dd0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:814 +0x123
net/http.HandlerFunc.ServeHTTP(0xc2080579c0, 0x7fdca407d440, 0xc208600f60, 0xc2091f8dd0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·007(0x7fdca407d408, 0xc20919abe0, 0xc2091f8dd0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:824 +0x12c
net/http.HandlerFunc.ServeHTTP(0xc2080579e0, 0x7fdca407d408, 0xc20919abe0, 0xc2091f8dd0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/bmizerany/pat.(*PatternServeMux).ServeHTTP(0xc208038b48, 0x7fdca407d408, 0xc20919abe0, 0xc2091f8dd0)
    /root/go/src/github.com/bmizerany/pat/mux.go:109 +0x21c
github.com/influxdb/influxdb/services/httpd.(*Handler).ServeHTTP(0xc2080ac980, 0x7fdca407d408, 0xc20919abe0, 0xc2091f8dd0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:175 +0x256
net/http.serverHandler.ServeHTTP(0xc209c2d560, 0x7fdca407d408, 0xc20919abe0, 0xc2091f8dd0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1703 +0x19a
net/http.(*conn).serve(0xc20919aa00)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1204 +0xb57
created by net/http.(*Server).Serve
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1751 +0x35e

goroutine 85 [semacquire]:
sync.(*Mutex).Lock(0xc20802c000)
    /root/.gvm/gos/go1.4.2/src/sync/mutex.go:66 +0xd3
sync.(*RWMutex).Lock(0xc20802c000)
    /root/.gvm/gos/go1.4.2/src/sync/rwmutex.go:82 +0x33
github.com/influxdb/influxdb/meta.func·022(0xc20811c280, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/meta/store.go:1020 +0x78
github.com/influxdb/influxdb/meta.(*Store).read(0xc20802c000, 0xc209d41400, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/meta/store.go:1240 +0x7d
github.com/influxdb/influxdb/meta.(*Store).Authenticate(0xc20802c000, 0xc20a2f398e, 0x6, 0xc20a2f3997, 0xf, 0x0, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/meta/store.go:1059 +0xa5
github.com/influxdb/influxdb/services/httpd.func·001(0x7fdca407d518, 0xc208601160, 0xc2091f9110)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:720 +0x2d6
net/http.HandlerFunc.ServeHTTP(0xc208057b20, 0x7fdca407d518, 0xc208601160, 0xc2091f9110)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·002(0x7fdca407d440, 0xc2086010e0, 0xc2091f9110)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:754 +0x288
net/http.HandlerFunc.ServeHTTP(0xc20805a660, 0x7fdca407d440, 0xc2086010e0, 0xc2091f9110)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·003(0x7fdca407d440, 0xc2086010e0, 0xc2091f9110)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:763 +0xba
net/http.HandlerFunc.ServeHTTP(0xc208057b40, 0x7fdca407d440, 0xc2086010e0, 0xc2091f9110)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·004(0x7fdca407d440, 0xc2086010e0, 0xc2091f9110)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:796 +0x31a
net/http.HandlerFunc.ServeHTTP(0xc20805a690, 0x7fdca407d440, 0xc2086010e0, 0xc2091f9110)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·005(0x7fdca407d440, 0xc2086010e0, 0xc2091f9110)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:806 +0x179
net/http.HandlerFunc.ServeHTTP(0xc20805a6b0, 0x7fdca407d440, 0xc2086010e0, 0xc2091f9110)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·006(0x7fdca407d440, 0xc2086010c0, 0xc2091f9110)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:814 +0x123
net/http.HandlerFunc.ServeHTTP(0xc208057b60, 0x7fdca407d440, 0xc2086010c0, 0xc2091f9110)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·007(0x7fdca407d408, 0xc20919ae60, 0xc2091f9110)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:824 +0x12c
net/http.HandlerFunc.ServeHTTP(0xc208057b80, 0x7fdca407d408, 0xc20919ae60, 0xc2091f9110)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/bmizerany/pat.(*PatternServeMux).ServeHTTP(0xc208038b48, 0x7fdca407d408, 0xc20919ae60, 0xc2091f9110)
    /root/go/src/github.com/bmizerany/pat/mux.go:109 +0x21c
github.com/influxdb/influxdb/services/httpd.(*Handler).ServeHTTP(0xc2080ac980, 0x7fdca407d408, 0xc20919ae60, 0xc2091f9110)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:175 +0x256
net/http.serverHandler.ServeHTTP(0xc209c2d560, 0x7fdca407d408, 0xc20919ae60, 0xc2091f9110)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1703 +0x19a
net/http.(*conn).serve(0xc20919ac80)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1204 +0xb57
created by net/http.(*Server).Serve
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1751 +0x35e

goroutine 86 [semacquire]:
sync.(*Mutex).Lock(0xc20802c000)
    /root/.gvm/gos/go1.4.2/src/sync/mutex.go:66 +0xd3
sync.(*RWMutex).Lock(0xc20802c000)
    /root/.gvm/gos/go1.4.2/src/sync/rwmutex.go:82 +0x33
github.com/influxdb/influxdb/meta.func·022(0xc20811c280, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/meta/store.go:1020 +0x78
github.com/influxdb/influxdb/meta.(*Store).read(0xc20802c000, 0xc209d43400, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/meta/store.go:1240 +0x7d
github.com/influxdb/influxdb/meta.(*Store).Authenticate(0xc20802c000, 0xc208099d0d, 0x6, 0xc208099d16, 0xf, 0x0, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/meta/store.go:1059 +0xa5
github.com/influxdb/influxdb/services/httpd.func·001(0x7fdca407d518, 0xc208601280, 0xc2091f91e0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:720 +0x2d6
net/http.HandlerFunc.ServeHTTP(0xc208057980, 0x7fdca407d518, 0xc208601280, 0xc2091f91e0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·002(0x7fdca407d440, 0xc208601200, 0xc2091f91e0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:754 +0x288
net/http.HandlerFunc.ServeHTTP(0xc20805a4a0, 0x7fdca407d440, 0xc208601200, 0xc2091f91e0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·003(0x7fdca407d440, 0xc208601200, 0xc2091f91e0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:763 +0xba
net/http.HandlerFunc.ServeHTTP(0xc2080579a0, 0x7fdca407d440, 0xc208601200, 0xc2091f91e0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·004(0x7fdca407d440, 0xc208601200, 0xc2091f91e0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:796 +0x31a
net/http.HandlerFunc.ServeHTTP(0xc20805a4d0, 0x7fdca407d440, 0xc208601200, 0xc2091f91e0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·005(0x7fdca407d440, 0xc208601200, 0xc2091f91e0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:806 +0x179
net/http.HandlerFunc.ServeHTTP(0xc20805a4f0, 0x7fdca407d440, 0xc208601200, 0xc2091f91e0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·006(0x7fdca407d440, 0xc2086011c0, 0xc2091f91e0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:814 +0x123
net/http.HandlerFunc.ServeHTTP(0xc2080579c0, 0x7fdca407d440, 0xc2086011c0, 0xc2091f91e0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·007(0x7fdca407d408, 0xc20919b0e0, 0xc2091f91e0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:824 +0x12c
net/http.HandlerFunc.ServeHTTP(0xc2080579e0, 0x7fdca407d408, 0xc20919b0e0, 0xc2091f91e0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/bmizerany/pat.(*PatternServeMux).ServeHTTP(0xc208038b48, 0x7fdca407d408, 0xc20919b0e0, 0xc2091f91e0)
    /root/go/src/github.com/bmizerany/pat/mux.go:109 +0x21c
github.com/influxdb/influxdb/services/httpd.(*Handler).ServeHTTP(0xc2080ac980, 0x7fdca407d408, 0xc20919b0e0, 0xc2091f91e0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:175 +0x256
net/http.serverHandler.ServeHTTP(0xc209c2d560, 0x7fdca407d408, 0xc20919b0e0, 0xc2091f91e0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1703 +0x19a
net/http.(*conn).serve(0xc20919af00)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1204 +0xb57
created by net/http.(*Server).Serve
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1751 +0x35e

goroutine 87 [chan receive]:
github.com/influxdb/influxdb/services/httpd.(*Handler).serveQuery(0xc2080ac980, 0x7fdca407d518, 0xc2086013a0, 0xc2091f92b0, 0xc208112120)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:268 +0xa44
github.com/influxdb/influxdb/services/httpd.*Handler.(github.com/influxdb/influxdb/services/httpd.serveQuery)·fm(0x7fdca407d518, 0xc2086013a0, 0xc2091f92b0, 0xc208112120)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:95 +0x4f
github.com/influxdb/influxdb/services/httpd.func·001(0x7fdca407d518, 0xc2086013a0, 0xc2091f92b0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:726 +0x395
net/http.HandlerFunc.ServeHTTP(0xc208057980, 0x7fdca407d518, 0xc2086013a0, 0xc2091f92b0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·002(0x7fdca407d440, 0xc208601320, 0xc2091f92b0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:754 +0x288
net/http.HandlerFunc.ServeHTTP(0xc20805a4a0, 0x7fdca407d440, 0xc208601320, 0xc2091f92b0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·003(0x7fdca407d440, 0xc208601320, 0xc2091f92b0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:763 +0xba
net/http.HandlerFunc.ServeHTTP(0xc2080579a0, 0x7fdca407d440, 0xc208601320, 0xc2091f92b0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·004(0x7fdca407d440, 0xc208601320, 0xc2091f92b0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:796 +0x31a
net/http.HandlerFunc.ServeHTTP(0xc20805a4d0, 0x7fdca407d440, 0xc208601320, 0xc2091f92b0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·005(0x7fdca407d440, 0xc208601320, 0xc2091f92b0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:806 +0x179
net/http.HandlerFunc.ServeHTTP(0xc20805a4f0, 0x7fdca407d440, 0xc208601320, 0xc2091f92b0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·006(0x7fdca407d440, 0xc208601300, 0xc2091f92b0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:814 +0x123
net/http.HandlerFunc.ServeHTTP(0xc2080579c0, 0x7fdca407d440, 0xc208601300, 0xc2091f92b0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·007(0x7fdca407d408, 0xc20919b360, 0xc2091f92b0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:824 +0x12c
net/http.HandlerFunc.ServeHTTP(0xc2080579e0, 0x7fdca407d408, 0xc20919b360, 0xc2091f92b0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/bmizerany/pat.(*PatternServeMux).ServeHTTP(0xc208038b48, 0x7fdca407d408, 0xc20919b360, 0xc2091f92b0)
    /root/go/src/github.com/bmizerany/pat/mux.go:109 +0x21c
github.com/influxdb/influxdb/services/httpd.(*Handler).ServeHTTP(0xc2080ac980, 0x7fdca407d408, 0xc20919b360, 0xc2091f92b0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:175 +0x256
net/http.serverHandler.ServeHTTP(0xc209c2d560, 0x7fdca407d408, 0xc20919b360, 0xc2091f92b0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1703 +0x19a
net/http.(*conn).serve(0xc20919b180)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1204 +0xb57
created by net/http.(*Server).Serve
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1751 +0x35e

goroutine 88 [semacquire]:
sync.(*Mutex).Lock(0xc20802c000)
    /root/.gvm/gos/go1.4.2/src/sync/mutex.go:66 +0xd3
sync.(*RWMutex).Lock(0xc20802c000)
    /root/.gvm/gos/go1.4.2/src/sync/rwmutex.go:82 +0x33
github.com/influxdb/influxdb/meta.func·022(0xc20811c280, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/meta/store.go:1020 +0x78
github.com/influxdb/influxdb/meta.(*Store).read(0xc20802c000, 0xc209299400, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/meta/store.go:1240 +0x7d
github.com/influxdb/influxdb/meta.(*Store).Authenticate(0xc20802c000, 0xc208099f0d, 0x6, 0xc208099f16, 0xf, 0x0, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/meta/store.go:1059 +0xa5
github.com/influxdb/influxdb/services/httpd.func·001(0x7fdca407d518, 0xc2086014e0, 0xc2091f95f0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:720 +0x2d6
net/http.HandlerFunc.ServeHTTP(0xc208057980, 0x7fdca407d518, 0xc2086014e0, 0xc2091f95f0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·002(0x7fdca407d440, 0xc208601440, 0xc2091f95f0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:754 +0x288
net/http.HandlerFunc.ServeHTTP(0xc20805a4a0, 0x7fdca407d440, 0xc208601440, 0xc2091f95f0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·003(0x7fdca407d440, 0xc208601440, 0xc2091f95f0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:763 +0xba
net/http.HandlerFunc.ServeHTTP(0xc2080579a0, 0x7fdca407d440, 0xc208601440, 0xc2091f95f0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·004(0x7fdca407d440, 0xc208601440, 0xc2091f95f0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:796 +0x31a
net/http.HandlerFunc.ServeHTTP(0xc20805a4d0, 0x7fdca407d440, 0xc208601440, 0xc2091f95f0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·005(0x7fdca407d440, 0xc208601440, 0xc2091f95f0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:806 +0x179
net/http.HandlerFunc.ServeHTTP(0xc20805a4f0, 0x7fdca407d440, 0xc208601440, 0xc2091f95f0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·006(0x7fdca407d440, 0xc208601420, 0xc2091f95f0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:814 +0x123
net/http.HandlerFunc.ServeHTTP(0xc2080579c0, 0x7fdca407d440, 0xc208601420, 0xc2091f95f0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·007(0x7fdca407d408, 0xc20919b5e0, 0xc2091f95f0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:824 +0x12c
net/http.HandlerFunc.ServeHTTP(0xc2080579e0, 0x7fdca407d408, 0xc20919b5e0, 0xc2091f95f0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/bmizerany/pat.(*PatternServeMux).ServeHTTP(0xc208038b48, 0x7fdca407d408, 0xc20919b5e0, 0xc2091f95f0)
    /root/go/src/github.com/bmizerany/pat/mux.go:109 +0x21c
github.com/influxdb/influxdb/services/httpd.(*Handler).ServeHTTP(0xc2080ac980, 0x7fdca407d408, 0xc20919b5e0, 0xc2091f95f0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:175 +0x256
net/http.serverHandler.ServeHTTP(0xc209c2d560, 0x7fdca407d408, 0xc20919b5e0, 0xc2091f95f0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1703 +0x19a
net/http.(*conn).serve(0xc20919b400)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1204 +0xb57
created by net/http.(*Server).Serve
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1751 +0x35e

goroutine 89 [chan receive]:
github.com/influxdb/influxdb/services/httpd.(*Handler).serveQuery(0xc2080ac980, 0x7fdca407d518, 0xc208601600, 0xc2091f96c0, 0xc208112120)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:268 +0xa44
github.com/influxdb/influxdb/services/httpd.*Handler.(github.com/influxdb/influxdb/services/httpd.serveQuery)·fm(0x7fdca407d518, 0xc208601600, 0xc2091f96c0, 0xc208112120)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:95 +0x4f
github.com/influxdb/influxdb/services/httpd.func·001(0x7fdca407d518, 0xc208601600, 0xc2091f96c0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:726 +0x395
net/http.HandlerFunc.ServeHTTP(0xc208057980, 0x7fdca407d518, 0xc208601600, 0xc2091f96c0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·002(0x7fdca407d440, 0xc208601560, 0xc2091f96c0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:754 +0x288
net/http.HandlerFunc.ServeHTTP(0xc20805a4a0, 0x7fdca407d440, 0xc208601560, 0xc2091f96c0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·003(0x7fdca407d440, 0xc208601560, 0xc2091f96c0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:763 +0xba
net/http.HandlerFunc.ServeHTTP(0xc2080579a0, 0x7fdca407d440, 0xc208601560, 0xc2091f96c0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·004(0x7fdca407d440, 0xc208601560, 0xc2091f96c0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:796 +0x31a
net/http.HandlerFunc.ServeHTTP(0xc20805a4d0, 0x7fdca407d440, 0xc208601560, 0xc2091f96c0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·005(0x7fdca407d440, 0xc208601560, 0xc2091f96c0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:806 +0x179
net/http.HandlerFunc.ServeHTTP(0xc20805a4f0, 0x7fdca407d440, 0xc208601560, 0xc2091f96c0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·006(0x7fdca407d440, 0xc208601540, 0xc2091f96c0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:814 +0x123
net/http.HandlerFunc.ServeHTTP(0xc2080579c0, 0x7fdca407d440, 0xc208601540, 0xc2091f96c0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·007(0x7fdca407d408, 0xc20919b860, 0xc2091f96c0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:824 +0x12c
net/http.HandlerFunc.ServeHTTP(0xc2080579e0, 0x7fdca407d408, 0xc20919b860, 0xc2091f96c0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/bmizerany/pat.(*PatternServeMux).ServeHTTP(0xc208038b48, 0x7fdca407d408, 0xc20919b860, 0xc2091f96c0)
    /root/go/src/github.com/bmizerany/pat/mux.go:109 +0x21c
github.com/influxdb/influxdb/services/httpd.(*Handler).ServeHTTP(0xc2080ac980, 0x7fdca407d408, 0xc20919b860, 0xc2091f96c0)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:175 +0x256
net/http.serverHandler.ServeHTTP(0xc209c2d560, 0x7fdca407d408, 0xc20919b860, 0xc2091f96c0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1703 +0x19a
net/http.(*conn).serve(0xc20919b680)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1204 +0xb57
created by net/http.(*Server).Serve
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1751 +0x35e

goroutine 90 [semacquire]:
sync.(*Mutex).Lock(0xc20802c000)
    /root/.gvm/gos/go1.4.2/src/sync/mutex.go:66 +0xd3
sync.(*RWMutex).Lock(0xc20802c000)
    /root/.gvm/gos/go1.4.2/src/sync/rwmutex.go:82 +0x33
github.com/influxdb/influxdb/meta.func·022(0xc20811c280, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/meta/store.go:1020 +0x78
github.com/influxdb/influxdb/meta.(*Store).read(0xc20802c000, 0xc20929f400, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/meta/store.go:1240 +0x7d
github.com/influxdb/influxdb/meta.(*Store).Authenticate(0xc20802c000, 0xc20a2f3c2e, 0x6, 0xc20a2f3c37, 0xf, 0x0, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/meta/store.go:1059 +0xa5
github.com/influxdb/influxdb/services/httpd.func·001(0x7fdca407d518, 0xc208601740, 0xc2091f9790)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:720 +0x2d6
net/http.HandlerFunc.ServeHTTP(0xc208057b20, 0x7fdca407d518, 0xc208601740, 0xc2091f9790)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·002(0x7fdca407d440, 0xc2086016a0, 0xc2091f9790)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:754 +0x288
net/http.HandlerFunc.ServeHTTP(0xc20805a660, 0x7fdca407d440, 0xc2086016a0, 0xc2091f9790)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·003(0x7fdca407d440, 0xc2086016a0, 0xc2091f9790)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:763 +0xba
net/http.HandlerFunc.ServeHTTP(0xc208057b40, 0x7fdca407d440, 0xc2086016a0, 0xc2091f9790)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·004(0x7fdca407d440, 0xc2086016a0, 0xc2091f9790)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:796 +0x31a
net/http.HandlerFunc.ServeHTTP(0xc20805a690, 0x7fdca407d440, 0xc2086016a0, 0xc2091f9790)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·005(0x7fdca407d440, 0xc2086016a0, 0xc2091f9790)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:806 +0x179
net/http.HandlerFunc.ServeHTTP(0xc20805a6b0, 0x7fdca407d440, 0xc2086016a0, 0xc2091f9790)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·006(0x7fdca407d440, 0xc208601680, 0xc2091f9790)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:814 +0x123
net/http.HandlerFunc.ServeHTTP(0xc208057b60, 0x7fdca407d440, 0xc208601680, 0xc2091f9790)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·007(0x7fdca407d408, 0xc20919bae0, 0xc2091f9790)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:824 +0x12c
net/http.HandlerFunc.ServeHTTP(0xc208057b80, 0x7fdca407d408, 0xc20919bae0, 0xc2091f9790)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/bmizerany/pat.(*PatternServeMux).ServeHTTP(0xc208038b48, 0x7fdca407d408, 0xc20919bae0, 0xc2091f9790)
    /root/go/src/github.com/bmizerany/pat/mux.go:109 +0x21c
github.com/influxdb/influxdb/services/httpd.(*Handler).ServeHTTP(0xc2080ac980, 0x7fdca407d408, 0xc20919bae0, 0xc2091f9790)
    /root/go/src/github.com/influxdb/influxdb/services/httpd/handler.go:175 +0x256
net/http.serverHandler.ServeHTTP(0xc209c2d560, 0x7fdca407d408, 0xc20919bae0, 0xc2091f9790)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1703 +0x19a
net/http.(*conn).serve(0xc20919b900)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1204 +0xb57
created by net/http.(*Server).Serve
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1751 +0x35e

goroutine 30 [select]:
github.com/influxdb/influxdb/cluster.(*PointsWriter).writeToShard(0xc2080101c0, 0xc209bb2cc0, 0xc2089d0853, 0x6, 0xc2080eb076, 0x7, 0x1, 0xc208656200, 0xf, 0x10, ...)
    /root/go/src/github.com/influxdb/influxdb/cluster/points_writer.go:278 +0x913
github.com/influxdb/influxdb/cluster.func·001(0xc209bb2cc0, 0xc2089d0853, 0x6, 0xc2080eb076, 0x7, 0xc208656200, 0xf, 0x10)
    /root/go/src/github.com/influxdb/influxdb/cluster/points_writer.go:205 +0xad
created by github.com/influxdb/influxdb/cluster.(*PointsWriter).WritePoints
    /root/go/src/github.com/influxdb/influxdb/cluster/points_writer.go:206 +0x447

goroutine 31 [runnable]:
syscall.Syscall(0x4b, 0x31, 0x0, 0x0, 0x0, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/syscall/asm_linux_amd64.s:21 +0x5
syscall.Fdatasync(0x31, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/syscall/zsyscall_linux_amd64.go:483 +0x55
github.com/boltdb/bolt.fdatasync(0xc2087c6d00, 0x0, 0x0)
    /root/go/src/github.com/boltdb/bolt/bolt_linux.go:11 +0x4c
github.com/boltdb/bolt.(*Tx).write(0xc20920c340, 0x0, 0x0)
    /root/go/src/github.com/boltdb/bolt/tx.go:460 +0x493
github.com/boltdb/bolt.(*Tx).Commit(0xc20920c340, 0x0, 0x0)
    /root/go/src/github.com/boltdb/bolt/tx.go:176 +0x47c
github.com/boltdb/bolt.(*DB).Update(0xc2087c6d00, 0xc2092b3e68, 0x0, 0x0)
    /root/go/src/github.com/boltdb/bolt/db.go:554 +0x169
github.com/influxdb/influxdb/tsdb.(*Shard).WritePoints(0xc20805d290, 0xc208656200, 0xf, 0x10, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/tsdb/shard.go:311 +0x555
github.com/influxdb/influxdb/tsdb.(*Store).WriteToShard(0xc20800c540, 0x11ed, 0xc208656200, 0xf, 0x10, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/tsdb/store.go:281 +0xf7
github.com/influxdb/influxdb/cluster.func·002(0x11ed, 0x1, 0xc208656200, 0xf, 0x10)
    /root/go/src/github.com/influxdb/influxdb/cluster/points_writer.go:241 +0xfc
created by github.com/influxdb/influxdb/cluster.(*PointsWriter).writeToShard
    /root/go/src/github.com/influxdb/influxdb/cluster/points_writer.go:271 +0x30b

goroutine 92 [runnable]:
github.com/influxdb/influxdb/tsdb.(*QueryExecutor).executeSelectStatement(0xc20808f700, 0x0, 0xc208fc9c80, 0xc20a2f3e00, 0x2710, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/tsdb/query_executor.go:282 +0x149
github.com/influxdb/influxdb/tsdb.func·006()
    /root/go/src/github.com/influxdb/influxdb/tsdb/query_executor.go:146 +0x6bd
created by github.com/influxdb/influxdb/tsdb.(*QueryExecutor).ExecuteQuery
    /root/go/src/github.com/influxdb/influxdb/tsdb/query_executor.go:196 +0x1f5

goroutine 93 [runnable]:
github.com/influxdb/influxdb/tsdb.(*QueryExecutor).executeSelectStatement(0xc20808f700, 0x0, 0xc209404180, 0xc20a2f3ec0, 0x2710, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/tsdb/query_executor.go:282 +0x149
github.com/influxdb/influxdb/tsdb.func·006()
    /root/go/src/github.com/influxdb/influxdb/tsdb/query_executor.go:146 +0x6bd
created by github.com/influxdb/influxdb/tsdb.(*QueryExecutor).ExecuteQuery
    /root/go/src/github.com/influxdb/influxdb/tsdb/query_executor.go:196 +0x1f5

goroutine 101 [runnable]:
github.com/influxdb/influxdb/tsdb.(*RawExecutor).execute(0xc20a67b020, 0xc20a01b260)
    /root/go/src/github.com/influxdb/influxdb/tsdb/engine.go:97
created by github.com/influxdb/influxdb/tsdb.(*RawExecutor).Execute
    /root/go/src/github.com/influxdb/influxdb/tsdb/engine.go:93 +0x5a

goroutine 95 [chan receive]:
github.com/influxdb/influxdb/tsdb.(*QueryExecutor).executeSelectStatement(0xc20808f700, 0x0, 0xc208fc9bc0, 0xc20a01a0c0, 0x2710, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/tsdb/query_executor.go:282 +0x149
github.com/influxdb/influxdb/tsdb.func·006()
    /root/go/src/github.com/influxdb/influxdb/tsdb/query_executor.go:146 +0x6bd
created by github.com/influxdb/influxdb/tsdb.(*QueryExecutor).ExecuteQuery
    /root/go/src/github.com/influxdb/influxdb/tsdb/query_executor.go:196 +0x1f5

goroutine 100 [runnable]:
github.com/influxdb/influxdb/tsdb.func·006()
    /root/go/src/github.com/influxdb/influxdb/tsdb/query_executor.go:123
created by github.com/influxdb/influxdb/tsdb.(*QueryExecutor).ExecuteQuery
    /root/go/src/github.com/influxdb/influxdb/tsdb/query_executor.go:196 +0x1f5

goroutine 98 [chan receive]:
github.com/influxdb/influxdb/tsdb.(*QueryExecutor).executeSelectStatement(0xc20808f700, 0x0, 0xc2094055c0, 0xc20a01a660, 0x2710, 0x0, 0x0)
    /root/go/src/github.com/influxdb/influxdb/tsdb/query_executor.go:282 +0x149
github.com/influxdb/influxdb/tsdb.func·006()
    /root/go/src/github.com/influxdb/influxdb/tsdb/query_executor.go:146 +0x6bd
created by github.com/influxdb/influxdb/tsdb.(*QueryExecutor).ExecuteQuery
    /root/go/src/github.com/influxdb/influxdb/tsdb/query_executor.go:196 +0x1f5
[metastore] 2015/08/10 06:42:36 [INFO] raft: Node at 127.0.0.1:8088 [Follower] entering Follower state
[metastore] 2015/08/10 06:42:36 read local node id: 1
[metastore] 2015/08/10 06:42:38 [WARN] raft: Heartbeat timeout reached, starting election
[metastore] 2015/08/10 06:42:38 [INFO] raft: Node at 127.0.0.1:8088 [Candidate] entering Candidate state
[metastore] 2015/08/10 06:42:38 [DEBUG] raft: Votes needed: 1
[metastore] 2015/08/10 06:42:38 [DEBUG] raft: Vote granted. Tally: 1
[metastore] 2015/08/10 06:42:38 [INFO] raft: Election won. Tally: 1
[metastore] 2015/08/10 06:42:38 [INFO] raft: Node at 127.0.0.1:8088 [Leader] entering Leader state
[metastore] 2015/08/10 06:42:38 [INFO] raft: Disabling EnableSingleNode (bootstrap)
[metastore] 2015/08/10 06:42:38 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:42:38 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:42:38 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:42:38 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:42:38 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:42:38 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:42:38 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:42:38 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:42:39 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:42:39 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:42:39 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:42:39 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:42:39 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:42:39 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:42:39 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:42:39 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:42:40 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:42:40 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:42:40 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:42:40 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[metastore] 2015/08/10 06:42:40 [DEBUG] raft: Node 127.0.0.1:8088 updated peer set (2): [127.0.0.1:8088]
[admin] 2015/08/10 06:42:42 listening on HTTP: [::]:8083
[httpd] 2015/08/10 06:42:42 authentication enabled: true
[httpd] 2015/08/10 06:42:42 listening on HTTP: [::]:8086
2015/08/10 06:42:42 InfluxDB starting, version 0.9.2, commit 6c0a91f775f9fc0e625d17ffa04a3fe86945ba09
2015/08/10 06:42:42 GOMAXPROCS set to 2
[run] 2015/08/10 06:42:42 listening for signals

[otoolep]

Thanks for the report @vovencij -- your trace implies a query was executing when this happened. Do you know what that query was?

[vovencij]

It is hard to tell with 100% confidence, but most probably, considering the logs of the client application, which reads and writes data to influx, it was a batch insert.

[timgriffiths]

Just a heads up i just upgraded and i am hitting this problem as well, is there any extra logging that i can turn on to help you guys troubleshot this?

[otoolep]

@timgriffiths - can you try a nightly build? We now handle an error that may have been causing this. Check the link below for nightly builds.

https://influxdb.com/download/index.html

[timgriffiths]

@otoolep Can do, I will change it over at next crash otherwise after COB today

[timgriffiths]

So my problem still exists, i running the latest nightly build, below is the full error. it's weird it can run fine for hours with no one changing what they are running then it will crash

2015/08/13 12:31:53 InfluxDB starting, version 0.9.3-nightly-b032c1c, commit b032c1c6adc5587232745a36d010d133df51d9f1
2015/08/13 12:31:53 GOMAXPROCS set to 12
[run] 2015/08/13 12:31:53 listening for signals
[metastore] 2015/08/13 12:31:53 updated node id=1 hostname=localhost:8088
panic: runtime error: invalid memory address or nil pointer dereference
[signal 0xb code=0x1 addr=0x0 pc=0x58f7c6]

goroutine 6308 [running]:
github.com/influxdb/influxdb/tsdb.(*Executor).executeRaw(0xc20b89bb90, 0xc20aac1860)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/executor.go:290 +0xcc6
created by github.com/influxdb/influxdb/tsdb.(*Executor).Execute
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/executor.go:88 +0x9a

goroutine 1 [chan receive, 2 minutes]:
main.(*Main).Run(0xc20806db00, 0xc20800a010, 0x1, 0x1, 0x0, 0x0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/cmd/influxd/main.go:86 +0x73b
main.main()
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/cmd/influxd/main.go:38 +0xdc

goroutine 6 [syscall, 2 minutes]:
os/signal.loop()
        /usr/local/go/src/os/signal/signal_unix.go:21 +0x1f
created by os/signal.init·1
        /usr/local/go/src/os/signal/signal_unix.go:27 +0x35

goroutine 17 [syscall, 2 minutes, locked to thread]:
runtime.goexit()
        /usr/local/go/src/runtime/asm_amd64.s:2232 +0x1

goroutine 8 [IO wait, 2 minutes]:
net.(*pollDesc).Wait(0xc208010450, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc208010450, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).accept(0xc2080103f0, 0x0, 0x7f7b61b66e30, 0xc20869c1f8)
        /usr/local/go/src/net/fd_unix.go:419 +0x40b
net.(*TCPListener).AcceptTCP(0xc208034d38, 0x8e72a0, 0x0, 0x0)
        /usr/local/go/src/net/tcpsock_posix.go:234 +0x4e
net.(*TCPListener).Accept(0xc208034d38, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/tcpsock_posix.go:244 +0x4c
github.com/influxdb/influxdb/tcp.(*Mux).Serve(0xc2080ec660, 0x7f7b61b694a8, 0xc208034d38, 0x0, 0x0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tcp/mux.go:45 +0x57
created by github.com/influxdb/influxdb/cmd/influxd/run.func·003
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/cmd/influxd/run/server.go:310 +0x8f2

goroutine 9 [chan receive, 2 minutes]:
github.com/influxdb/influxdb/tcp.(*listener).Accept(0xc208034d40, 0x0, 0x0, 0x0, 0x0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tcp/mux.go:117 +0x80
github.com/influxdb/influxdb/meta.(*raftLayer).Accept(0xc2080ec6f0, 0x0, 0x0, 0x0, 0x0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/meta/store.go:2052 +0x64
github.com/hashicorp/raft.(*NetworkTransport).listen(0xc208010540)
        /tmp/tmp.bBFDyJej53/src/github.com/hashicorp/raft/net_transport.go:346 +0x50
created by github.com/hashicorp/raft.NewNetworkTransport
        /tmp/tmp.bBFDyJej53/src/github.com/hashicorp/raft/net_transport.go:138 +0x2c4

goroutine 10 [select]:
github.com/hashicorp/raft.(*Raft).leaderLoop(0xc2080c21c0)
        /tmp/tmp.bBFDyJej53/src/github.com/hashicorp/raft/raft.go:815 +0xc7c
github.com/hashicorp/raft.(*Raft).runLeader(0xc2080c21c0)
        /tmp/tmp.bBFDyJej53/src/github.com/hashicorp/raft/raft.go:787 +0x74e
github.com/hashicorp/raft.(*Raft).run(0xc2080c21c0)
        /tmp/tmp.bBFDyJej53/src/github.com/hashicorp/raft/raft.go:584 +0xc9
github.com/hashicorp/raft.*Raft.(github.com/hashicorp/raft.run)·fm()
        /tmp/tmp.bBFDyJej53/src/github.com/hashicorp/raft/raft.go:241 +0x27
github.com/hashicorp/raft.func·011()
        /tmp/tmp.bBFDyJej53/src/github.com/hashicorp/raft/state.go:152 +0x51
created by github.com/hashicorp/raft.(*raftState).goFunc
        /tmp/tmp.bBFDyJej53/src/github.com/hashicorp/raft/state.go:153 +0xe3

goroutine 11 [select, 2 minutes]:
github.com/hashicorp/raft.(*Raft).runFSM(0xc2080c21c0)
        /tmp/tmp.bBFDyJej53/src/github.com/hashicorp/raft/raft.go:498 +0xf74
github.com/hashicorp/raft.*Raft.(github.com/hashicorp/raft.runFSM)·fm()
        /tmp/tmp.bBFDyJej53/src/github.com/hashicorp/raft/raft.go:242 +0x27
github.com/hashicorp/raft.func·011()
        /tmp/tmp.bBFDyJej53/src/github.com/hashicorp/raft/state.go:152 +0x51
created by github.com/hashicorp/raft.(*raftState).goFunc
        /tmp/tmp.bBFDyJej53/src/github.com/hashicorp/raft/state.go:153 +0xe3

goroutine 12 [select, 2 minutes]:
github.com/hashicorp/raft.(*Raft).runSnapshots(0xc2080c21c0)
        /tmp/tmp.bBFDyJej53/src/github.com/hashicorp/raft/raft.go:1602 +0x466
github.com/hashicorp/raft.*Raft.(github.com/hashicorp/raft.runSnapshots)·fm()
        /tmp/tmp.bBFDyJej53/src/github.com/hashicorp/raft/raft.go:243 +0x27
github.com/hashicorp/raft.func·011()
        /tmp/tmp.bBFDyJej53/src/github.com/hashicorp/raft/state.go:152 +0x51
created by github.com/hashicorp/raft.(*raftState).goFunc
        /tmp/tmp.bBFDyJej53/src/github.com/hashicorp/raft/state.go:153 +0xe3

goroutine 13 [chan receive, 2 minutes]:
github.com/influxdb/influxdb/tcp.(*listener).Accept(0xc208034d48, 0x0, 0x0, 0x0, 0x0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tcp/mux.go:117 +0x80
github.com/influxdb/influxdb/meta.(*Store).serveExecListener(0xc20805c140)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/meta/store.go:617 +0x8f
created by github.com/influxdb/influxdb/meta.(*Store).Open
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/meta/store.go:233 +0x270

goroutine 14 [chan receive, 2 minutes]:
github.com/influxdb/influxdb/tcp.(*listener).Accept(0xc208034d50, 0x0, 0x0, 0x0, 0x0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tcp/mux.go:117 +0x80
github.com/influxdb/influxdb/meta.(*Store).serveRPCListener(0xc20805c140)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/meta/store.go:721 +0xc9
created by github.com/influxdb/influxdb/meta.(*Store).Open
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/meta/store.go:236 +0x2ba

goroutine 146 [IO wait]:
net.(*pollDesc).Wait(0xc208f6e060, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc208f6e060, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc208f6e000, 0xc208f74000, 0x1000, 0x1000, 0x0, 0x7f7b61b66e30, 0xc20c2b0420)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc208f70000, 0xc208f74000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
net/http.(*liveSwitchReader).Read(0xc208f72048, 0xc208f74000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc20979c100, 0xc208f74000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc209928de0)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc209928de0, 0xc208e9fb0a, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc209928de0, 0x0, 0x0, 0x0, 0xc209de6100, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc2091884e0, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc2091884e0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc209928de0, 0xc209bf0340, 0x0, 0x0)
        /usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc208f72000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc208f72000)
        /usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 16 [select, 2 minutes]:
github.com/influxdb/influxdb/cmd/influxd/run.(*Server).monitorErrorChan(0xc2080aa0e0, 0xc208072600)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/cmd/influxd/run/server.go:439 +0x14a
created by github.com/influxdb/influxdb/cmd/influxd/run.func·003
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/cmd/influxd/run/server.go:316 +0xa63

goroutine 34 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc208070000, 0xc208134060)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 35 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc208070090, 0xc2081a7a40)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 36 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc2080705a0, 0xc208126720)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 37 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc208071320, 0xc208126e40)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 38 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc208070240, 0xc2082fe2a0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 39 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc208070900, 0xc2082f0840)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 40 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc208070bd0, 0xc208122b40)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 41 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc208070990, 0xc2082ae7e0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 42 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc208070b40, 0xc2081a2d80)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 43 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc2080713b0, 0xc208122de0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 44 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc2081be990, 0xc2081907e0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 45 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc2081bf170, 0xc2081913e0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 46 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc2081bf8c0, 0xc208191b00)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 47 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc2084ee990, 0xc208628de0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 48 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc2081beea0, 0xc2081b9260)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 49 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc2081bf5f0, 0xc208191f80)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 50 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc2081bef30, 0xc2081d5f80)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 51 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc2081bf710, 0xc2081d7620)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 52 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc2081bebd0, 0xc2084c6d20)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 53 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc2081bf4d0, 0xc2081d4a20)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 54 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc2081bf0e0, 0xc208336cc0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 55 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc2081be900, 0xc2083378c0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 56 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc2081bf3b0, 0xc2089fd200)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 57 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc2081bfd40, 0xc2081d7a40)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 58 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc2081bf290, 0xc2084a2de0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 59 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc2081bea20, 0xc2081b9f20)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 60 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc2081bf7a0, 0xc208195680)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 61 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc208070c60, 0xc208537a40)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 62 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc2081be5a0, 0xc2082a0b40)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 63 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc2081be630, 0xc20864b800)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 64 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc2081be3f0, 0xc208392ea0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 65 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc2084ee240, 0xc208309e00)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 66 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc2084ee090, 0xc208e5cfc0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 67 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc2084eeab0, 0xc208e022a0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 68 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc2081be750, 0xc208642ea0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 69 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc2084ee6c0, 0xc208188e40)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 70 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc2084ee2d0, 0xc208470a80)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 71 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc2093b7200, 0xc209ce3320)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 72 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc2093b79e0, 0xc2084fa240)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 73 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc209f727e0, 0xc208337f20)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 74 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc209f733b0, 0xc20909a7e0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 75 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc2084ee510, 0xc20909aa80)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 76 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc2093b73b0, 0xc2084fa360)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 77 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc209f72510, 0xc208867680)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 78 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc209f73050, 0xc2091816e0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 79 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc2093b74d0, 0xc2084b8f60)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 80 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc209f72630, 0xc20879b2c0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 81 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc209f73200, 0xc209771800)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 82 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc2084ee480, 0xc208e02060)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 83 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc2084eefc0, 0xc2099291a0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 84 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc209f730e0, 0xc209503b60)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 85 [select, 2 minutes]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).autoflusher(0xc2084ee630, 0xc208d5aa20)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:468 +0x391
created by github.com/influxdb/influxdb/tsdb/engine/b1.func·002
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:133 +0x4ac

goroutine 86 [select]:
github.com/influxdb/influxdb/services/hh.(*Service).retryWrites(0xc20805b2c0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/hh/service.go:98 +0x2e7
created by github.com/influxdb/influxdb/services/hh.(*Service).Open
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/hh/service.go:62 +0xef

goroutine 87 [select, 2 minutes]:
github.com/influxdb/influxdb/services/hh.(*Service).expireWrites(0xc20805b2c0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/hh/service.go:116 +0x2a4
created by github.com/influxdb/influxdb/services/hh.(*Service).Open
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/hh/service.go:63 +0x109

goroutine 88 [chan receive, 2 minutes]:
github.com/influxdb/influxdb/tcp.(*listener).Accept(0xc208034d58, 0x0, 0x0, 0x0, 0x0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tcp/mux.go:117 +0x80
github.com/influxdb/influxdb/cluster.(*Service).serve(0xc2080102a0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/cluster/service.go:81 +0x102
created by github.com/influxdb/influxdb/cluster.(*Service).Open
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/cluster/service.go:58 +0x67

goroutine 89 [select, 2 minutes]:
github.com/influxdb/influxdb/services/precreator.(*Service).runPrecreation(0xc20804ee10)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/precreator/service.go:72 +0x407
created by github.com/influxdb/influxdb/services/precreator.(*Service).Open
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/precreator/service.go:50 +0xcb

goroutine 90 [chan receive, 2 minutes]:
github.com/influxdb/influxdb/tcp.(*listener).Accept(0xc208034d60, 0x0, 0x0, 0x0, 0x0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tcp/mux.go:117 +0x80
github.com/influxdb/influxdb/services/snapshotter.(*Service).serve(0xc20804ef00)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/snapshotter/service.go:68 +0xad
created by github.com/influxdb/influxdb/services/snapshotter.(*Service).Open
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/snapshotter/service.go:46 +0x62

goroutine 91 [IO wait, 2 minutes]:
net.(*pollDesc).Wait(0xc209161020, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc209161020, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).accept(0xc209160fc0, 0x0, 0x7f7b61b66e30, 0xc208842390)
        /usr/local/go/src/net/fd_unix.go:419 +0x40b
net.(*TCPListener).AcceptTCP(0xc2081424d0, 0xc208144700, 0x0, 0x0)
        /usr/local/go/src/net/tcpsock_posix.go:234 +0x4e
net.(*TCPListener).Accept(0xc2081424d0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/tcpsock_posix.go:244 +0x4c
net/http.(*Server).Serve(0xc209cc0060, 0x7f7b61b694a8, 0xc2081424d0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:1728 +0x92
net/http.Serve(0x7f7b61b694a8, 0xc2081424d0, 0x7f7b60084f80, 0xc208842360, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:1606 +0xa1
github.com/influxdb/influxdb/services/admin.(*Service).serve(0xc20804efa0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/admin/service.go:105 +0x147
created by github.com/influxdb/influxdb/services/admin.(*Service).Open
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/admin/service.go:68 +0x431

goroutine 92 [select]:
github.com/influxdb/influxdb/services/continuous_querier.(*Service).backgroundLoop(0xc208010310)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/continuous_querier/service.go:155 +0x3e9
created by github.com/influxdb/influxdb/services/continuous_querier.(*Service).Open
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/continuous_querier/service.go:91 +0x1ed

goroutine 93 [IO wait, 1 minutes]:
net.(*pollDesc).Wait(0xc2091611e0, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc2091611e0, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).accept(0xc209161180, 0x0, 0x7f7b61b66e30, 0xc209daa070)
        /usr/local/go/src/net/fd_unix.go:419 +0x40b
net.(*TCPListener).AcceptTCP(0xc2081424e0, 0xc2091c9dc8, 0x0, 0x0)
        /usr/local/go/src/net/tcpsock_posix.go:234 +0x4e
net.(*TCPListener).Accept(0xc2081424e0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/tcpsock_posix.go:244 +0x4c
net/http.(*Server).Serve(0xc2097712c0, 0x7f7b61b694a8, 0xc2081424e0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:1728 +0x92
net/http.Serve(0x7f7b61b694a8, 0xc2081424e0, 0x7f7b60084f30, 0xc208010380, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:1606 +0xa1
github.com/influxdb/influxdb/services/httpd.(*Service).serve(0xc20804f0e0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/service.go:107 +0x79
created by github.com/influxdb/influxdb/services/httpd.(*Service).Open
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/service.go:75 +0x590

goroutine 94 [select, 2 minutes]:
github.com/influxdb/influxdb/services/retention.(*Service).deleteShardGroups(0xc208072ae0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/retention/service.go:67 +0x433
created by github.com/influxdb/influxdb/services/retention.(*Service).Open
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/retention/service.go:44 +0x67

goroutine 95 [select, 2 minutes]:
github.com/influxdb/influxdb/services/retention.(*Service).deleteShards(0xc208072ae0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/retention/service.go:101 +0x821
created by github.com/influxdb/influxdb/services/retention.(*Service).Open
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/retention/service.go:45 +0x81

goroutine 96 [select, 2 minutes]:
github.com/influxdb/influxdb/cmd/influxd/run.(*Command).monitorServerErrors(0xc208011c00)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/cmd/influxd/run/command.go:135 +0x2da
created by github.com/influxdb/influxdb/cmd/influxd/run.(*Command).Run
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/cmd/influxd/run/command.go:117 +0xd7a

goroutine 98 [chan receive]:
github.com/influxdb/influxdb/services/httpd.(*Handler).serveQuery(0xc208010380, 0x7f7b60085238, 0xc20a4ed680, 0xc209cdfc70, 0x0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:260 +0xa44
github.com/influxdb/influxdb/services/httpd.*Handler.(github.com/influxdb/influxdb/services/httpd.serveQuery)·fm(0x7f7b60085238, 0xc20a4ed680, 0xc209cdfc70, 0x0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:95 +0x4f
github.com/influxdb/influxdb/services/httpd.func·001(0x7f7b60085238, 0xc20a4ed680, 0xc209cdfc70)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:608 +0x78
net/http.HandlerFunc.ServeHTTP(0xc2080e9da0, 0x7f7b60085238, 0xc20a4ed680, 0xc209cdfc70)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·002(0x7f7b60085160, 0xc20a4ed5e0, 0xc209cdfc70)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:666 +0x288
net/http.HandlerFunc.ServeHTTP(0xc2080ea700, 0x7f7b60085160, 0xc20a4ed5e0, 0xc209cdfc70)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·003(0x7f7b60085160, 0xc20a4ed5e0, 0xc209cdfc70)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:675 +0xba
net/http.HandlerFunc.ServeHTTP(0xc2080e9dc0, 0x7f7b60085160, 0xc20a4ed5e0, 0xc209cdfc70)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·004(0x7f7b60085160, 0xc20a4ed5e0, 0xc209cdfc70)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:708 +0x31a
net/http.HandlerFunc.ServeHTTP(0xc2080ea730, 0x7f7b60085160, 0xc20a4ed5e0, 0xc209cdfc70)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·005(0x7f7b60085160, 0xc20a4ed5e0, 0xc209cdfc70)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:718 +0x179
net/http.HandlerFunc.ServeHTTP(0xc2080ea750, 0x7f7b60085160, 0xc20a4ed5e0, 0xc209cdfc70)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·007(0x7f7b60085128, 0xc20873a820, 0xc209cdfc70)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:736 +0x12c
net/http.HandlerFunc.ServeHTTP(0xc2080e9de0, 0x7f7b60085128, 0xc20873a820, 0xc209cdfc70)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/bmizerany/pat.(*PatternServeMux).ServeHTTP(0xc208034c70, 0x7f7b60085128, 0xc20873a820, 0xc209cdfc70)
        /tmp/tmp.bBFDyJej53/src/github.com/bmizerany/pat/mux.go:109 +0x21c
github.com/influxdb/influxdb/services/httpd.(*Handler).ServeHTTP(0xc208010380, 0x7f7b60085128, 0xc20873a820, 0xc209cdfc70)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:167 +0x256
net/http.serverHandler.ServeHTTP(0xc2097712c0, 0x7f7b60085128, 0xc20873a820, 0xc209cdfc70)
        /usr/local/go/src/net/http/server.go:1703 +0x19a
net/http.(*conn).serve(0xc20805a000)
        /usr/local/go/src/net/http/server.go:1204 +0xb57
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 99 [chan receive]:
github.com/influxdb/influxdb/services/httpd.(*Handler).serveQuery(0xc208010380, 0x7f7b60085238, 0xc20a4ed140, 0xc20919dd40, 0x0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:260 +0xa44
github.com/influxdb/influxdb/services/httpd.*Handler.(github.com/influxdb/influxdb/services/httpd.serveQuery)·fm(0x7f7b60085238, 0xc20a4ed140, 0xc20919dd40, 0x0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:95 +0x4f
github.com/influxdb/influxdb/services/httpd.func·001(0x7f7b60085238, 0xc20a4ed140, 0xc20919dd40)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:608 +0x78
net/http.HandlerFunc.ServeHTTP(0xc2080e9da0, 0x7f7b60085238, 0xc20a4ed140, 0xc20919dd40)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·002(0x7f7b60085160, 0xc20a4ed0a0, 0xc20919dd40)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:666 +0x288
net/http.HandlerFunc.ServeHTTP(0xc2080ea700, 0x7f7b60085160, 0xc20a4ed0a0, 0xc20919dd40)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·003(0x7f7b60085160, 0xc20a4ed0a0, 0xc20919dd40)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:675 +0xba
net/http.HandlerFunc.ServeHTTP(0xc2080e9dc0, 0x7f7b60085160, 0xc20a4ed0a0, 0xc20919dd40)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·004(0x7f7b60085160, 0xc20a4ed0a0, 0xc20919dd40)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:708 +0x31a
net/http.HandlerFunc.ServeHTTP(0xc2080ea730, 0x7f7b60085160, 0xc20a4ed0a0, 0xc20919dd40)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·005(0x7f7b60085160, 0xc20a4ed0a0, 0xc20919dd40)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:718 +0x179
net/http.HandlerFunc.ServeHTTP(0xc2080ea750, 0x7f7b60085160, 0xc20a4ed0a0, 0xc20919dd40)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·007(0x7f7b60085128, 0xc208d03e00, 0xc20919dd40)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:736 +0x12c
net/http.HandlerFunc.ServeHTTP(0xc2080e9de0, 0x7f7b60085128, 0xc208d03e00, 0xc20919dd40)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/bmizerany/pat.(*PatternServeMux).ServeHTTP(0xc208034c70, 0x7f7b60085128, 0xc208d03e00, 0xc20919dd40)
        /tmp/tmp.bBFDyJej53/src/github.com/bmizerany/pat/mux.go:109 +0x21c
github.com/influxdb/influxdb/services/httpd.(*Handler).ServeHTTP(0xc208010380, 0x7f7b60085128, 0xc208d03e00, 0xc20919dd40)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:167 +0x256
net/http.serverHandler.ServeHTTP(0xc2097712c0, 0x7f7b60085128, 0xc208d03e00, 0xc20919dd40)
        /usr/local/go/src/net/http/server.go:1703 +0x19a
net/http.(*conn).serve(0xc20805a0a0)
        /usr/local/go/src/net/http/server.go:1204 +0xb57
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 97 [chan receive]:
github.com/influxdb/influxdb/services/httpd.(*Handler).serveQuery(0xc208010380, 0x7f7b60085238, 0xc208e58b20, 0xc209ac1790, 0x0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:260 +0xa44
github.com/influxdb/influxdb/services/httpd.*Handler.(github.com/influxdb/influxdb/services/httpd.serveQuery)·fm(0x7f7b60085238, 0xc208e58b20, 0xc209ac1790, 0x0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:95 +0x4f
github.com/influxdb/influxdb/services/httpd.func·001(0x7f7b60085238, 0xc208e58b20, 0xc209ac1790)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:608 +0x78
net/http.HandlerFunc.ServeHTTP(0xc2080e9da0, 0x7f7b60085238, 0xc208e58b20, 0xc209ac1790)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·002(0x7f7b60085160, 0xc208e58620, 0xc209ac1790)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:666 +0x288
net/http.HandlerFunc.ServeHTTP(0xc2080ea700, 0x7f7b60085160, 0xc208e58620, 0xc209ac1790)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·003(0x7f7b60085160, 0xc208e58620, 0xc209ac1790)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:675 +0xba
net/http.HandlerFunc.ServeHTTP(0xc2080e9dc0, 0x7f7b60085160, 0xc208e58620, 0xc209ac1790)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·004(0x7f7b60085160, 0xc208e58620, 0xc209ac1790)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:708 +0x31a
net/http.HandlerFunc.ServeHTTP(0xc2080ea730, 0x7f7b60085160, 0xc208e58620, 0xc209ac1790)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·005(0x7f7b60085160, 0xc208e58620, 0xc209ac1790)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:718 +0x179
net/http.HandlerFunc.ServeHTTP(0xc2080ea750, 0x7f7b60085160, 0xc208e58620, 0xc209ac1790)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·007(0x7f7b60085128, 0xc20826e0a0, 0xc209ac1790)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:736 +0x12c
net/http.HandlerFunc.ServeHTTP(0xc2080e9de0, 0x7f7b60085128, 0xc20826e0a0, 0xc209ac1790)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/bmizerany/pat.(*PatternServeMux).ServeHTTP(0xc208034c70, 0x7f7b60085128, 0xc20826e0a0, 0xc209ac1790)
        /tmp/tmp.bBFDyJej53/src/github.com/bmizerany/pat/mux.go:109 +0x21c
github.com/influxdb/influxdb/services/httpd.(*Handler).ServeHTTP(0xc208010380, 0x7f7b60085128, 0xc20826e0a0, 0xc209ac1790)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:167 +0x256
net/http.serverHandler.ServeHTTP(0xc2097712c0, 0x7f7b60085128, 0xc20826e0a0, 0xc209ac1790)
        /usr/local/go/src/net/http/server.go:1703 +0x19a
net/http.(*conn).serve(0xc2094fa000)
        /usr/local/go/src/net/http/server.go:1204 +0xb57
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 179 [IO wait]:
net.(*pollDesc).Wait(0xc2086a9a30, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc2086a9a30, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc2086a99d0, 0xc209efb000, 0x1000, 0x1000, 0x0, 0x7f7b61b66e30, 0xc208d60680)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc208142318, 0xc209efb000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
net/http.(*liveSwitchReader).Read(0xc20945fb28, 0xc209efb000, 0x1000, 0x1000, 0x2600000000adf8b0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc20a1c91c0, 0xc209efb000, 0x1000, 0x1000, 0xb02f90, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc209cda1e0)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc209cda1e0, 0xa, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc209cda1e0, 0x0, 0x0, 0x0, 0xc207db3500, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc20a4ca000, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc20a4ca000, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc209cda1e0, 0xc209b200d0, 0x0, 0x0)
        /usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc20945fae0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc20945fae0)
        /usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 100 [IO wait]:
net.(*pollDesc).Wait(0xc209b02290, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc209b02290, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc209b02230, 0xc209f7f000, 0x1000, 0x1000, 0x0, 0x7f7b61b66e30, 0xc2098202c8)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc209432030, 0xc209f7f000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
net/http.(*liveSwitchReader).Read(0xc20805a188, 0xc209f7f000, 0x1000, 0x1000, 0xadf8b0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc2094457a0, 0xc209f7f000, 0x1000, 0x1000, 0xb02f90, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc209cc0180)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc209cc0180, 0xa, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc209cc0180, 0x0, 0x0, 0x0, 0xc20876d600, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc2089c2300, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc2089c2300, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc209cc0180, 0xc20984fe10, 0x0, 0x0)
        /usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc20805a140, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc20805a140)
        /usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 131 [IO wait]:
net.(*pollDesc).Wait(0xc209afa990, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc209afa990, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc209afa930, 0xc209fc2000, 0x1000, 0x1000, 0x0, 0x7f7b61b66e30, 0xc209b78e18)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc2081425e0, 0xc209fc2000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
net/http.(*liveSwitchReader).Read(0xc2094fa2c8, 0xc209fc2000, 0x1000, 0x1000, 0xadf8b0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc208c3c7c0, 0xc209fc2000, 0x1000, 0x1000, 0xb02f90, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc208d5b5c0)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc208d5b5c0, 0xa, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc208d5b5c0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc20b89a030, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc20b89a030, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc208d5b5c0, 0xc2084bdd40, 0x0, 0x0)
        /usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc2094fa280, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc2094fa280)
        /usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 20 [IO wait]:
net.(*pollDesc).Wait(0xc208d30990, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc208d30990, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc208d30930, 0xc2089f9000, 0x1000, 0x1000, 0x0, 0x7f7b61b66e30, 0xc208b8d490)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc20992a288, 0xc2089f9000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
net/http.(*liveSwitchReader).Read(0xc20826eae8, 0xc2089f9000, 0x1000, 0x1000, 0xc20b130401, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc208e30a20, 0xc2089f9000, 0x1000, 0x1000, 0xc208e34480, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc209442ae0)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc209442ae0, 0x100a, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc209442ae0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc20a3298c0, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc20a3298c0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc209442ae0, 0xc209cd0340, 0x0, 0x0)
        /usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc20826eaa0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc20826eaa0)
        /usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 147 [IO wait]:
net.(*pollDesc).Wait(0xc208f6e0d0, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc208f6e0d0, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc208f6e070, 0xc20982e000, 0x1000, 0x1000, 0x0, 0x7f7b61b66e30, 0xc20ce9cb60)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc208f70008, 0xc20982e000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
net/http.(*liveSwitchReader).Read(0xc208f720e8, 0xc20982e000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc20979c1c0, 0xc20982e000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc209928e40)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc209928e40, 0xc20b1fdb0a, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc209928e40, 0x0, 0x0, 0x0, 0xc207b10600, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc20cef9980, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc20cef9980, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc209928e40, 0xc209ed2340, 0x0, 0x0)
        /usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc208f720a0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc208f720a0)
        /usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 107 [IO wait]:
net.(*pollDesc).Wait(0xc2094f7a30, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc2094f7a30, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc2094f79d0, 0xc208d7b000, 0x1000, 0x1000, 0x0, 0x7f7b61b66e30, 0xc20cc50758)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc209432998, 0xc208d7b000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
net/http.(*liveSwitchReader).Read(0xc20945e9a8, 0xc208d7b000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc209460de0, 0xc208d7b000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc20967b3e0)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc20967b3e0, 0xc20b8ddb0a, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc20967b3e0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc20be23a10, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc20be23a10, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc20967b3e0, 0xc20a83a680, 0x0, 0x0)
        /usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc20945e960, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc20945e960)
        /usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 148 [IO wait]:
net.(*pollDesc).Wait(0xc208f6e140, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc208f6e140, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc208f6e0e0, 0xc20983a000, 0x1000, 0x1000, 0x0, 0x7f7b61b66e30, 0xc2092ab2a8)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc208f70010, 0xc20983a000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
net/http.(*liveSwitchReader).Read(0xc208f72188, 0xc20983a000, 0x1000, 0x1000, 0x2600000000000002, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc20979c300, 0xc20983a000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc209928ea0)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc209928ea0, 0xa, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc209928ea0, 0x0, 0x0, 0x0, 0xc207c86700, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc20b7989f0, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc20b7989f0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc209928ea0, 0xc20c050000, 0x0, 0x0)
        /usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc208f72140, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc208f72140)
        /usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 106 [IO wait]:
net.(*pollDesc).Wait(0xc2094f79c0, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc2094f79c0, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc2094f7960, 0xc209881000, 0x1000, 0x1000, 0x0, 0x7f7b61b66e30, 0xc2098afed8)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc209432990, 0xc209881000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
net/http.(*liveSwitchReader).Read(0xc20945e908, 0xc209881000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc209460da0, 0xc209881000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc20967b380)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc20967b380, 0xc20a45fb0a, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc20967b380, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc20a4d8c00, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc20a4d8c00, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc20967b380, 0xc209430d00, 0x0, 0x0)
        /usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc20945e8c0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc20945e8c0)
        /usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 122 [select]:
github.com/influxdb/influxdb/cluster.(*PointsWriter).WritePoints(0xc208010230, 0xc20aa630c0, 0x0, 0x0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/cluster/points_writer.go:210 +0x634
github.com/influxdb/influxdb/services/httpd.(*Handler).serveWriteJSON(0xc208010380, 0x7f7b60085238, 0xc209a740a0, 0xc20a83a0d0, 0xc20bb28000, 0x50e9, 0x7e00, 0x0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:385 +0xc6f
github.com/influxdb/influxdb/services/httpd.(*Handler).serveWriteLine(0xc208010380, 0x7f7b60085238, 0xc209a740a0, 0xc20a83a0d0, 0xc20bb28000, 0x50e9, 0x7e00, 0x0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:411 +0xb2
github.com/influxdb/influxdb/services/httpd.(*Handler).serveWrite(0xc208010380, 0x7f7b60085238, 0xc209a740a0, 0xc20a83a0d0, 0x0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:331 +0x69d
github.com/influxdb/influxdb/services/httpd.*Handler.(github.com/influxdb/influxdb/services/httpd.serveWrite)·fm(0x7f7b60085238, 0xc209a740a0, 0xc20a83a0d0, 0x0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:103 +0x4f
github.com/influxdb/influxdb/services/httpd.func·001(0x7f7b60085238, 0xc209a740a0, 0xc20a83a0d0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:608 +0x78
net/http.HandlerFunc.ServeHTTP(0xc2080e9e80, 0x7f7b60085238, 0xc209a740a0, 0xc20a83a0d0)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·002(0x7f7b60085160, 0xc209a74040, 0xc20a83a0d0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:666 +0x288
net/http.HandlerFunc.ServeHTTP(0xc2080ea810, 0x7f7b60085160, 0xc209a74040, 0xc20a83a0d0)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·003(0x7f7b60085160, 0xc209a74040, 0xc20a83a0d0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:675 +0xba
net/http.HandlerFunc.ServeHTTP(0xc2080e9ea0, 0x7f7b60085160, 0xc209a74040, 0xc20a83a0d0)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·004(0x7f7b60085160, 0xc209a74040, 0xc20a83a0d0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:708 +0x31a
net/http.HandlerFunc.ServeHTTP(0xc2080ea840, 0x7f7b60085160, 0xc209a74040, 0xc20a83a0d0)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·005(0x7f7b60085160, 0xc209a74040, 0xc20a83a0d0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:718 +0x179
net/http.HandlerFunc.ServeHTTP(0xc2080ea860, 0x7f7b60085160, 0xc209a74040, 0xc20a83a0d0)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·007(0x7f7b60085128, 0xc20a178000, 0xc20a83a0d0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:736 +0x12c
net/http.HandlerFunc.ServeHTTP(0xc2080e9ec0, 0x7f7b60085128, 0xc20a178000, 0xc20a83a0d0)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/bmizerany/pat.(*PatternServeMux).ServeHTTP(0xc208034c70, 0x7f7b60085128, 0xc20a178000, 0xc20a83a0d0)
        /tmp/tmp.bBFDyJej53/src/github.com/bmizerany/pat/mux.go:109 +0x21c
github.com/influxdb/influxdb/services/httpd.(*Handler).ServeHTTP(0xc208010380, 0x7f7b60085128, 0xc20a178000, 0xc20a83a0d0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:167 +0x256
net/http.serverHandler.ServeHTTP(0xc2097712c0, 0x7f7b60085128, 0xc20a178000, 0xc20a83a0d0)
        /usr/local/go/src/net/http/server.go:1703 +0x19a
net/http.(*conn).serve(0xc208d5fd60)
        /usr/local/go/src/net/http/server.go:1204 +0xb57
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 157 [IO wait, 2 minutes]:
net.(*pollDesc).Wait(0xc209acaa00, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc209acaa00, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc209aca9a0, 0xc209d82000, 0x1000, 0x1000, 0x0, 0x7f7b61b66e30, 0xc209934748)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc208142300, 0xc209d82000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
net/http.(*liveSwitchReader).Read(0xc20873a048, 0xc209d82000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc2090d89a0, 0xc209d82000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc209181380)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc209181380, 0xc209fd3b0a, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc209181380, 0x0, 0x0, 0x0, 0xc20a1ddc00, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc2091a8c30, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc2091a8c30, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc209181380, 0xc209bd84e0, 0x0, 0x0)
        /usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc20873a000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc20873a000)
        /usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 108 [IO wait]:
net.(*pollDesc).Wait(0xc2094f7aa0, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc2094f7aa0, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc2094f7a40, 0xc2090a5000, 0x1000, 0x1000, 0x0, 0x7f7b61b66e30, 0xc2090d5540)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc2094329a0, 0xc2090a5000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
net/http.(*liveSwitchReader).Read(0xc20945ea48, 0xc2090a5000, 0x1000, 0x1000, 0x12e0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc209460e20, 0xc2090a5000, 0x1000, 0x1000, 0x12e0, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc20967b440)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).Read(0xc20967b440, 0xc20979b084, 0xd7c, 0xd7c, 0x564, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:174 +0x26c
io.(*LimitedReader).Read(0xc20c084f60, 0xc20979b084, 0xd7c, 0xd7c, 0x41638a, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
net/http.(*body).readLocked(0xc2093b9280, 0xc20979b084, 0xd7c, 0xd7c, 0x564, 0x0, 0x0)
        /usr/local/go/src/net/http/transfer.go:584 +0x7a
net/http.(*body).Read(0xc2093b9280, 0xc20979b084, 0xd7c, 0xd7c, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/transfer.go:579 +0x115
bytes.(*Buffer).ReadFrom(0xc20a523570, 0x7f7b600869c0, 0xc2093b9280, 0x3084, 0x0, 0x0)
        /usr/local/go/src/bytes/buffer.go:169 +0x25a
io/ioutil.readAll(0x7f7b600869c0, 0xc2093b9280, 0x200, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/io/ioutil/ioutil.go:33 +0x1b0
io/ioutil.ReadAll(0x7f7b600869c0, 0xc2093b9280, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/io/ioutil/ioutil.go:42 +0x68
github.com/influxdb/influxdb/services/httpd.(*Handler).serveWrite(0xc208010380, 0x7f7b60085238, 0xc20c084fe0, 0xc20871a680, 0x0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:315 +0x23b
github.com/influxdb/influxdb/services/httpd.*Handler.(github.com/influxdb/influxdb/services/httpd.serveWrite)·fm(0x7f7b60085238, 0xc20c084fe0, 0xc20871a680, 0x0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:103 +0x4f
github.com/influxdb/influxdb/services/httpd.func·001(0x7f7b60085238, 0xc20c084fe0, 0xc20871a680)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:608 +0x78
net/http.HandlerFunc.ServeHTTP(0xc2080e9e80, 0x7f7b60085238, 0xc20c084fe0, 0xc20871a680)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·002(0x7f7b60085160, 0xc20c084f80, 0xc20871a680)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:666 +0x288
net/http.HandlerFunc.ServeHTTP(0xc2080ea810, 0x7f7b60085160, 0xc20c084f80, 0xc20871a680)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·003(0x7f7b60085160, 0xc20c084f80, 0xc20871a680)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:675 +0xba
net/http.HandlerFunc.ServeHTTP(0xc2080e9ea0, 0x7f7b60085160, 0xc20c084f80, 0xc20871a680)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·004(0x7f7b60085160, 0xc20c084f80, 0xc20871a680)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:708 +0x31a
net/http.HandlerFunc.ServeHTTP(0xc2080ea840, 0x7f7b60085160, 0xc20c084f80, 0xc20871a680)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·005(0x7f7b60085160, 0xc20c084f80, 0xc20871a680)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:718 +0x179
net/http.HandlerFunc.ServeHTTP(0xc2080ea860, 0x7f7b60085160, 0xc20c084f80, 0xc20871a680)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·007(0x7f7b60085128, 0xc20a1780a0, 0xc20871a680)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:736 +0x12c
net/http.HandlerFunc.ServeHTTP(0xc2080e9ec0, 0x7f7b60085128, 0xc20a1780a0, 0xc20871a680)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/bmizerany/pat.(*PatternServeMux).ServeHTTP(0xc208034c70, 0x7f7b60085128, 0xc20a1780a0, 0xc20871a680)
        /tmp/tmp.bBFDyJej53/src/github.com/bmizerany/pat/mux.go:109 +0x21c
github.com/influxdb/influxdb/services/httpd.(*Handler).ServeHTTP(0xc208010380, 0x7f7b60085128, 0xc20a1780a0, 0xc20871a680)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/services/httpd/handler.go:167 +0x256
net/http.serverHandler.ServeHTTP(0xc2097712c0, 0x7f7b60085128, 0xc20a1780a0, 0xc20871a680)
        /usr/local/go/src/net/http/server.go:1703 +0x19a
net/http.(*conn).serve(0xc20945ea00)
        /usr/local/go/src/net/http/server.go:1204 +0xb57
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 434 [IO wait]:
net.(*pollDesc).Wait(0xc209908a70, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc209908a70, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc209908a10, 0xc209019000, 0x1000, 0x1000, 0x0, 0x7f7b61b66e30, 0xc2099a5df8)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc209433ce8, 0xc209019000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
net/http.(*liveSwitchReader).Read(0xc208d02408, 0xc209019000, 0x1000, 0x1000, 0xadf8b0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc209687120, 0xc209019000, 0x1000, 0x1000, 0xb02f90, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc2094fca80)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc2094fca80, 0xa, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc2094fca80, 0x0, 0x0, 0x0, 0xc207c45b00, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc20bba4c30, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc20bba4c30, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc2094fca80, 0xc20c051d40, 0x0, 0x0)
        /usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc208d023c0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc208d023c0)
        /usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 444 [IO wait, 2 minutes]:
net.(*pollDesc).Wait(0xc20935ffe0, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc20935ffe0, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc20935ff80, 0xc209876000, 0x1000, 0x1000, 0x0, 0x7f7b61b66e30, 0xc209e360b0)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc2087523a8, 0xc209876000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
net/http.(*liveSwitchReader).Read(0xc20826fd08, 0xc209876000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc209aafa80, 0xc209876000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc20bed2360)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc20bed2360, 0xc2098e9b0a, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc20bed2360, 0x0, 0x0, 0x0, 0xc20921a800, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc209071ce0, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc209071ce0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc20bed2360, 0xc208f6c820, 0x0, 0x0)
        /usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc20826fcc0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc20826fcc0)
        /usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 2889 [IO wait]:
net.(*pollDesc).Wait(0xc209872060, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc209872060, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc209872000, 0xc20aa76000, 0x1000, 0x1000, 0x0, 0x7f7b61b66e30, 0xc20ad58430)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc209642008, 0xc20aa76000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
net/http.(*liveSwitchReader).Read(0xc20826e048, 0xc20aa76000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc209eea060, 0xc20aa76000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc20aac0060)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc20aac0060, 0xc20bc29b0a, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc20aac0060, 0x0, 0x0, 0x0, 0xc208b85d00, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc20a4d78f0, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc20a4d78f0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc20aac0060, 0xc2089fb1e0, 0x0, 0x0)
        /usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc20826e000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc20826e000)
        /usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 154 [IO wait]:
net.(*pollDesc).Wait(0xc2084ab9c0, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc2084ab9c0, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc2084ab960, 0xc209d8b000, 0x1000, 0x1000, 0x0, 0x7f7b61b66e30, 0xc208e66870)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc2094322b8, 0xc209d8b000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
net/http.(*liveSwitchReader).Read(0xc209df3448, 0xc209d8b000, 0x1000, 0x1000, 0xc20984b201, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc20a1b63a0, 0xc209d8b000, 0x1000, 0x1000, 0xc20a465440, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc208272f60)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc208272f60, 0x100a, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc208272f60, 0x0, 0x0, 0x0, 0xc207bc4300, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc20c3bc090, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc20c3bc090, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc208272f60, 0xc20982a8f0, 0x0, 0x0)
        /usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc209df3400, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc209df3400)
        /usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 170 [IO wait]:
net.(*pollDesc).Wait(0xc20a17d8e0, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc20a17d8e0, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc20a17d880, 0xc20a17e000, 0x1000, 0x1000, 0x0, 0x7f7b61b66e30, 0xc209935fe0)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc209e18258, 0xc20a17e000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
net/http.(*liveSwitchReader).Read(0xc20873afe8, 0xc20a17e000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc2099c8e80, 0xc20a17e000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc208e032c0)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc208e032c0, 0xc208eabb0a, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc208e032c0, 0x0, 0x0, 0x0, 0xc20bbeda00, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc20a32cea0, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc20a32cea0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc208e032c0, 0xc209b20c30, 0x0, 0x0)
        /usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc20873afa0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc20873afa0)
        /usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 398 [IO wait]:
net.(*pollDesc).Wait(0xc209f54f40, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc209f54f40, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc209f54ee0, 0xc20aa77000, 0x1000, 0x1000, 0x0, 0x7f7b61b66e30, 0xc209906f00)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc20aa34d88, 0xc20aa77000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
net/http.(*liveSwitchReader).Read(0xc20a178688, 0xc20aa77000, 0x1000, 0x1000, 0xadf8b0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc20a1e2f40, 0xc20aa77000, 0x1000, 0x1000, 0xb02f90, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc20b066ae0)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc20b066ae0, 0xa, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc20b066ae0, 0x0, 0x0, 0x0, 0xc208a0ec00, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc20b9d3cb0, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc20b9d3cb0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc20b066ae0, 0xc20982be10, 0x0, 0x0)
        /usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc20a178640, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc20a178640)
        /usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 230 [IO wait, 1 minutes]:
net.(*pollDesc).Wait(0xc20bb97b10, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc20bb97b10, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc20bb97ab0, 0xc209c2c000, 0x1000, 0x1000, 0x0, 0x7f7b61b66e30, 0xc2098a8ae0)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc208753818, 0xc209c2c000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
net/http.(*liveSwitchReader).Read(0xc20873a408, 0xc209c2c000, 0x1000, 0x1000, 0xadf8b0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc209c266e0, 0xc209c2c000, 0x1000, 0x1000, 0xb02f90, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc209442f60)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc209442f60, 0xa, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc209442f60, 0x0, 0x0, 0x0, 0xc207e71b00, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc2098e4c30, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc2098e4c30, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc209442f60, 0xc20919c750, 0x0, 0x0)
        /usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc20873a3c0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc20873a3c0)
        /usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 369 [IO wait]:
net.(*pollDesc).Wait(0xc209908a00, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc209908a00, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc2099089a0, 0xc209e43000, 0x1000, 0x1000, 0x0, 0x7f7b61b66e30, 0xc209b60140)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc209433ce0, 0xc209e43000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
net/http.(*liveSwitchReader).Read(0xc208d02368, 0xc209e43000, 0x1000, 0x1000, 0xadf8b0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc2096870e0, 0xc209e43000, 0x1000, 0x1000, 0xb02f90, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc2094fc9c0)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc2094fc9c0, 0xa, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc2094fc9c0, 0x0, 0x0, 0x0, 0xc207d96600, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc20a699920, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc20a699920, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc2094fc9c0, 0xc20984fa00, 0x0, 0x0)
        /usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc208d02320, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc208d02320)
        /usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 270 [IO wait]:
net.(*pollDesc).Wait(0xc20935ea00, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc20935ea00, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc20935e9a0, 0xc209368000, 0x1000, 0x1000, 0x0, 0x7f7b61b66e30, 0xc209cfe6f8)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc208034478, 0xc209368000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
net/http.(*liveSwitchReader).Read(0xc20a0a7768, 0xc209368000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc209797100, 0xc209368000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc20aac1f20)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc20aac1f20, 0xc2099a7b0a, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc20aac1f20, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc20c06f650, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc20c06f650, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc20aac1f20, 0xc209ad8dd0, 0x0, 0x0)
        /usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc20a0a7720, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc20a0a7720)
        /usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 231 [IO wait]:
net.(*pollDesc).Wait(0xc20bb97b80, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc20bb97b80, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc20bb97b20, 0xc20aad6000, 0x1000, 0x1000, 0x0, 0x7f7b61b66e30, 0xc2080ebd38)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc208753820, 0xc20aad6000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
net/http.(*liveSwitchReader).Read(0xc20873a4a8, 0xc20aad6000, 0x1000, 0x1000, 0xadf8b0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc209c26720, 0xc20aad6000, 0x1000, 0x1000, 0xb02f90, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc209442fc0)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc209442fc0, 0xa, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc209442fc0, 0x0, 0x0, 0x0, 0xc207f08700, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc208f78000, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc208f78000, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc209442fc0, 0xc208e5a4e0, 0x0, 0x0)
        /usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc20873a460, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc20873a460)
        /usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 503 [IO wait, 2 minutes]:
net.(*pollDesc).Wait(0xc2098734f0, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc2098734f0, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc209873490, 0xc209874000, 0x1000, 0x1000, 0x0, 0x7f7b61b66e30, 0xc209705300)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc208142678, 0xc209874000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
net/http.(*liveSwitchReader).Read(0xc209f3c0e8, 0xc209874000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc209f39200, 0xc209874000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc2098aa000)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc2098aa000, 0xc209ec7b0a, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc2098aa000, 0x0, 0x0, 0x0, 0xc20bb39700, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc2091a9290, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc2091a9290, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc2098aa000, 0xc208f6c000, 0x0, 0x0)
        /usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc209f3c0a0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc209f3c0a0)
        /usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 504 [IO wait, 2 minutes]:
net.(*pollDesc).Wait(0xc209873560, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc209873560, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc209873500, 0xc209878000, 0x1000, 0x1000, 0x0, 0x7f7b61b66e30, 0xc2091036f0)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc208142680, 0xc209878000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
net/http.(*liveSwitchReader).Read(0xc209f3c188, 0xc209878000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc209f39240, 0xc209878000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc2098aa060)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc2098aa060, 0xc2099c1b0a, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc2098aa060, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc20acbd710, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc20acbd710, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc2098aa060, 0xc2084bc5b0, 0x0, 0x0)
        /usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc209f3c140, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc209f3c140)
        /usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 497 [IO wait]:
net.(*pollDesc).Wait(0xc2090fe300, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc2090fe300, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc2090fe2a0, 0xc20a6c1000, 0x1000, 0x1000, 0x0, 0x7f7b61b66e30, 0xc2090d02b0)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc208142398, 0xc20a6c1000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
net/http.(*liveSwitchReader).Read(0xc20945fc68, 0xc20a6c1000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc209f393e0, 0xc20a6c1000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc209cc07e0)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc209cc07e0, 0xc208d3db0a, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc209cc07e0, 0x0, 0x0, 0x0, 0xc20877b400, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc2087ebb90, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc2087ebb90, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc209cc07e0, 0xc209deeb60, 0x0, 0x0)
        /usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc20945fc20, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc20945fc20)
        /usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 455 [IO wait]:
net.(*pollDesc).Wait(0xc20aa3d020, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc20aa3d020, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc20aa3cfc0, 0xc2096b2000, 0x1000, 0x1000, 0x0, 0x7f7b61b66e30, 0xc20947e110)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc208f70360, 0xc2096b2000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
net/http.(*liveSwitchReader).Read(0xc20a0a6fe8, 0xc2096b2000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc20a4b2140, 0xc2096b2000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc2084b97a0)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc2084b97a0, 0xc20a0c5b0a, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc2084b97a0, 0x0, 0x0, 0x0, 0xc208708a00, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc208716870, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc208716870, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc2084b97a0, 0xc209ad95f0, 0x0, 0x0)
        /usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc20a0a6fa0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc20a0a6fa0)
        /usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 511 [IO wait]:
net.(*pollDesc).Wait(0xc20bec9100, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc20bec9100, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc20bec90a0, 0xc209d05000, 0x1000, 0x1000, 0x0, 0x7f7b61b66e30, 0xc2098d3230)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc208752038, 0xc209d05000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
net/http.(*liveSwitchReader).Read(0xc2094fa0e8, 0xc209d05000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc209decce0, 0xc209d05000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc20bf4b380)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc20bf4b380, 0xc2094bdb0a, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc20bf4b380, 0x0, 0x0, 0x0, 0xc208708100, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc2089c3260, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc2089c3260, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc20bf4b380, 0xc209ad89c0, 0x0, 0x0)
        /usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc2094fa0a0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc2094fa0a0)
        /usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 512 [IO wait]:
net.(*pollDesc).Wait(0xc20bec93a0, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc20bec93a0, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc20bec9340, 0xc2086e7000, 0x1000, 0x1000, 0x0, 0x7f7b61b66e30, 0xc209734c50)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc208752040, 0xc2086e7000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
net/http.(*liveSwitchReader).Read(0xc2094fa368, 0xc2086e7000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc209decec0, 0xc2086e7000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc20bf4b4a0)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc20bf4b4a0, 0xc20936db0a, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc20bf4b4a0, 0x0, 0x0, 0x0, 0xc20a367c00, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc20acea030, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc20acea030, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc20bf4b4a0, 0xc2089fa0d0, 0x0, 0x0)
        /usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc2094fa320, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc2094fa320)
        /usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 6249 [chan receive]:
github.com/influxdb/influxdb/tsdb.(*QueryExecutor).executeSelectStatement(0xc20806db80, 0x2, 0xc20b056780, 0xc2096e1f20, 0x2710, 0x0, 0x0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/query_executor.go:265 +0xe1
github.com/influxdb/influxdb/tsdb.func·008()
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/query_executor.go:146 +0x6bd
created by github.com/influxdb/influxdb/tsdb.(*QueryExecutor).ExecuteQuery
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/query_executor.go:196 +0x1f5

goroutine 521 [IO wait, 2 minutes]:
net.(*pollDesc).Wait(0xc20972bdb0, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc20972bdb0, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc20972bd50, 0xc209356000, 0x1000, 0x1000, 0x0, 0x7f7b61b66e30, 0xc208762f80)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc209e182a8, 0xc209356000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
net/http.(*liveSwitchReader).Read(0xc2098ad948, 0xc209356000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc209c02280, 0xc209356000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc2091c2f00)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc2091c2f00, 0xc2086fdb0a, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc2091c2f00, 0x0, 0x0, 0x0, 0xc20851e500, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc209f5c480, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc209f5c480, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc2091c2f00, 0xc209cdf930, 0x0, 0x0)
        /usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc2098ad900, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc2098ad900)
        /usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 554 [IO wait, 2 minutes]:
net.(*pollDesc).Wait(0xc2088c83e0, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc2088c83e0, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc2088c8380, 0xc209743000, 0x1000, 0x1000, 0x0, 0x7f7b61b66e30, 0xc2098a1ca8)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc2081421b8, 0xc209743000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
net/http.(*liveSwitchReader).Read(0xc2098ac2c8, 0xc209743000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc20b0e0380, 0xc209743000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc209cc03c0)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc209cc03c0, 0xc20a4fbb0a, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc209cc03c0, 0x0, 0x0, 0x0, 0xc207f8cb00, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc208734bd0, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc208734bd0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc209cc03c0, 0xc209ac0b60, 0x0, 0x0)
        /usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc2098ac280, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc2098ac280)
        /usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 692 [IO wait, 2 minutes]:
net.(*pollDesc).Wait(0xc20c0121b0, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc20c0121b0, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc20c012150, 0xc209d04000, 0x1000, 0x1000, 0x0, 0x7f7b61b66e30, 0xc209934bd8)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc208752000, 0xc209d04000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
net/http.(*liveSwitchReader).Read(0xc2098ac048, 0xc209d04000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc20c084020, 0xc209d04000, 0x1000, 0x1000, 0x2, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc20bf9e000)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc20bf9e000, 0xc208e9fb0a, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc20bf9e000, 0x0, 0x0, 0x0, 0xc20851ef00, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc20afe6ba0, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc20afe6ba0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc20bf9e000, 0xc209cdfd40, 0x0, 0x0)
        /usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc2098ac000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc2098ac000)
        /usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 6306 [runnable]:
github.com/influxdb/influxdb/tsdb/engine/b1.(*byteSlices).Less(0xc20a898ca0, 0x17c, 0x183, 0x100)
        <autogenerated>:58
sort.doPivot(0x7f7b60086dc8, 0xc20a898ca0, 0x17c, 0x18d, 0x18d, 0x17c)
        /usr/local/go/src/sort/sort.go:129 +0x434
sort.quickSort(0x7f7b60086dc8, 0xc20a898ca0, 0x17c, 0x18d, 0xf)
        /usr/local/go/src/sort/sort.go:173 +0xa9
sort.quickSort(0x7f7b60086dc8, 0xc20a898ca0, 0x15f, 0x18d, 0x10)
        /usr/local/go/src/sort/sort.go:180 +0x178
sort.quickSort(0x7f7b60086dc8, 0xc20a898ca0, 0x12f, 0x18d, 0x11)
        /usr/local/go/src/sort/sort.go:180 +0x178
sort.quickSort(0x7f7b60086dc8, 0xc20a898ca0, 0x0, 0x25d, 0x14)
        /usr/local/go/src/sort/sort.go:180 +0x178
sort.Sort(0x7f7b60086dc8, 0xc20a898ca0)
        /usr/local/go/src/sort/sort.go:200 +0x7b
github.com/influxdb/influxdb/tsdb/engine/b1.func·005(0x0, 0x0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:304 +0xa1c
github.com/influxdb/influxdb/tsdb/engine/b1.(*Engine).WritePoints(0xc2084ee2d0, 0xc20a1b9000, 0x4e, 0x80, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/engine/b1/b1.go:312 +0xef
github.com/influxdb/influxdb/tsdb.(*Shard).WritePoints(0xc20800de80, 0xc20a1b9000, 0x4e, 0x80, 0x0, 0x0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/shard.go:197 +0x3ba
github.com/influxdb/influxdb/tsdb.(*Store).WriteToShard(0xc208072720, 0x85, 0xc20a1b9000, 0x4e, 0x80, 0x0, 0x0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/store.go:284 +0xf7
github.com/influxdb/influxdb/cluster.func·002(0x85, 0x1, 0xc20a1b9000, 0x4e, 0x80)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/cluster/points_writer.go:241 +0xfc
created by github.com/influxdb/influxdb/cluster.(*PointsWriter).writeToShard
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/cluster/points_writer.go:271 +0x30b

goroutine 6250 [chan receive]:
github.com/influxdb/influxdb/tsdb.(*QueryExecutor).executeSelectStatement(0xc20806db80, 0x2, 0xc20b056c00, 0xc209442720, 0x2710, 0x0, 0x0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/query_executor.go:265 +0xe1
github.com/influxdb/influxdb/tsdb.func·008()
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/query_executor.go:146 +0x6bd
created by github.com/influxdb/influxdb/tsdb.(*QueryExecutor).ExecuteQuery
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/query_executor.go:196 +0x1f5

goroutine 6280 [runnable]:
github.com/influxdb/influxdb/tsdb.(*Store).CreateMapper(0xc208072720, 0x85, 0xc20982a9c0, 0xcf, 0x2710, 0x0, 0x0, 0x0, 0x0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/store.go:303 +0x414
github.com/influxdb/influxdb/cluster.(*ShardMapper).CreateMapper(0xc20806db40, 0x85, 0xc209199428, 0x1, 0x1, 0xc20982a9c0, 0xcf, 0x2710, 0x0, 0x0, ...)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/cluster/shard_mapper.go:48 +0x157
github.com/influxdb/influxdb/tsdb.(*QueryExecutor).Plan(0xc20806db80, 0xc2092223c0, 0x2710, 0x7f7b60085610, 0x0, 0x0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/query_executor.go:237 +0x955
github.com/influxdb/influxdb/tsdb.(*QueryExecutor).executeSelectStatement(0xc20806db80, 0x2, 0xc2092223c0, 0xc2087c43c0, 0x2710, 0x0, 0x0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/query_executor.go:255 +0x65
github.com/influxdb/influxdb/tsdb.func·008()
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/query_executor.go:146 +0x6bd
created by github.com/influxdb/influxdb/tsdb.(*QueryExecutor).ExecuteQuery
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/query_executor.go:196 +0x1f5

goroutine 6269 [runnable]:
encoding/binary.bigEndian.Uint64(0xc20a322bbb, 0x8, 0x11, 0xc208d2ee00)
        /usr/local/go/src/encoding/binary/binary.go:109
github.com/influxdb/influxdb/tsdb.(*FieldCodec).DecodeByID(0xc2091f17b0, 0xc2089f0b03, 0xc20a322bba, 0x12, 0x12, 0x0, 0x0, 0x0, 0x0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/shard.go:637 +0x278
github.com/influxdb/influxdb/tsdb.(*FieldCodec).DecodeByName(0xc2091f17b0, 0xc2097ae728, 0x8, 0xc20a322ba8, 0x24, 0x24, 0x0, 0x0, 0x0, 0x0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/shard.go:674 +0x142
github.com/influxdb/influxdb/tsdb.(*tagSetCursor).decodeRawPoint(0xc20b130600, 0xc20cd31a70, 0xc2097aec00, 0x1, 0x1, 0xee4908, 0x0, 0x0, 0x0, 0x0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/mapper.go:705 +0x18c
github.com/influxdb/influxdb/tsdb.(*tagSetCursor).Next(0xc20b130600, 0x13f9e4da5a77fae4, 0x13f9e4e7db89bee2, 0xc2097aec00, 0x1, 0x1, 0xee4908, 0x0, 0x0, 0x13f9e4dbbda10000, ...)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/mapper.go:680 +0x2f5
github.com/influxdb/influxdb/tsdb.(*LocalMapper).nextChunkRaw(0xc20983cb40, 0x0, 0x0, 0x0, 0x0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/mapper.go:268 +0x139
github.com/influxdb/influxdb/tsdb.(*LocalMapper).NextChunk(0xc20983cb40, 0x0, 0x0, 0x0, 0x0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/mapper.go:251 +0x55
github.com/influxdb/influxdb/tsdb.(*StatefulMapper).NextChunk(0xc208a0f2e0, 0x1, 0x0, 0x0)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/executor.go:43 +0x5c
github.com/influxdb/influxdb/tsdb.(*Executor).executeRaw(0xc20cd31200, 0xc208d5b620)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/executor.go:190 +0x124a
created by github.com/influxdb/influxdb/tsdb.(*Executor).Execute
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/tsdb/executor.go:88 +0x9a

goroutine 6241 [select]:
github.com/influxdb/influxdb/cluster.(*PointsWriter).writeToShard(0xc208010230, 0xc208836540, 0xc2098affa8, 0x2, 0xc2098affaa, 0x5, 0x1, 0xc20a1b9000, 0x4e, 0x80, ...)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/cluster/points_writer.go:278 +0x913
github.com/influxdb/influxdb/cluster.func·001(0xc208836540, 0xc2098affa8, 0x2, 0xc2098affaa, 0x5, 0xc20a1b9000, 0x4e, 0x80)
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/cluster/points_writer.go:205 +0xad
created by github.com/influxdb/influxdb/cluster.(*PointsWriter).WritePoints
        /tmp/tmp.bBFDyJej53/src/github.com/influxdb/influxdb/cluster/points_writer.go:206 +0x447

[otoolep]

What are the details of your retention policies, please?

[otoolep]

I took a look at the code, and have some ideas about what is going on, but am far from sure. Your system must be receiving queries during this time, as the code is crashing in the query engine. Are you running continuous queries?

I am also wondering the data in the shards is getting deleted while the query is taking place. This shouldn't be an issue, but am considering it, hence my question regarding retention policies.

[vovencij]

In our case we have default retention policies (we do not specify any explicitly) and no continuous queries.

[timgriffiths]

so i have 5 databases, 4 of which have the

name    duration    replicaN    default
default "0"                 1   false
month   "720h0m0s"  1   true

and the other is

name    duration    replicaN    default
default "0"               1 false

[beckettsean]

@timgriffiths that last one is very confusing to me. It looks like you have a database that has no default retention policy. That shouldn't be possible. (There's an RP named "default", but the default column is set to false, meaning it is not the default retention policy.)

Can you run the SHOW RETENTION POLICIES ON <database> query on that database and paste the full output here?

[timgriffiths]

Sorry that's a typo, you are correct all my databases have a default retention policy

name    duration    replicaN    default
default "0"               1               true

[beckettsean]

Thanks, @timgriffiths. I discovered it is actually possible to end up in a state where there is no default retention policy (#3699) but I'm glad we can rule that out as a complicating factor in your issue.

[pjalet]

Hello,

I ran into a similar error but not at starting time. Log is copied below:

[http] 2015/08/18 16:11:49 138.131.181.22 - - [18/Aug/2015:16:11:49 +0200] GET /query?u=root&p=root&q=show%20series&db=TEST_1 HTTP/1.1 200 171 http://<address>:8083/ Mozilla/5.0 (Windows NT 6.1; WOW64; rv:38.0) Gecko/20100101 Firefox/38.0 1117ed4f-45b3-11e5-aa4a-000000000000 1.211851ms
panic: runtime error: invalid memory address or nil pointer dereference
    panic: runtime error: invalid memory address or nil pointer dereference
[signal 0xb code=0x1 addr=0x1 pc=0x70adc1]

goroutine 21969 [running]:
github.com/boltdb/bolt.(*Tx).Rollback(0x0, 0x0, 0x0)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/boltdb/bolt/tx.go:210 +0x31
github.com/influxdb/influxdb/tsdb.(*LocalMapper).Close(0xc2082bf760)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/tsdb/tx.go:267 +0x2c
github.com/influxdb/influxdb/influxql.(*MapReduceJob).Close(0xc20b4cfc00)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/influxql/engine.go:60 +0x8d
github.com/influxdb/influxdb/influxql.(*Executor).close(0xc20810d940)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/influxql/engine.go:912 +0x6a
github.com/boltdb/bolt.(*Tx).Rollback(0x0, 0x0, 0x0)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/boltdb/bolt/tx.go:210 +0x31
github.com/influxdb/influxdb/tsdb.(*LocalMapper).Close(0xc2082bf760)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/tsdb/tx.go:267 +0x2c
github.com/influxdb/influxdb/influxql.(*MapReduceJob).Close(0xc20b4cfc00)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/influxql/engine.go:60 +0x8d
github.com/influxdb/influxdb/influxql.(*MapReduceJob).Open(0xc20b4cfc00, 0x0, 0x0)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/influxql/engine.go:51 +0xdb
github.com/influxdb/influxdb/influxql.(*MapReduceJob).Execute(0xc20b4cfc00, 0xc2087be120, 0x1)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/influxql/engine.go:72 +0x36
github.com/influxdb/influxdb/influxql.(*Executor).execute(0xc20810d940, 0xc2087be120)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/influxql/engine.go:926 +0xba
created by github.com/influxdb/influxdb/influxql.(*Executor).Execute
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/influxql/engine.go:905 +0x5a

goroutine 1 [chan receive (nil chan), 10300 minutes]:
main.(*Main).Run(0xc208154760, 0xc20800a010, 0x4, 0x4, 0x0, 0x0)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/cmd/influxd/main.go:81 +0x450
main.main()
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/cmd/influxd/main.go:39 +0x1d0

goroutine 6 [syscall, 10301 minutes]:
os/signal.loop()
    /root/.gvm/gos/go1.4.2/src/os/signal/signal_unix.go:21 +0x1f
created by os/signal.init·1
    /root/.gvm/gos/go1.4.2/src/os/signal/signal_unix.go:27 +0x35

goroutine 21968 [chan receive]:
github.com/influxdb/influxdb/tsdb.(*QueryExecutor).executeSelectStatement(0xc208075800, 0x0, 0xc208380240, 0xc20930644b, 0x6, 0xc2087be0c0, 0x2710, 0x0, 0x0)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/tsdb/query_executor.go:236 +0x1f1
github.com/influxdb/influxdb/tsdb.func·004()
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/tsdb/query_executor.go:157 +0x727
created by github.com/influxdb/influxdb/tsdb.(*QueryExecutor).ExecuteQuery
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/tsdb/query_executor.go:211 +0x22b

goroutine 17 [syscall, 10301 minutes, locked to thread]:
runtime.goexit()
    /root/.gvm/gos/go1.4.2/src/runtime/asm_amd64.s:2232 +0x1

goroutine 8 [IO wait, 6609 minutes]:
net.(*pollDesc).Wait(0xc2080104c0, 0x72, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc2080104c0, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).accept(0xc208010460, 0x0, 0x7fb1c27e9cc8, 0xc2099ba028)
    /root/.gvm/gos/go1.4.2/src/net/fd_unix.go:419 +0x40b
net.(*TCPListener).AcceptTCP(0xc208086a20, 0x8cbd40, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/tcpsock_posix.go:234 +0x4e
net.(*TCPListener).Accept(0xc208086a20, 0x0, 0x0, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/tcpsock_posix.go:244 +0x4c
github.com/influxdb/influxdb/tcp.(*Mux).Serve(0xc2080b9a40, 0x7fb1c27f6278, 0xc208086a20, 0x0, 0x0)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/tcp/mux.go:45 +0x57
created by github.com/influxdb/influxdb/cmd/influxd/run.func·003
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/cmd/influxd/run/server.go:274 +0x762

goroutine 9 [chan receive, 10301 minutes]:
github.com/influxdb/influxdb/tcp.(*listener).Accept(0xc208086a28, 0x0, 0x0, 0x0, 0x0)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/tcp/mux.go:117 +0x80
github.com/influxdb/influxdb/meta.(*raftLayer).Accept(0xc2080b9aa0, 0x0, 0x0, 0x0, 0x0)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/meta/store.go:1636 +0x64
github.com/hashicorp/raft.(*NetworkTransport).listen(0xc208010540)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/hashicorp/raft/net_transport.go:346 +0x50
created by github.com/hashicorp/raft.NewNetworkTransport
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/hashicorp/raft/net_transport.go:138 +0x2c4

goroutine 10 [select]:
github.com/hashicorp/raft.(*Raft).leaderLoop(0xc2080b61c0)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/hashicorp/raft/raft.go:807 +0xc7c
github.com/hashicorp/raft.(*Raft).runLeader(0xc2080b61c0)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/hashicorp/raft/raft.go:779 +0x74e
github.com/hashicorp/raft.(*Raft).run(0xc2080b61c0)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/hashicorp/raft/raft.go:576 +0xc9
github.com/hashicorp/raft.*Raft.(github.com/hashicorp/raft.run)·fm()
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/hashicorp/raft/raft.go:241 +0x27
github.com/hashicorp/raft.func·011()
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/hashicorp/raft/state.go:152 +0x51
created by github.com/hashicorp/raft.(*raftState).goFunc
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/hashicorp/raft/state.go:153 +0xe3

goroutine 11 [select, 2316 minutes]:
github.com/hashicorp/raft.(*Raft).runFSM(0xc2080b61c0)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/hashicorp/raft/raft.go:490 +0xf74
github.com/hashicorp/raft.*Raft.(github.com/hashicorp/raft.runFSM)·fm()
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/hashicorp/raft/raft.go:242 +0x27
github.com/hashicorp/raft.func·011()
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/hashicorp/raft/state.go:152 +0x51
created by github.com/hashicorp/raft.(*raftState).goFunc
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/hashicorp/raft/state.go:153 +0xe3

goroutine 12 [select]:
github.com/hashicorp/raft.(*Raft).runSnapshots(0xc2080b61c0)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/hashicorp/raft/raft.go:1594 +0x466
github.com/hashicorp/raft.*Raft.(github.com/hashicorp/raft.runSnapshots)·fm()
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/hashicorp/raft/raft.go:243 +0x27
github.com/hashicorp/raft.func·011()
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/hashicorp/raft/state.go:152 +0x51
created by github.com/hashicorp/raft.(*raftState).goFunc
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/hashicorp/raft/state.go:153 +0xe3

goroutine 14 [chan receive, 10301 minutes]:
github.com/influxdb/influxdb/tcp.(*listener).Accept(0xc208086a30, 0x0, 0x0, 0x0, 0x0)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/tcp/mux.go:117 +0x80
github.com/influxdb/influxdb/meta.(*Store).serveExecListener(0xc20806e280)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/meta/store.go:436 +0x8f
created by github.com/influxdb/influxdb/meta.(*Store).Open
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/meta/store.go:183 +0x1c2

goroutine 18 [select, 10301 minutes]:
github.com/influxdb/influxdb/cmd/influxd/run.(*Server).monitorErrorChan(0xc2080900c0, 0xc20804a4e0)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/cmd/influxd/run/server.go:390 +0x14a
created by github.com/influxdb/influxdb/cmd/influxd/run.func·003
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/cmd/influxd/run/server.go:280 +0x8d3

goroutine 15 [select]:
github.com/influxdb/influxdb/services/hh.(*Service).retryWrites(0xc208067040)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/services/hh/service.go:98 +0x2e7
created by github.com/influxdb/influxdb/services/hh.(*Service).Open
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/services/hh/service.go:62 +0xef

goroutine 16 [select, 39 minutes]:
github.com/influxdb/influxdb/services/hh.(*Service).expireWrites(0xc208067040)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/services/hh/service.go:116 +0x2a4
created by github.com/influxdb/influxdb/services/hh.(*Service).Open
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/services/hh/service.go:63 +0x109

goroutine 34 [chan receive, 10300 minutes]:
github.com/influxdb/influxdb/tcp.(*listener).Accept(0xc208086a38, 0x0, 0x0, 0x0, 0x0)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/tcp/mux.go:117 +0x80
github.com/influxdb/influxdb/cluster.(*Service).serve(0xc208010310)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/cluster/service.go:79 +0x102
created by github.com/influxdb/influxdb/cluster.(*Service).Open
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/cluster/service.go:56 +0x67

goroutine 35 [select, 7 minutes]:
github.com/influxdb/influxdb/services/precreator.(*Service).runPrecreation(0xc20800ae10)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/services/precreator/service.go:72 +0x407
created by github.com/influxdb/influxdb/services/precreator.(*Service).Open
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/services/precreator/service.go:50 +0xcb

goroutine 36 [chan receive, 6609 minutes]:
github.com/influxdb/influxdb/tcp.(*listener).Accept(0xc208086a40, 0x0, 0x0, 0x0, 0x0)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/tcp/mux.go:117 +0x80
github.com/influxdb/influxdb/services/snapshotter.(*Service).serve(0xc20800af00)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/services/snapshotter/service.go:68 +0xad
created by github.com/influxdb/influxdb/services/snapshotter.(*Service).Open
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/services/snapshotter/service.go:46 +0x62

goroutine 37 [IO wait]:
net.(*pollDesc).Wait(0xc208174760, 0x72, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc208174760, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).accept(0xc208174700, 0x0, 0x7fb1c27e9cc8, 0xc209792fe8)
    /root/.gvm/gos/go1.4.2/src/net/fd_unix.go:419 +0x40b
net.(*TCPListener).AcceptTCP(0xc208160128, 0xc208060d90, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/tcpsock_posix.go:234 +0x4e
net.(*TCPListener).Accept(0xc208160128, 0x0, 0x0, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/tcpsock_posix.go:244 +0x4c
net/http.(*Server).Serve(0xc20813e0c0, 0x7fb1c27f6278, 0xc208160128, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1728 +0x92
net/http.Serve(0x7fb1c27f6278, 0xc208160128, 0x7fb1c27f7e18, 0xc208138040, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1606 +0xa1
github.com/influxdb/influxdb/services/admin.(*Service).serve(0xc2080b9890)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/services/admin/service.go:71 +0x147
created by github.com/influxdb/influxdb/services/admin.(*Service).Open
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/services/admin/service.go:39 +0xd9

goroutine 38 [select]:
github.com/influxdb/influxdb/services/continuous_querier.(*Service).backgroundLoop(0xc208010380)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/services/continuous_querier/service.go:151 +0x1fc
created by github.com/influxdb/influxdb/services/continuous_querier.(*Service).Open
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/services/continuous_querier/service.go:87 +0x1ed

goroutine 39 [IO wait]:
net.(*pollDesc).Wait(0xc2081747d0, 0x72, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc2081747d0, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).accept(0xc208174770, 0x0, 0x7fb1c27e9cc8, 0xc2092ea528)
    /root/.gvm/gos/go1.4.2/src/net/fd_unix.go:419 +0x40b
net.(*TCPListener).AcceptTCP(0xc208160130, 0xc2080e5dc8, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/tcpsock_posix.go:234 +0x4e
net.(*TCPListener).Accept(0xc208160130, 0x0, 0x0, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/tcpsock_posix.go:244 +0x4c
net/http.(*Server).Serve(0xc208170960, 0x7fb1c27f6278, 0xc208160130, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1728 +0x92
net/http.Serve(0x7fb1c27f6278, 0xc208160130, 0x7fb1c27f7dc8, 0xc2080103f0, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1606 +0xa1
github.com/influxdb/influxdb/services/httpd.(*Service).serve(0xc208075880)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/services/httpd/service.go:83 +0x79
created by github.com/influxdb/influxdb/services/httpd.(*Service).Open
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/services/httpd/service.go:51 +0x283

goroutine 40 [select]:
github.com/influxdb/influxdb/services/retention.(*Service).deleteShardGroups(0xc20804a8a0)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/services/retention/service.go:67 +0x433
created by github.com/influxdb/influxdb/services/retention.(*Service).Open
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/services/retention/service.go:44 +0x67

goroutine 41 [select]:
github.com/influxdb/influxdb/services/retention.(*Service).deleteShards(0xc20804a8a0)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/services/retention/service.go:101 +0x821
created by github.com/influxdb/influxdb/services/retention.(*Service).Open
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/services/retention/service.go:45 +0x81

goroutine 42 [chan receive, 221 minutes]:
github.com/influxdb/influxdb/cmd/influxd/run.(*Server).startServerReporting(0xc2080900c0)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/cmd/influxd/run/server.go:341 +0x5e
created by github.com/influxdb/influxdb/cmd/influxd/run.func·003
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/cmd/influxd/run/server.go:303 +0xd78

goroutine 43 [select, 10300 minutes]:
github.com/influxdb/influxdb/cmd/influxd/run.(*Command).monitorServerErrors(0xc20804a360)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/cmd/influxd/run/command.go:118 +0x2da
created by github.com/influxdb/influxdb/cmd/influxd/run.(*Command).Run
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/cmd/influxd/run/command.go:102 +0xa1a

goroutine 21937 [chan receive]:
github.com/influxdb/influxdb/services/httpd.(*Handler).serveQuery(0xc2080103f0, 0x7fb1c27fa938, 0xc209bc55a0, 0xc20ad7d450, 0x0)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/services/httpd/handler.go:241 +0x7c4
github.com/influxdb/influxdb/services/httpd.*Handler.(github.com/influxdb/influxdb/services/httpd.serveQuery)·fm(0x7fb1c27fa938, 0xc209bc55a0, 0xc20ad7d450, 0x0)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/services/httpd/handler.go:90 +0x4f
github.com/influxdb/influxdb/services/httpd.func·001(0x7fb1c27fa938, 0xc209bc55a0, 0xc20ad7d450)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/services/httpd/handler.go:601 +0x78
net/http.HandlerFunc.ServeHTTP(0xc2080e7760, 0x7fb1c27fa938, 0xc209bc55a0, 0xc20ad7d450)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·002(0x7fb1c27fa8b0, 0xc209bc5500, 0xc20ad7d450)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/services/httpd/handler.go:659 +0x288
net/http.HandlerFunc.ServeHTTP(0xc2080ec090, 0x7fb1c27fa8b0, 0xc209bc5500, 0xc20ad7d450)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·003(0x7fb1c27fa8b0, 0xc209bc5500, 0xc20ad7d450)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/services/httpd/handler.go:668 +0xb0
net/http.HandlerFunc.ServeHTTP(0xc2080e7780, 0x7fb1c27fa8b0, 0xc209bc5500, 0xc20ad7d450)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·004(0x7fb1c27fa8b0, 0xc209bc5500, 0xc20ad7d450)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/services/httpd/handler.go:701 +0x31a
net/http.HandlerFunc.ServeHTTP(0xc2080ec0d0, 0x7fb1c27fa8b0, 0xc209bc5500, 0xc20ad7d450)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·005(0x7fb1c27fa8b0, 0xc209bc5500, 0xc20ad7d450)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/services/httpd/handler.go:711 +0x179
net/http.HandlerFunc.ServeHTTP(0xc2080ec0f0, 0x7fb1c27fa8b0, 0xc209bc5500, 0xc20ad7d450)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·006(0x7fb1c27fa8b0, 0xc209bc54e0, 0xc20ad7d450)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/services/httpd/handler.go:719 +0x123
net/http.HandlerFunc.ServeHTTP(0xc2080e77a0, 0x7fb1c27fa8b0, 0xc209bc54e0, 0xc20ad7d450)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/influxdb/influxdb/services/httpd.func·007(0x7fb1c27f8268, 0xc20938e280, 0xc20ad7d450)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/services/httpd/handler.go:729 +0x12c
net/http.HandlerFunc.ServeHTTP(0xc2080e77c0, 0x7fb1c27f8268, 0xc20938e280, 0xc20ad7d450)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1265 +0x41
github.com/bmizerany/pat.(*PatternServeMux).ServeHTTP(0xc208086970, 0x7fb1c27f8268, 0xc20938e280, 0xc20ad7d450)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/bmizerany/pat/mux.go:109 +0x21c
github.com/influxdb/influxdb/services/httpd.(*Handler).ServeHTTP(0xc2080103f0, 0x7fb1c27f8268, 0xc20938e280, 0xc20ad7d450)
    /root/.gvm/pkgsets/go1.4.2/global/src/github.com/influxdb/influxdb/services/httpd/handler.go:166 +0x256
net/http.serverHandler.ServeHTTP(0xc208170960, 0x7fb1c27f8268, 0xc20938e280, 0xc20ad7d450)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1703 +0x19a
net/http.(*conn).serve(0xc2080660a0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1204 +0xb57
created by net/http.(*Server).Serve
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1751 +0x35e

goroutine 21719 [IO wait, 344 minutes]:
net.(*pollDesc).Wait(0xc2098c8300, 0x72, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc2098c8300, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc2098c82a0, 0xc20a1a9000, 0x1000, 0x1000, 0x0, 0x7fb1c27e9cc8, 0xc20b08b328)
    /root/.gvm/gos/go1.4.2/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc2081600e0, 0xc20a1a9000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/net.go:121 +0xdc
net/http.(*liveSwitchReader).Read(0xc209586048, 0xc20a1a9000, 0x1000, 0x1000, 0xc20800afa0, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc208f1e9c0, 0xc20a1a9000, 0x1000, 0x1000, 0xc209143940, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc209147440)
    /root/.gvm/gos/go1.4.2/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc209147440, 0xa, 0x0, 0x0, 0x0, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc209147440, 0x0, 0x0, 0x0, 0xc20b671400, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc2090d2300, 0x0, 0x0, 0x0, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc2090d2300, 0x0, 0x0, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc209147440, 0xc20a73a1a0, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc209586000, 0x0, 0x0, 0x0)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc209586000)
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
    /root/.gvm/gos/go1.4.2/src/net/http/server.go:1751 +0x35e

[beckettsean]

Significant improvements to write path and speed in 0.9.3, released yesterday. I am provisionally closing this, please reply if you can reproduce the issue on 0.9.3.

[consense]

Hi,

the orinigal panic mentioned in this ticket (invalid memory address or nil pointer dereference, /root/go/src/github.com/boltdb/bolt/db.go:422) is still occuring for me using 0.9.3.

Not sure which query/write caused this exactly as we had modest production load on the db at that time. Gladly give a hint on how to make this more reproducable for you.

Full stacktrace at: https://gist.github.com/consense/0b04ae6019ff37fbeb9c