Gaia-9001 halt stack trace

[gamarin2]

Gaia-9001 halted. Here is the log:

E[12116-11-12|15:08:53.733] CONSENSUS FAILURE!!!                         module=consensus err="ERROR:
Codespace:
1
Code: 10
Message: \"47steak < -121932steak\"
" stack="goroutine 555 [running]:
runtime/debug.Stack(0xc000c0b230, 0xf0e340, 0xc00427f600)
/usr/local/go/src/runtime/debug/stack.go:24 +0xa7
github.com/cosmos/cosmos-sdk/vendor/github.com/tendermint/tendermint/consensus.(*ConsensusState).receiveRoutine.func2(0xc000183880, 0x10f5340)
    /root/go/src/github.com/cosmos/cosmossdk/vendor/github.com/tendermint/tendermint/consensus/state.go: 586 +0x57
panic(0xf0e340, 0xc00427f600)\n\t/usr/local/go/src/runtime/panic.go:513 +0x1b9
github.com/cosmos/cosmos-sdk/x/distribution/keeper.Keeper.WithdrawToDelegator(0x11d9480, 0xc000bd4e90, 0xc0001041c0, 0xc0001041c0, 0x11d9480, 0xc000bd4ee0, 0x11d94c0, 0xc000bd4ef0, 0xc0001a1140, 0x5, ...)\
    /root/go/src/github.com/cosmos/cosmos-sdk/x/distribution/keeper/delegation.go:120 +0x34b
github.com/cosmos/cosmos-sdk/x/distribution/keeper.Keeper.WithdrawValidatorRewardsAll(0x11d9480, 0xc000bd4e90, 0xc0001041c0, 0xc0001041c0, 0x11d9480, 0xc000bd4ee0, 0
x11d94c0, 0xc000bd4ef0, 0xc0001a1140, 0x5, ...)
    /root/go/src/github.com/cosmos/cosmos-sdk/x/distribution/keeper/validator.go:77 +0x6a6
github.com/cosmos/cosmos-sdk/x/distribution/keeper.Keeper.onValidatorModified(0x11d9480, 0xc000bd4e90, 0xc0001041c0, 0xc0001041c0, 0x11d9480, 0xc000bd4ee0, 0
x11d94c0, 0xc000bd4ef0, 0xc0001a1140, 0x5, ...)
    /root/go/src/github.com/cosmos/cosmos-sdk/x/distribution/keeper/hooks.go:28 +0x120
github.com/cosmos/cosmos-sdk/x/distribution/keeper.Hooks.OnValidatorModified(0x11d9480, 0xc000bd4e90, 0xc0001041c0, 0xc0001041c0, 0x11d9480, 0xc000bd4ee0, 0x11d9
4c0, 0xc000bd4ef0, 0xc0001a1140, 0x5, ...)
    /root/go/src/github.com/cosmos/cosmos-sdk/x/distribution/keeper/hooks.go:104 +0xd0
github.com/cosmos/cosmos-sdk/cmd/gaia/app.Hooks.OnValidatorModified(0x11d9480, 0xc000bd4e90, 0xc0001041c0, 0xc0001041c0, 0x11d9480, 0xc000bd4ee0, 0x11d94c0, 0xc00
0bd4ef0, 0xc0001a1140, 0x5, ...)
    /root/go/src/github.com/cosmos/cosmos-sdk/cmd/gaia/app/app.go:345 +0xd0
github.com/cosmos/cosmos-sdk/x/stake/keeper.Keeper.OnValidatorModified(0x11d9480, 0xc000bd4e60, 0x11d94c0, 0xc000bd4e70, 0xc0001041c0, 0x11e72a0, 0xc0001
6d100, 0x11e89e0, 0xc000be9440, 0xc0001041c0, ...)
    /root/go/src/github.com/cosmos/cosmos-sdk/x/stake/keeper/hooks.go:16 +0xa5
github.com/cosmos/cosmos-sdk/x/stake/keeper.Keeper.Slash(0x11d9480, 0xc000bd4e60, 0x11d94c0, 0xc000bd4e70, 0xc0001041c0, 0x11e72a0, 0xc00016d100, 0x11e89e0, 0xc000be9
440, 0xc0001041c0, ...)
    /root/go/src/github.com/cosmos/cosmos-sdk/x/stake/keeper/slash.go:54 +0x584
github.com/cosmos/cosmos-sdk/x/slashing.Keeper.handleValidatorSignature(0x11d9480, 0xc000bd4eb0, 0xc0001041c0, 0x11ea180, 0xc0001e23c0, 0xc0001041c0, 0x11d9480, 0xc000bd4ee0, 0x11d94c0, 0xc000
bd4ef0, ...)
    /root/go/src/github.com/cosmos/cosmos-sdk/x/slashing/keeper.go:156 +0xc0b
github.com/cosmos/cosmos-sdk/x/slashing.BeginBlocker(0x11e1500, 0xc00305b5f0, 0xc00431f8c0, 0xb, 0xc001df57c0, 0x20, 0x20, 0x7, 0x0, 0x0, ...)
    /root/go/src/github.com/cosmos/cosmos-sdk/x/slashing/tick.go:24+0x2d8\ngithub.com/cosmos/cosmos-sdk/cmd/gaia/app.(*GaiaApp).BeginBlocker(0xc000202800, 0x11e1500, 0xc003
05b5f0, 0xc00431f8c0, 0xb, 0xc001df57c0, 0x20, 0x20, 0x7, 0x0, ...)
    /root/go/src/github.com/cosmos/cosmos-sdk/cmd/gaia/app/app.go:193 +0xea
github.com/cosmos/cosmos-sdk/cmd/gaia/app.(*GaiaApp).BeginBlocker-fm(0x11e1500, 0xc00305b5f0, 0xc00431f8c0, 0xb, 0xc001df57c0, 0x20, 0x20, 0x7, 0x0, 0x0
, ...)
    /root/go/src/github.com/cosmos/cosmos-sdk/cmd/gaia/app/app.go:164+0xba\ngithub.com/cosmos/cosmos-sdk/baseapp.(*BaseApp).BeginBlock(0xc000
bd6690, 0xc001df57c0, 0x20, 0x20, 0x7, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /root/go/src/github.com/cosmos/cosmos-sdk/baseapp/baseapp.go:434 +0x230
github.com/cosmos/cosmos-sdk/vendor/github.com/tendermint/tendermint/abci/client.(*localClient).BeginBlockSync(0xc0000b5a40, 0xc001df57c0, 0x20, 0x20, 0x7, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /root/go/src/github.com/cosmos/cosmos-sdk/vendor/github.com/tendermint/t
endermint/abci/client/local_client.go:206 +0x9e
github.com/cosmos/cosmos-sdk/vendor/github.com/tendermint/tendermint/proxy.(*appConnConsensus).BeginBlockSync(0xc000bd50d0, 0xc001df57c0, 0x20, 0x20, 0x7, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /root/go/src/github.com/cosmos/cosmos-sdk/vendor/github.com/tendermint/tendermint/proxy/app_conn.go:69 +0x6b
github.com/cosmos/cosmos-sdk/vendor/github.com/tendermint/tendermint/state.execBlockOnProxyApp(0x
11e2180, 0xc000941220, 0x11e6e20, 0xc000bd50d0, 0xc0001f8780, 0xc00305ae70, 0x11eb800, 0xc00000e300, 0x35d3, 0xc004d2d5a0, ...)
    /root/go/src/github.com/cosmos/cosmos-sdk/vendor/github.com/tendermint/tendermint/state/execution.go:235 +0x47f
github.com/cosmos/cosmos-sdk/vendor/github.com/tendermint/tendermint/state.(*BlockExecutor).ApplyBlock(0xc00001c3f0, 0x7, 0x0, 0xc000a52bf6, 0x6, 0xc000a52c10, 0x9, 0x81fd, 0x35d3, 0xc004d2d5a0, ...) 
 /root/go/src/github.com/cosmos/cosmossdk/vendor/github.com/tendermint/tendermint/state/execution.go:96 +0x15f
github.com/cosmos/cosmos-sdk/vendor/github.com/tendermint/tendermint/consensus.(*ConsensusState).finalizeCommit(0xc000183880, 0x81fe)
    /root/go/src/github.com/cosmos/cosmos-sdk/vendor/github.com/tendermint/tendermint/consensus/state.go:1327 +0xa8c
github.com/cosmos/cosmos-sdk/vendor/github.com/tendermint/tendermint/consensus.(*ConsensusState).tryFinalizeCommit(0xc000183880, 0x81fe)
    /root/go/src/github.com/cosmos/cosmos-sdk/vendor/github.com/tendermint/tendermint/consensus/state.go:1258 +0x451
github.com/cosmos/cosmos-sdk/vendor/github.com/tendermint/tendermint/consensus.(*C
onsensusState).enterCommit.func1(0xc000183880, 0x0, 0x81fe)
    /root/go/src/github.com/cosmos/cosmos-sdk/vendor/github.com/tendermint/tendermint/con
sensus/state.go:1204 +0x90
github.com/cosmos/cosmos-sdk/vendor/github.com/tendermint/tendermint/consensus.(*ConsensusState).enterCommit(0xc0001

[zmanian]

Most likely caused by
#2776

[hendrikhofstadt]

To add context:

I added -500000000 steaks to the FeePool which has probably made it negative. The amount to withdraw was therefore negative as well and caused the above crash since the new balance after AddCoins can't be negative.