Skip to content
This repository has been archived by the owner on Aug 2, 2022. It is now read-only.

42/50 Test #42: validate_dirty_db_test ...............***Failed #6388

Closed
namehuxing opened this issue Nov 25, 2018 · 4 comments
Closed

42/50 Test #42: validate_dirty_db_test ...............***Failed #6388

namehuxing opened this issue Nov 25, 2018 · 4 comments
Labels

Comments

@namehuxing
Copy link

namehuxing commented Nov 25, 2018

EOS version 1.4.4
system:ubuntu 18.04.1 LTS VirtualBox
CPU:i7 8750H
Memory:8G
DISK:50G

image

image

root@hx-VirtualBox:/opt/eos/build# ctest --output-on-failure -R validate_dirty_db_test --repeat-until-fail 20
Test project /opt/eos/build
    Start 42: validate_dirty_db_test
    Test #42: validate_dirty_db_test ...........***Failed   17.40 sec
kill: (2677): No such process
kill: (2678): No such process
launching bios
spawning child, programs/nodeos/nodeos --max-transaction-time -1 --abi-serializer-max-time-ms 990000 --filter-on * --p2p-max-nodes-per-host 1 --contracts-console  --config-dir etc/eosio/node_bios --data-dir var/lib/node_bios --genesis-json etc/eosio/node_bios/genesis.json --genesis-timestamp 2018-11-25T03:08:37.054
launching testnet_00
spawning child, programs/nodeos/nodeos --max-transaction-time -1 --abi-serializer-max-time-ms 990000 --filter-on * --p2p-max-nodes-per-host 1 --contracts-console  --config-dir etc/eosio/node_00 --data-dir var/lib/node_00 --genesis-json etc/eosio/node_00/genesis.json --genesis-timestamp 2018-11-25T03:08:37.054
**********************************************************************
run 'bash bios_boot.sh' to kick off delegated block production
**********************************************************************
 BEGIN
 UTC time: 2018-11-25 03:08:37.038157
 EOS Client version: 59626f1e
 Processor: x86_64
 OS name: Linux-4.15.0-39-generic-x86_64-with-Ubuntu-18.04-bionic
 cmd: programs/eosio-launcher/eosio-launcher -k 9
 cmd: pkill -9 nodeos
producing nodes: 1, topology: mesh, delay between nodes launch(seconds): 1, chain sync strategy: resync
Stand up cluster
  Checking if port 8888 is available.
  Checking if port 8889 is available.
 cmd: programs/eosio-launcher/eosio-launcher -p 1 -n 1 -d 1 -i 2018-11-25T03:08:37.054 -f --p2p-plugin net --nodeos --max-transaction-time -1 --abi-serializer-max-time-ms 990000 --filter-on * --p2p-max-nodes-per-host 1 --contracts-console --max-block-cpu-usage 160000000 --max-transaction-cpu-usage 150000000 --shape mesh
     cmd: pgrep -a nodeos
  pgrep output: "2809 programs/nodeos/nodeos --max-transaction-time -1 --abi-serializer-max-time-ms 990000 --filter-on * --p2p-max-nodes-per-host 1 --contracts-console --config-dir etc/eosio/node_bios --data-dir var/lib/node_bios --genesis-json etc/eosio/node_bios/genesis.json --genesis-timestamp 2018-11-25T03:08:37.054
2810 programs/nodeos/nodeos --max-transaction-time -1 --abi-serializer-max-time-ms 990000 --filter-on * --p2p-max-nodes-per-host 1 --contracts-console --config-dir etc/eosio/node_00 --data-dir var/lib/node_00 --genesis-json etc/eosio/node_00/genesis.json --genesis-timestamp 2018-11-25T03:08:37.054
"
   new Node host=localhost, port=8888, pid=2810, cmd=programs/nodeos/nodeos --max-transaction-time -1 --abi-serializer-max-time-ms 990000 --filter-on * --p2p-max-nodes-per-host 1 --contracts-console --config-dir etc/eosio/node_00 --data-dir var/lib/node_00 --genesis-json etc/eosio/node_00/genesis.json --genesis-timestamp 2018-11-25T03:08:37.054
  Node> Host: localhost, Port:8888
  Found 1 nodes
 Cluster viability smoke test. Validate every cluster node has block 1. 
          cmd: programs/cleos/cleos --url http://localhost:8888  --no-auto-keosd get info
        Failure in get info parsing head block. None
    cmd: sleep 3 seconds, remaining time: 59 seconds
          cmd: programs/cleos/cleos --url http://localhost:8888  --no-auto-keosd get info
        Failure in get info parsing head block. None
    cmd: sleep 3 seconds, remaining time: 56 seconds
          cmd: programs/cleos/cleos --url http://localhost:8888  --no-auto-keosd get info
        Failure in get info parsing head block. None
    cmd: sleep 3 seconds, remaining time: 53 seconds
          cmd: programs/cleos/cleos --url http://localhost:8888  --no-auto-keosd get info
        Failure in get info parsing head block. None
    cmd: sleep 3 seconds, remaining time: 50 seconds
          cmd: programs/cleos/cleos --url http://localhost:8888  --no-auto-keosd get info
 Skipping bootstrap.
Kill cluster nodes.
 cmd: programs/eosio-launcher/eosio-launcher -k 9
 cmd: pkill -9 nodeos
Restart nodeos repeatedly to ensure dirty database flag sticks.
Attempt 1.
 Launching nodeos process.
 cmd: programs/nodeos/nodeos --config-dir etc/eosio/node_bios --data-dir var/lib/node_bios --verbose-http-errors --http-validate-host=false
 Nodeos process launched.
 Setting nodeos process timeout.
 ERROR: Nodeos is running beyond the defined wait time. Hard killing nodeos instance.
Cleanup in finally block.
 Test failed.
   Node State:
    cmd   : programs/nodeos/nodeos --max-transaction-time -1 --abi-serializer-max-time-ms 990000 --filter-on * --p2p-max-nodes-per-host 1 --contracts-console --config-dir etc/eosio/node_00 --data-dir var/lib/node_00 --genesis-json etc/eosio/node_00/genesis.json --genesis-timestamp 2018-11-25T03:08:37.054
    killed: True
    host  : localhost
    port  : 8888
    pid   : None
    hbn   : 6 (at last call to getInfo)
    lib   : 5 (at last call to getInfo)
   =================================================================
   Contents of etc/eosio/node_bios/config.ini:
blocks-dir = blocks
http-server-address = 127.0.0.1:8788
http-validate-host = false
p2p-listen-endpoint = 0.0.0.0:9776
p2p-server-address = localhost:9776
enable-stale-production = true
allowed-connection = any
private-key = ["EOS6MRyAjQq8ud7hVNYcfnVPJqcVpscN5So8BhtHuGYqET5GDW5CV","5KQwrPbwdL6PhXujxW37FSSQZ1JiwsST4cqQzDeyXtP79zkvFD3"]
producer-name = eosio
plugin = eosio::producer_plugin
plugin = eosio::net_plugin
plugin = eosio::chain_api_plugin
plugin = eosio::history_api_plugin
   =================================================================
   Contents of var/lib/node_bios/stderr.txt:
info  2018-11-25T03:08:48.174 thread-0  chain_plugin.cpp:333          plugin_initialize    ] initializing chain plugin
info  2018-11-25T03:08:48.175 thread-0  chain_plugin.cpp:585          plugin_initialize    ] Using genesis state provided in '/opt/eos/build/etc/eosio/node_bios/genesis.json'
debug 2018-11-25T03:08:48.175 thread-0  chain_plugin.cpp:314          calculate_genesis_ti ] pausing 446000 microseconds to the next interval
info  2018-11-25T03:08:48.175 thread-0  chain_plugin.cpp:317          calculate_genesis_ti ] Adjusting genesis timestamp to 2018-11-25T03:08:37.500
warn  2018-11-25T03:08:48.175 thread-0  chain_plugin.cpp:592          plugin_initialize    ] Starting up fresh blockchain with provided genesis state.
warn  2018-11-25T03:08:48.514 thread-0  producer_plugin.cpp:610       plugin_initialize    ] "private-key" is DEPRECATED, use "signature-provider=EOS6MRyAjQq8ud7hVNYcfnVPJqcVpscN5So8BhtHuGYqET5GDW5CV=KEY:***************************************************"
info  2018-11-25T03:08:48.515 thread-0  net_plugin.cpp:2901           plugin_initialize    ] Initialize net plugin
info  2018-11-25T03:08:48.515 thread-0  net_plugin.cpp:2927           plugin_initialize    ] host: 0.0.0.0 port: 9776 
info  2018-11-25T03:08:48.515 thread-0  net_plugin.cpp:2998           plugin_initialize    ] my node_id is 62101f2908425d5135ab6d788dfb0cb9a2a64b691b5d6ab84c4d282e645f8921
info  2018-11-25T03:08:48.515 thread-0  http_plugin.cpp:422           plugin_initialize    ] configured http to listen on 127.0.0.1:8788
warn  2018-11-25T03:08:48.515 thread-0  history_plugin.cpp:321        plugin_initialize    ] --filter-on * enabled. This can fill shared_mem, causing nodeos to stop.
opened GELF socket to endpoint 10.160.11.21:12201
info  2018-11-25T03:08:48.515 thread-0  main.cpp:110                  main                 ] nodeos version v1.4.4
info  2018-11-25T03:08:48.515 thread-0  main.cpp:111                  main                 ] eosio root is /root/.local/share
info  2018-11-25T03:08:48.515 thread-0  main.cpp:112                  main                 ] nodeos using configuration file /opt/eos/build/etc/eosio/node_bios/config.ini
info  2018-11-25T03:08:48.515 thread-0  main.cpp:113                  main                 ] nodeos data directory is /opt/eos/build/var/lib/node_bios
error 2018-11-25T03:08:48.516 thread-0  controller.cpp:1596           startup              ] No head block in fork db, perhaps we need to replay
warn  2018-11-25T03:08:48.516 thread-0  controller.cpp:574            initialize_fork_db   ]  Initializing new blockchain with genesis state                  
info  2018-11-25T03:08:48.564 thread-0  chain_plugin.cpp:707          plugin_startup       ] starting chain in read/write mode
info  2018-11-25T03:08:48.564 thread-0  chain_plugin.cpp:711          plugin_startup       ] Blockchain started; head block is #1, genesis timestamp is 2018-11-25T03:08:37.500
info  2018-11-25T03:08:48.565 thread-0  producer_plugin.cpp:714       plugin_startup       ] producer plugin:  plugin_startup() begin
info  2018-11-25T03:08:48.565 thread-0  producer_plugin.cpp:736       plugin_startup       ] Launching block production for 1 producers at 2018-11-25T03:08:48.565.
warn  2018-11-25T03:08:48.565 thread-0  transaction_context.cp:108    deadline_timer       ] Using polled checktime; deadline timer too inaccurate: min:3us max:20835us mean:890us stddev:1181us
info  2018-11-25T03:08:48.565 thread-0  producer_plugin.cpp:748       plugin_startup       ] producer plugin:  plugin_startup() end
info  2018-11-25T03:08:48.573 thread-0  net_plugin.cpp:3017           plugin_startup       ] starting listener, max clients is 25
info  2018-11-25T03:08:48.573 thread-0  http_plugin.cpp:486           plugin_startup       ] start listening for http requests
info  2018-11-25T03:08:48.573 thread-0  chain_api_plugin.cpp:77       plugin_startup       ] starting chain_api_plugin
info  2018-11-25T03:08:48.573 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/abi_bin_to_json
info  2018-11-25T03:08:48.573 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/abi_json_to_bin
info  2018-11-25T03:08:48.574 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/get_abi
info  2018-11-25T03:08:48.574 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/get_account
info  2018-11-25T03:08:48.574 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/get_block
info  2018-11-25T03:08:48.574 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/get_block_header_state
info  2018-11-25T03:08:48.574 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/get_code
info  2018-11-25T03:08:48.574 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/get_code_hash
info  2018-11-25T03:08:48.574 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/get_currency_balance
info  2018-11-25T03:08:48.574 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/get_currency_stats
info  2018-11-25T03:08:48.574 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/get_info
info  2018-11-25T03:08:48.574 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/get_producer_schedule
info  2018-11-25T03:08:48.575 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/get_producers
info  2018-11-25T03:08:48.575 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/get_raw_abi
info  2018-11-25T03:08:48.575 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/get_raw_code_and_abi
info  2018-11-25T03:08:48.575 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/get_required_keys
info  2018-11-25T03:08:48.575 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/get_scheduled_transactions
info  2018-11-25T03:08:48.575 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/get_table_by_scope
info  2018-11-25T03:08:48.575 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/get_table_rows
info  2018-11-25T03:08:48.575 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/get_transaction_id
info  2018-11-25T03:08:48.575 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/push_block
info  2018-11-25T03:08:48.575 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/push_transaction
info  2018-11-25T03:08:48.576 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/push_transactions
info  2018-11-25T03:08:48.576 thread-0  history_api_plugin.cpp:38     plugin_startup       ] starting history_api_plugin
info  2018-11-25T03:08:48.576 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/history/get_actions
info  2018-11-25T03:08:48.576 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/history/get_controlled_accounts
info  2018-11-25T03:08:48.576 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/history/get_key_accounts
info  2018-11-25T03:08:48.576 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/history/get_transaction
debug 2018-11-25T03:08:49.000 thread-0  net_plugin.cpp:2690           accepted_block_heade ] signaled, id = 00000002420f807f4fcfc8d39c3f4c74cc3cf53b600f82d6c5cc082cffe0fc83
debug 2018-11-25T03:08:49.000 thread-0  net_plugin.cpp:2694           accepted_block       ] signaled, id = 00000002420f807f4fcfc8d39c3f4c74cc3cf53b600f82d6c5cc082cffe0fc83
info  2018-11-25T03:08:49.000 thread-0  producer_plugin.cpp:1490      produce_block        ] Produced block 00000002420f807f... #2 @ 2018-11-25T03:08:49.000 signed by eosio [trxs: 0, lib: 0, confirmed: 0]
debug 2018-11-25T03:08:49.000 thread-0  net_plugin.cpp:2703           accepted_transaction ] signaled, id = 62d6fb29acb5dd6d361d27d66551f5f47c2638524682f8bc43e722d05b737855
debug 2018-11-25T03:08:49.001 thread-0  net_plugin.cpp:2708           applied_transaction  ] signaled, id = 62d6fb29acb5dd6d361d27d66551f5f47c2638524682f8bc43e722d05b737855
warn  2018-11-25T03:08:49.381 thread-0  net_plugin.cpp:732            connection           ] accepted network connection
info  2018-11-25T03:08:49.381 thread-0  net_plugin.cpp:2221           handle_message       ] ["connecting client" 127.0.0.1:49748]received handshake_message
debug 2018-11-25T03:08:49.382 thread-0  net_plugin.cpp:2241           handle_message       ] checking for duplicate
debug 2018-11-25T03:08:49.382 thread-0  net_plugin.cpp:2295           handle_message       ] lib_num = 0 peer_lib = 0
debug 2018-11-25T03:08:49.382 thread-0  net_plugin.cpp:953            send_handshake       ] Sending handshake generation 1 to connecting client
debug 2018-11-25T03:08:49.382 thread-0  net_plugin.cpp:1497           recv_handshake       ] sync check state 4
info  2018-11-25T03:08:49.383 thread-0  net_plugin.cpp:2443           handle_message       ] ["localhost:9876 - 5a47771" 127.0.0.1:49748]received request_message:catch_up
debug 2018-11-25T03:08:49.383 thread-0  net_plugin.cpp:839            blk_send_branch      ] head_num = 2
debug 2018-11-25T03:08:49.383 thread-0  net_plugin.cpp:852            blk_send_branch      ] maybe truncating branch at  = 1:0000000110a205af59e300ef2fc16668fa31428e9ad536940cd20c18f5e59021
info  2018-11-25T03:08:49.383 thread-0  net_plugin.cpp:906            blk_send_branch      ] Sent 1 blocks on my fork
debug 2018-11-25T03:08:49.500 thread-0  net_plugin.cpp:2699           irreversible_block   ] signaled, id = 0000000110a205af59e300ef2fc16668fa31428e9ad536940cd20c18f5e59021
debug 2018-11-25T03:08:49.500 thread-0  net_plugin.cpp:2690           accepted_block_heade ] signaled, id = 00000003576ceef8cd698e458b6ce4d88c4d2befb3a45077889c75830ca29e39
debug 2018-11-25T03:08:49.500 thread-0  net_plugin.cpp:2694           accepted_block       ] signaled, id = 00000003576ceef8cd698e458b6ce4d88c4d2befb3a45077889c75830ca29e39
info  2018-11-25T03:08:49.500 thread-0  producer_plugin.cpp:1490      produce_block        ] Produced block 00000003576ceef8... #3 @ 2018-11-25T03:08:49.500 signed by eosio [trxs: 0, lib: 2, confirmed: 0]
debug 2018-11-25T03:08:49.501 thread-0  net_plugin.cpp:2703           accepted_transaction ] signaled, id = 447a98cc847e3ccc5cabc916d4295fdcc3aaca4e61563428ba2ec5175c640273
debug 2018-11-25T03:08:49.501 thread-0  net_plugin.cpp:2708           applied_transaction  ] signaled, id = 447a98cc847e3ccc5cabc916d4295fdcc3aaca4e61563428ba2ec5175c640273
debug 2018-11-25T03:08:50.000 thread-0  net_plugin.cpp:2699           irreversible_block   ] signaled, id = 00000002420f807f4fcfc8d39c3f4c74cc3cf53b600f82d6c5cc082cffe0fc83
debug 2018-11-25T03:08:50.000 thread-0  net_plugin.cpp:2690           accepted_block_heade ] signaled, id = 0000000484aefc763bbc06948cd9950a60fbf5ae93c5362a66238ed1386e6f4f
debug 2018-11-25T03:08:50.000 thread-0  net_plugin.cpp:2694           accepted_block       ] signaled, id = 0000000484aefc763bbc06948cd9950a60fbf5ae93c5362a66238ed1386e6f4f
info  2018-11-25T03:08:50.000 thread-0  producer_plugin.cpp:1490      produce_block        ] Produced block 0000000484aefc76... #4 @ 2018-11-25T03:08:50.000 signed by eosio [trxs: 0, lib: 3, confirmed: 0]
debug 2018-11-25T03:08:50.000 thread-0  net_plugin.cpp:2703           accepted_transaction ] signaled, id = 9c25e2c4ae541e616781a4d30c1780280400cd094a196dffe945c863ac227916
debug 2018-11-25T03:08:50.001 thread-0  net_plugin.cpp:2708           applied_transaction  ] signaled, id = 9c25e2c4ae541e616781a4d30c1780280400cd094a196dffe945c863ac227916
debug 2018-11-25T03:08:50.500 thread-0  net_plugin.cpp:2699           irreversible_block   ] signaled, id = 00000003576ceef8cd698e458b6ce4d88c4d2befb3a45077889c75830ca29e39
debug 2018-11-25T03:08:50.500 thread-0  net_plugin.cpp:2690           accepted_block_heade ] signaled, id = 00000005cd891b6bb0b3cf5d3e7b2b8d933292a463d7e884e6f31976577b459e
debug 2018-11-25T03:08:50.500 thread-0  net_plugin.cpp:2694           accepted_block       ] signaled, id = 00000005cd891b6bb0b3cf5d3e7b2b8d933292a463d7e884e6f31976577b459e
info  2018-11-25T03:08:50.500 thread-0  producer_plugin.cpp:1490      produce_block        ] Produced block 00000005cd891b6b... #5 @ 2018-11-25T03:08:50.500 signed by eosio [trxs: 0, lib: 4, confirmed: 0]
debug 2018-11-25T03:08:50.500 thread-0  net_plugin.cpp:2703           accepted_transaction ] signaled, id = 10ea0c102b3b788c5477ab32e2daeefc43293d6e2b392babea9ae8e4b7966c1c
debug 2018-11-25T03:08:50.501 thread-0  net_plugin.cpp:2708           applied_transaction  ] signaled, id = 10ea0c102b3b788c5477ab32e2daeefc43293d6e2b392babea9ae8e4b7966c1c
debug 2018-11-25T03:08:51.001 thread-0  net_plugin.cpp:2699           irreversible_block   ] signaled, id = 0000000484aefc763bbc06948cd9950a60fbf5ae93c5362a66238ed1386e6f4f
debug 2018-11-25T03:08:51.001 thread-0  net_plugin.cpp:2690           accepted_block_heade ] signaled, id = 000000068a77b728050bc12fa2b15cd901c47f19237959291b4e0329a324ed6e
debug 2018-11-25T03:08:51.001 thread-0  net_plugin.cpp:2694           accepted_block       ] signaled, id = 000000068a77b728050bc12fa2b15cd901c47f19237959291b4e0329a324ed6e
info  2018-11-25T03:08:51.001 thread-0  producer_plugin.cpp:1490      produce_block        ] Produced block 000000068a77b728... #6 @ 2018-11-25T03:08:51.000 signed by eosio [trxs: 0, lib: 5, confirmed: 0]
debug 2018-11-25T03:08:51.001 thread-0  net_plugin.cpp:2703           accepted_transaction ] signaled, id = 627428192866b4d5096a2211e5325755355980bfc9ea32c98ee752ee62fb8492
debug 2018-11-25T03:08:51.001 thread-0  net_plugin.cpp:2708           applied_transaction  ] signaled, id = 627428192866b4d5096a2211e5325755355980bfc9ea32c98ee752ee62fb8492
   =================================================================
   Contents of etc/eosio/node_00/config.ini:
blocks-dir = blocks
http-server-address = 127.0.0.1:8888
http-validate-host = false
p2p-listen-endpoint = 0.0.0.0:9876
p2p-server-address = localhost:9876
allowed-connection = any
p2p-peer-address = localhost:9776
private-key = ["EOS6hiTAacXazWoGLzREn6mpiVeBWkEfNn8Zp9m34UsSqKGETpcp7","5J9sMH4ExfHkEsJGRfzYcDE9B1Kg6NfBc5LkwuTpHSPxBEdnV4e"]
producer-name = defproducera
producer-name = defproducerb
producer-name = defproducerc
producer-name = defproducerd
producer-name = defproducere
producer-name = defproducerf
producer-name = defproducerg
producer-name = defproducerh
producer-name = defproduceri
producer-name = defproducerj
producer-name = defproducerk
producer-name = defproducerl
producer-name = defproducerm
producer-name = defproducern
producer-name = defproducero
producer-name = defproducerp
producer-name = defproducerq
producer-name = defproducerr
producer-name = defproducers
producer-name = defproducert
producer-name = defproduceru
plugin = eosio::producer_plugin
plugin = eosio::net_plugin
plugin = eosio::chain_api_plugin
plugin = eosio::history_api_plugin
   =================================================================
   Contents of etc/eosio/node_00/genesis.json:
{
  "initial_timestamp": "2018-06-01T12:00:00.000",
  "initial_key": "EOS6MRyAjQq8ud7hVNYcfnVPJqcVpscN5So8BhtHuGYqET5GDW5CV",
  "initial_configuration": {
    "max_block_net_usage": 1048576,
    "target_block_net_usage_pct": 1000,
    "max_transaction_net_usage": 524288,
    "base_per_transaction_net_usage": 12,
    "net_usage_leeway": 500,
    "context_free_discount_net_usage_num": 20,
    "context_free_discount_net_usage_den": 100,
    "max_block_cpu_usage": 160000000,
    "target_block_cpu_usage_pct": 1000,
    "max_transaction_cpu_usage": 150000000,
    "min_transaction_cpu_usage": 100,
    "max_transaction_lifetime": 3600,
    "deferred_trx_expiration_window": 600,
    "max_transaction_delay": 3888000,
    "max_inline_action_size": 4096,
    "max_inline_action_depth": 4,
    "max_authority_depth": 6
  }
}   =================================================================
   Contents of var/lib/node_00/stderr.txt:
info  2018-11-25T03:08:49.103 thread-0  chain_plugin.cpp:333          plugin_initialize    ] initializing chain plugin
info  2018-11-25T03:08:49.103 thread-0  chain_plugin.cpp:585          plugin_initialize    ] Using genesis state provided in '/opt/eos/build/etc/eosio/node_00/genesis.json'
debug 2018-11-25T03:08:49.103 thread-0  chain_plugin.cpp:314          calculate_genesis_ti ] pausing 446000 microseconds to the next interval
info  2018-11-25T03:08:49.103 thread-0  chain_plugin.cpp:317          calculate_genesis_ti ] Adjusting genesis timestamp to 2018-11-25T03:08:37.500
warn  2018-11-25T03:08:49.103 thread-0  chain_plugin.cpp:592          plugin_initialize    ] Starting up fresh blockchain with provided genesis state.
warn  2018-11-25T03:08:49.347 thread-0  producer_plugin.cpp:610       plugin_initialize    ] "private-key" is DEPRECATED, use "signature-provider=EOS6hiTAacXazWoGLzREn6mpiVeBWkEfNn8Zp9m34UsSqKGETpcp7=KEY:***************************************************"
info  2018-11-25T03:08:49.347 thread-0  net_plugin.cpp:2901           plugin_initialize    ] Initialize net plugin
info  2018-11-25T03:08:49.347 thread-0  net_plugin.cpp:2927           plugin_initialize    ] host: 0.0.0.0 port: 9876 
info  2018-11-25T03:08:49.348 thread-0  net_plugin.cpp:2998           plugin_initialize    ] my node_id is 5a477712559e01243d8797ac2358e2b40baa4d6045869d379213343aeb5bc3e1
info  2018-11-25T03:08:49.348 thread-0  http_plugin.cpp:422           plugin_initialize    ] configured http to listen on 127.0.0.1:8888
warn  2018-11-25T03:08:49.348 thread-0  history_plugin.cpp:321        plugin_initialize    ] --filter-on * enabled. This can fill shared_mem, causing nodeos to stop.
opened GELF socket to endpoint 10.160.11.21:12201
info  2018-11-25T03:08:49.348 thread-0  main.cpp:110                  main                 ] nodeos version v1.4.4
info  2018-11-25T03:08:49.348 thread-0  main.cpp:111                  main                 ] eosio root is /root/.local/share
info  2018-11-25T03:08:49.348 thread-0  main.cpp:112                  main                 ] nodeos using configuration file /opt/eos/build/etc/eosio/node_00/config.ini
info  2018-11-25T03:08:49.348 thread-0  main.cpp:113                  main                 ] nodeos data directory is /opt/eos/build/var/lib/node_00
error 2018-11-25T03:08:49.349 thread-0  controller.cpp:1596           startup              ] No head block in fork db, perhaps we need to replay
warn  2018-11-25T03:08:49.349 thread-0  controller.cpp:574            initialize_fork_db   ]  Initializing new blockchain with genesis state                  
info  2018-11-25T03:08:49.377 thread-0  chain_plugin.cpp:707          plugin_startup       ] starting chain in read/write mode
info  2018-11-25T03:08:49.377 thread-0  chain_plugin.cpp:711          plugin_startup       ] Blockchain started; head block is #1, genesis timestamp is 2018-11-25T03:08:37.500
info  2018-11-25T03:08:49.377 thread-0  producer_plugin.cpp:714       plugin_startup       ] producer plugin:  plugin_startup() begin
info  2018-11-25T03:08:49.377 thread-0  producer_plugin.cpp:736       plugin_startup       ] Launching block production for 21 producers at 2018-11-25T03:08:49.377.
info  2018-11-25T03:08:49.377 thread-0  producer_plugin.cpp:748       plugin_startup       ] producer plugin:  plugin_startup() end
info  2018-11-25T03:08:49.377 thread-0  net_plugin.cpp:3017           plugin_startup       ] starting listener, max clients is 25
warn  2018-11-25T03:08:49.378 thread-0  net_plugin.cpp:708            connection           ] created connection to localhost:9776
info  2018-11-25T03:08:49.378 thread-0  net_plugin.cpp:1921           connect              ] host: localhost port: 9776 
info  2018-11-25T03:08:49.378 thread-0  http_plugin.cpp:486           plugin_startup       ] start listening for http requests
info  2018-11-25T03:08:49.378 thread-0  chain_api_plugin.cpp:77       plugin_startup       ] starting chain_api_plugin
info  2018-11-25T03:08:49.378 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/abi_bin_to_json
info  2018-11-25T03:08:49.378 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/abi_json_to_bin
info  2018-11-25T03:08:49.378 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/get_abi
info  2018-11-25T03:08:49.378 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/get_account
info  2018-11-25T03:08:49.378 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/get_block
info  2018-11-25T03:08:49.379 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/get_block_header_state
info  2018-11-25T03:08:49.379 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/get_code
info  2018-11-25T03:08:49.379 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/get_code_hash
info  2018-11-25T03:08:49.379 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/get_currency_balance
info  2018-11-25T03:08:49.379 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/get_currency_stats
info  2018-11-25T03:08:49.379 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/get_info
info  2018-11-25T03:08:49.379 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/get_producer_schedule
info  2018-11-25T03:08:49.379 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/get_producers
info  2018-11-25T03:08:49.379 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/get_raw_abi
info  2018-11-25T03:08:49.379 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/get_raw_code_and_abi
info  2018-11-25T03:08:49.379 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/get_required_keys
info  2018-11-25T03:08:49.380 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/get_scheduled_transactions
info  2018-11-25T03:08:49.380 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/get_table_by_scope
info  2018-11-25T03:08:49.380 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/get_table_rows
info  2018-11-25T03:08:49.380 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/get_transaction_id
info  2018-11-25T03:08:49.380 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/push_block
info  2018-11-25T03:08:49.380 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/push_transaction
info  2018-11-25T03:08:49.380 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/chain/push_transactions
info  2018-11-25T03:08:49.380 thread-0  history_api_plugin.cpp:38     plugin_startup       ] starting history_api_plugin
info  2018-11-25T03:08:49.380 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/history/get_actions
info  2018-11-25T03:08:49.380 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/history/get_controlled_accounts
info  2018-11-25T03:08:49.381 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/history/get_key_accounts
info  2018-11-25T03:08:49.381 thread-0  http_plugin.cpp:554           add_handler          ] add api url: /v1/history/get_transaction
debug 2018-11-25T03:08:49.381 thread-0  net_plugin.cpp:953            send_handshake       ] Sending handshake generation 1 to localhost:9776
info  2018-11-25T03:08:49.382 thread-0  net_plugin.cpp:2221           handle_message       ] ["localhost:9776" 127.0.0.1:9776]received handshake_message
debug 2018-11-25T03:08:49.382 thread-0  net_plugin.cpp:2241           handle_message       ] checking for duplicate
debug 2018-11-25T03:08:49.382 thread-0  net_plugin.cpp:2295           handle_message       ] lib_num = 0 peer_lib = 0
debug 2018-11-25T03:08:49.382 thread-0  net_plugin.cpp:1492           recv_handshake       ] sync check state 3
info  2018-11-25T03:08:49.382 thread-0  net_plugin.cpp:1524           verify_catchup       ] got a catch_up notice while in in sync, fork head num = 2 target LIB = 0 next_expected = 1
debug 2018-11-25T03:08:49.383 thread-0  net_plugin.cpp:1275           set_state            ] old state in sync becoming head catchup
info  2018-11-25T03:08:49.383 thread-0  net_plugin.cpp:2377           handle_message       ] ["localhost:9776 - 62101f2" 127.0.0.1:9776]received notice_message
debug 2018-11-25T03:08:49.383 thread-0  net_plugin.cpp:2412           handle_message       ] this is a catch up notice with 2 blocks
info  2018-11-25T03:08:49.383 thread-0  net_plugin.cpp:1538           recv_notice          ] sync_manager got catch up block notice
debug 2018-11-25T03:08:49.384 thread-0  net_plugin.cpp:2434           handle_message       ] send req = false
debug 2018-11-25T03:08:49.384 thread-0  net_plugin.cpp:2521           handle_message       ] canceling wait on localhost:9776 - 62101f2
debug 2018-11-25T03:08:49.384 thread-0  net_plugin.cpp:1667           recv_block           ] canceling wait on localhost:9776 - 62101f2
info  2018-11-25T03:08:49.384 thread-0  net_plugin.cpp:2537           handle_message       ] ["localhost:9776 - 62101f2" 127.0.0.1:9776]received signed_block : #2 block age in secs = 0
debug 2018-11-25T03:08:49.384 thread-0  net_plugin.cpp:2690           accepted_block_heade ] signaled, id = 00000002420f807f4fcfc8d39c3f4c74cc3cf53b600f82d6c5cc082cffe0fc83
warn  2018-11-25T03:08:49.384 thread-0  transaction_context.cp:108    deadline_timer       ] Using polled checktime; deadline timer too inaccurate: min:3us max:17489us mean:1691us stddev:1948us
debug 2018-11-25T03:08:49.384 thread-0  net_plugin.cpp:2703           accepted_transaction ] signaled, id = 953a98713d53bcae5971e6bf51d49b119f934e2dba8612044dae91f2fed4e68c
debug 2018-11-25T03:08:49.384 thread-0  net_plugin.cpp:2708           applied_transaction  ] signaled, id = 953a98713d53bcae5971e6bf51d49b119f934e2dba8612044dae91f2fed4e68c
debug 2018-11-25T03:08:49.385 thread-0  net_plugin.cpp:2694           accepted_block       ] signaled, id = 00000002420f807f4fcfc8d39c3f4c74cc3cf53b600f82d6c5cc082cffe0fc83
info  2018-11-25T03:08:49.385 thread-0  producer_plugin.cpp:337       on_incoming_block    ] Received block 420f807f4fcfc8d3... #2 @ 2018-11-25T03:08:49.000 signed by eosio [trxs: 0, lib: 0, conf: 0, latency: 385 ms]
debug 2018-11-25T03:08:49.385 thread-0  net_plugin.cpp:2703           accepted_transaction ] signaled, id = 62d6fb29acb5dd6d361d27d66551f5f47c2638524682f8bc43e722d05b737855
debug 2018-11-25T03:08:49.385 thread-0  net_plugin.cpp:2708           applied_transaction  ] signaled, id = 62d6fb29acb5dd6d361d27d66551f5f47c2638524682f8bc43e722d05b737855
debug 2018-11-25T03:08:49.385 thread-0  net_plugin.cpp:1565           recv_block           ]  got block 2 from localhost:9776 - 62101f2
debug 2018-11-25T03:08:49.385 thread-0  net_plugin.cpp:1575           recv_block           ] sync_manager in head_catchup state
debug 2018-11-25T03:08:49.385 thread-0  net_plugin.cpp:1275           set_state            ] old state head catchup becoming in sync
debug 2018-11-25T03:08:49.501 thread-0  net_plugin.cpp:2521           handle_message       ] canceling wait on localhost:9776 - 62101f2
debug 2018-11-25T03:08:49.501 thread-0  net_plugin.cpp:1667           recv_block           ] canceling wait on localhost:9776 - 62101f2
info  2018-11-25T03:08:49.501 thread-0  net_plugin.cpp:2537           handle_message       ] ["localhost:9776 - 62101f2" 127.0.0.1:9776]received signed_block : #3 block age in secs = 0
debug 2018-11-25T03:08:49.501 thread-0  net_plugin.cpp:2699           irreversible_block   ] signaled, id = 0000000110a205af59e300ef2fc16668fa31428e9ad536940cd20c18f5e59021
debug 2018-11-25T03:08:49.502 thread-0  net_plugin.cpp:2690           accepted_block_heade ] signaled, id = 00000003576ceef8cd698e458b6ce4d88c4d2befb3a45077889c75830ca29e39
debug 2018-11-25T03:08:49.502 thread-0  net_plugin.cpp:2703           accepted_transaction ] signaled, id = 62d6fb29acb5dd6d361d27d66551f5f47c2638524682f8bc43e722d05b737855
debug 2018-11-25T03:08:49.502 thread-0  net_plugin.cpp:2708           applied_transaction  ] signaled, id = 62d6fb29acb5dd6d361d27d66551f5f47c2638524682f8bc43e722d05b737855
debug 2018-11-25T03:08:49.502 thread-0  net_plugin.cpp:2694           accepted_block       ] signaled, id = 00000003576ceef8cd698e458b6ce4d88c4d2befb3a45077889c75830ca29e39
info  2018-11-25T03:08:49.502 thread-0  producer_plugin.cpp:337       on_incoming_block    ] Received block 576ceef8cd698e45... #3 @ 2018-11-25T03:08:49.500 signed by eosio [trxs: 0, lib: 2, conf: 0, latency: 2 ms]
debug 2018-11-25T03:08:49.502 thread-0  net_plugin.cpp:2703           accepted_transaction ] signaled, id = 447a98cc847e3ccc5cabc916d4295fdcc3aaca4e61563428ba2ec5175c640273
debug 2018-11-25T03:08:49.502 thread-0  net_plugin.cpp:2708           applied_transaction  ] signaled, id = 447a98cc847e3ccc5cabc916d4295fdcc3aaca4e61563428ba2ec5175c640273
debug 2018-11-25T03:08:49.502 thread-0  net_plugin.cpp:1565           recv_block           ]  got block 3 from localhost:9776 - 62101f2
debug 2018-11-25T03:08:50.001 thread-0  net_plugin.cpp:2521           handle_message       ] canceling wait on localhost:9776 - 62101f2
debug 2018-11-25T03:08:50.001 thread-0  net_plugin.cpp:1667           recv_block           ] canceling wait on localhost:9776 - 62101f2
info  2018-11-25T03:08:50.001 thread-0  net_plugin.cpp:2537           handle_message       ] ["localhost:9776 - 62101f2" 127.0.0.1:9776]received signed_block : #4 block age in secs = 0
debug 2018-11-25T03:08:50.001 thread-0  net_plugin.cpp:2699           irreversible_block   ] signaled, id = 00000002420f807f4fcfc8d39c3f4c74cc3cf53b600f82d6c5cc082cffe0fc83
debug 2018-11-25T03:08:50.001 thread-0  net_plugin.cpp:2690           accepted_block_heade ] signaled, id = 0000000484aefc763bbc06948cd9950a60fbf5ae93c5362a66238ed1386e6f4f
debug 2018-11-25T03:08:50.001 thread-0  net_plugin.cpp:2703           accepted_transaction ] signaled, id = 447a98cc847e3ccc5cabc916d4295fdcc3aaca4e61563428ba2ec5175c640273
debug 2018-11-25T03:08:50.002 thread-0  net_plugin.cpp:2708           applied_transaction  ] signaled, id = 447a98cc847e3ccc5cabc916d4295fdcc3aaca4e61563428ba2ec5175c640273
debug 2018-11-25T03:08:50.002 thread-0  net_plugin.cpp:2694           accepted_block       ] signaled, id = 0000000484aefc763bbc06948cd9950a60fbf5ae93c5362a66238ed1386e6f4f
info  2018-11-25T03:08:50.002 thread-0  producer_plugin.cpp:337       on_incoming_block    ] Received block 84aefc763bbc0694... #4 @ 2018-11-25T03:08:50.000 signed by eosio [trxs: 0, lib: 3, conf: 0, latency: 2 ms]
debug 2018-11-25T03:08:50.002 thread-0  net_plugin.cpp:2703           accepted_transaction ] signaled, id = 9c25e2c4ae541e616781a4d30c1780280400cd094a196dffe945c863ac227916
debug 2018-11-25T03:08:50.002 thread-0  net_plugin.cpp:2708           applied_transaction  ] signaled, id = 9c25e2c4ae541e616781a4d30c1780280400cd094a196dffe945c863ac227916
debug 2018-11-25T03:08:50.002 thread-0  net_plugin.cpp:1565           recv_block           ]  got block 4 from localhost:9776 - 62101f2
debug 2018-11-25T03:08:50.501 thread-0  net_plugin.cpp:2521           handle_message       ] canceling wait on localhost:9776 - 62101f2
debug 2018-11-25T03:08:50.501 thread-0  net_plugin.cpp:1667           recv_block           ] canceling wait on localhost:9776 - 62101f2
info  2018-11-25T03:08:50.501 thread-0  net_plugin.cpp:2537           handle_message       ] ["localhost:9776 - 62101f2" 127.0.0.1:9776]received signed_block : #5 block age in secs = 0
debug 2018-11-25T03:08:50.501 thread-0  net_plugin.cpp:2699           irreversible_block   ] signaled, id = 00000003576ceef8cd698e458b6ce4d88c4d2befb3a45077889c75830ca29e39
debug 2018-11-25T03:08:50.501 thread-0  net_plugin.cpp:2690           accepted_block_heade ] signaled, id = 00000005cd891b6bb0b3cf5d3e7b2b8d933292a463d7e884e6f31976577b459e
debug 2018-11-25T03:08:50.501 thread-0  net_plugin.cpp:2703           accekill: (2809): No such process
kill: (2810): No such process
pted_transaction ] signaled, id = 9c25e2c4ae541e616781a4d30c1780280400cd094a196dffe945c863ac227916
debug 2018-11-25T03:08:50.502 thread-0  net_plugin.cpp:2708           applied_transaction  ] signaled, id = 9c25e2c4ae541e616781a4d30c1780280400cd094a196dffe945c863ac227916
debug 2018-11-25T03:08:50.502 thread-0  net_plugin.cpp:2694           accepted_block       ] signaled, id = 00000005cd891b6bb0b3cf5d3e7b2b8d933292a463d7e884e6f31976577b459e
info  2018-11-25T03:08:50.502 thread-0  producer_plugin.cpp:337       on_incoming_block    ] Received block cd891b6bb0b3cf5d... #5 @ 2018-11-25T03:08:50.500 signed by eosio [trxs: 0, lib: 4, conf: 0, latency: 2 ms]
debug 2018-11-25T03:08:50.502 thread-0  net_plugin.cpp:2703           accepted_transaction ] signaled, id = 10ea0c102b3b788c5477ab32e2daeefc43293d6e2b392babea9ae8e4b7966c1c
debug 2018-11-25T03:08:50.502 thread-0  net_plugin.cpp:2708           applied_transaction  ] signaled, id = 10ea0c102b3b788c5477ab32e2daeefc43293d6e2b392babea9ae8e4b7966c1c
debug 2018-11-25T03:08:50.502 thread-0  net_plugin.cpp:1565           recv_block           ]  got block 5 from localhost:9776 - 62101f2
debug 2018-11-25T03:08:51.002 thread-0  net_plugin.cpp:2521           handle_message       ] canceling wait on localhost:9776 - 62101f2
debug 2018-11-25T03:08:51.002 thread-0  net_plugin.cpp:1667           recv_block           ] canceling wait on localhost:9776 - 62101f2
info  2018-11-25T03:08:51.002 thread-0  net_plugin.cpp:2537           handle_message       ] ["localhost:9776 - 62101f2" 127.0.0.1:9776]received signed_block : #6 block age in secs = 0
debug 2018-11-25T03:08:51.002 thread-0  net_plugin.cpp:2699           irreversible_block   ] signaled, id = 0000000484aefc763bbc06948cd9950a60fbf5ae93c5362a66238ed1386e6f4f
debug 2018-11-25T03:08:51.002 thread-0  net_plugin.cpp:2690           accepted_block_heade ] signaled, id = 000000068a77b728050bc12fa2b15cd901c47f19237959291b4e0329a324ed6e
debug 2018-11-25T03:08:51.002 thread-0  net_plugin.cpp:2703           accepted_transaction ] signaled, id = 10ea0c102b3b788c5477ab32e2daeefc43293d6e2b392babea9ae8e4b7966c1c
debug 2018-11-25T03:08:51.002 thread-0  net_plugin.cpp:2708           applied_transaction  ] signaled, id = 10ea0c102b3b788c5477ab32e2daeefc43293d6e2b392babea9ae8e4b7966c1c
debug 2018-11-25T03:08:51.003 thread-0  net_plugin.cpp:2694           accepted_block       ] signaled, id = 000000068a77b728050bc12fa2b15cd901c47f19237959291b4e0329a324ed6e
info  2018-11-25T03:08:51.003 thread-0  producer_plugin.cpp:337       on_incoming_block    ] Received block 8a77b728050bc12f... #6 @ 2018-11-25T03:08:51.000 signed by eosio [trxs: 0, lib: 5, conf: 0, latency: 3 ms]
debug 2018-11-25T03:08:51.003 thread-0  net_plugin.cpp:2703           accepted_transaction ] signaled, id = 627428192866b4d5096a2211e5325755355980bfc9ea32c98ee752ee62fb8492
debug 2018-11-25T03:08:51.003 thread-0  net_plugin.cpp:2708           applied_transaction  ] signaled, id = 627428192866b4d5096a2211e5325755355980bfc9ea32c98ee752ee62fb8492
debug 2018-11-25T03:08:51.003 thread-0  net_plugin.cpp:1565           recv_block           ]  got block 6 from localhost:9776 - 62101f2
info  2018-11-25T03:08:51.221 thread-0  net_plugin.cpp:2142           operator()           ] Peer localhost:9776 - 62101f2 closed connection
debug 2018-11-25T03:08:51.222 thread-0  net_plugin.cpp:780            close                ] canceling wait on localhost:9776
 == Errors see above ==
 == cout/cerr pairs from last 7 calls to Utils. ==
 cmd={programs/cleos/cleos --url http://localhost:8888 --no-auto-keosd get info}
 cout={b'{\n  "server_version": "59626f1e",\n  "chain_id": "b4e2edb37cc533c644a8865eaf6b1227a8fdc84c943d1b2bc9721e1909eda538",\n  "head_block_num": 6,\n  "last_irreversible_block_num": 5,\n  "last_irreversible_block_id": "00000005cd891b6bb0b3cf5d3e7b2b8d933292a463d7e884e6f31976577b459e",\n  "head_block_id": "000000068a77b728050bc12fa2b15cd901c47f19237959291b4e0329a324ed6e",\n  "head_block_time": "2018-11-25T03:08:51.000",\n  "head_block_producer": "eosio",\n  "virtual_block_cpu_limit": 160641601,\n  "virtual_block_net_limit": 1053831,\n  "block_cpu_limit": 159999900,\n  "block_net_limit": 1048576,\n  "server_version_string": "v1.4.4"\n}\n'}
 cerr={b''}

 cmd={programs/cleos/cleos --url http://localhost:8888 --no-auto-keosd get info}
 cout={b''}
 cerr={b'Failed to connect to nodeos at http://localhost:8888; is nodeos running?\n'}

 cmd={programs/cleos/cleos --url http://localhost:8888 --no-auto-keosd get info}
 cout={b''}
 cerr={b'Failed to connect to nodeos at http://localhost:8888; is nodeos running?\n'}

 cmd={programs/cleos/cleos --url http://localhost:8888 --no-auto-keosd get info}
 cout={b''}
 cerr={b'Failed to connect to nodeos at http://localhost:8888; is nodeos running?\n'}

 cmd={programs/cleos/cleos --url http://localhost:8888 --no-auto-keosd get info}
 cout={b''}
 cerr={b'Failed to connect to nodeos at http://localhost:8888; is nodeos running?\n'}

 cmd={pgrep -a nodeos}
 cout={b'2809 programs/nodeos/nodeos --max-transaction-time -1 --abi-serializer-max-time-ms 990000 --filter-on * --p2p-max-nodes-per-host 1 --contracts-console --config-dir etc/eosio/node_bios --data-dir var/lib/node_bios --genesis-json etc/eosio/node_bios/genesis.json --genesis-timestamp 2018-11-25T03:08:37.054\n2810 programs/nodeos/nodeos --max-transaction-time -1 --abi-serializer-max-time-ms 990000 --filter-on * --p2p-max-nodes-per-host 1 --contracts-console --config-dir etc/eosio/node_00 --data-dir var/lib/node_00 --genesis-json etc/eosio/node_00/genesis.json --genesis-timestamp 2018-11-25T03:08:37.054\n'}
 cerr={b''}

 cmd={programs/cleos/cleos version client}
 cout={b'Build version: 59626f1e\n'}
 cerr={b''}

 == cmd/cout/cerr pairs done. ==
 Shut down the cluster.
  cmd: programs/eosio-launcher/eosio-launcher -k 9
  cmd: pkill -9 nodeos
Traceback (most recent call last):
  File "/opt/eos/build/tests/validate-dirty-db.py", line 93, in <module>
    assert(ret[0])
AssertionError


0% tests passed, 1 tests failed out of 1

Label Time Summary:
nonparallelizable_tests    =  17.40 sec*proc (1 test)

Total Test time (real) =  17.41 sec

The following tests FAILED:
	 42 - validate_dirty_db_test (Failed)

@jgiszczak Edited for clarity.

@jgiszczak
Copy link
Contributor

I did verify that the --repeat-until-fail 20 argument does work, and got 20 successful runs in a row.

You can try being certain your environment is clean. Be sure no EOS.IO processes are running:

pkill -9 eos

to shut down any instances of nodeos, cleos, or keosd. Then

root@hx-VirtualBox:/opt/eos/build# rm -r etc/eosio/node_bios
root@hx-VirtualBox:/opt/eos/build# rm -r etc/eosio/node_00
root@hx-VirtualBox:/opt/eos/build# rm -r var/lib/*

to be sure no stray configuration files are left in the filesystem locations the tests use. The tests do these things themselves, so this is unlikely to solve the problem, but it doesn't hurt to be sure.

Beyond that, try running the entire test suite again with make test. There may be some timing-related problem with the test being revealed on your specific system.

@namehuxing
Copy link
Author

image

I've tried, and I still have the same error, and I've reinstalled a virtual machine to verify it, but I still have the same problem (is there any configuration after installing the ubuntu-18.04.1-desktop version of the virtual machine)? I suspected that it was a virtual machine CPU concurrent problem, also doubted whether it was an IPv6 problem, have done experiments, but all reported the same error, now the error seems to be unable to obtain node information.

error.txt

@jgiszczak
Copy link
Contributor

The strangest part of this report is how all of your other tests pass. Your initial problem report showed complete success outside of the one failing test, yet many of the other tests do very similar things in terms of setup. Are you getting consistent passing results for all other tests?

@spoonincode
Copy link
Contributor

Support ticket with no response from submitter in 6 months; closing

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Projects
None yet
Development

No branches or pull requests

4 participants