Question on chat example and TCP vs QUIC

[Derrreks]

I am working with the chat example locally: https://github.com/libp2p/rust-libp2p/tree/master/examples/chat

In the example, both TCP and QUIC are configured:

.with_tcp(
    tcp::Config::default(),
    noise::Config::new,
    yamux::Config::default,
)?
.with_quic()

...

swarm.listen_on("/ip4/0.0.0.0/udp/0/quic-v1".parse()?)?;
swarm.listen_on("/ip4/0.0.0.0/tcp/0".parse()?)?;

And the example works locally with these configurations.

However if I comment out the lines related to QUIC, and so rely only on TCP, I often get InsufficientPeers errors when I try to send a message. If I close all connections and wait and reopen, it will sometimes work again. The opposite, relying only on QUIC, reliably works. From research it seems that InsufficientPeers can refer to being connected to peers but not having subscribers to the topic, but if that were the issue I'd expect it to fail in all cases (given that part of the code is not changing here).

Is this expected? Is there further implementation needed for only TCP for that to be more reliable? Might there be issues around ports remaining opening or something?

Thanks for any help.

[dariusc93]

Hey! Could you provide the logs? How soon after connection do you send a message?

[Derrreks]

Hi @dariusc93 - thanks for getting back. So the logs from the example are quite basic:

> Terminal 1:

Peer Id: 12D3KooWBUg7Li1zddUqXh7HKT7qTNRohpsCxgT7KbZACTzrQEy1
Local node is listening on /ip4/127.0.0.1/tcp/55489
Local node is listening on /ip4/10.0.0.130/tcp/55489
mDNS discovered a new peer: 12D3KooWKbHqBobq42PRk7j1YnAcgfFWmMr212NFXgmjoPoHNmqj
hello
Publish error: InsufficientPeers

> Terminal 2

Peer Id: 12D3KooWKbHqBobq42PRk7j1YnAcgfFWmMr212NFXgmjoPoHNmqj
Local node is listening on /ip4/127.0.0.1/tcp/55491
Local node is listening on /ip4/10.0.0.130/tcp/55491
mDNS discovered a new peer: 12D3KooWBUg7Li1zddUqXh7HKT7qTNRohpsCxgT7KbZACTzrQEy1

I'm sending a message relatively quickly after the two terminals are opened, perhaps just a few seconds. I've continued messing with it, and it seems almost like every other time I run it it works and the other half reports that error.

Let me know if there's anything I can log out or try that may be helpful.

[Derrreks]

Okay I've kept messing with it:

If I am running it successfully, close all instances and then re-initialize them all - it will fail. However, if I wait a minute after closing it seems to reliably work.

So this leads me to believe that perhaps something is remaining open that is causing issues until it gets cleaned up somehow?

[dariusc93]

Thanks! To get the logs can you use RUST_LOG=debug prior to running the example? Eg RUST_LOG=debug cargo run. This would output the logs to console :) The other option would probably be to output all the events to see if an error is emitted from swarm, but the latter may provide more detail information.

[Derrreks]

Okay here's some logs from attempting to send a message when it failed:

> Terminal 1

   Compiling blockchain v0.1.0 (/Users/derek/Documents/code/blockchain)
    Finished `dev` profile [unoptimized + debuginfo] target(s) in 2.40s
     Running `target/debug/blockchain`
Peer Id: 12D3KooWKkZzA7Bgi49uberYXfmFMbjeGST4JbHg7oVFpE17Pitq
2024-11-12T04:03:27.507735Z  INFO libp2p_swarm: local_peer_id=12D3KooWKkZzA7Bgi49uberYXfmFMbjeGST4JbHg7oVFpE17Pitq
2024-11-12T04:03:27.507908Z DEBUG libp2p_gossipsub::behaviour: Subscribing to topic topic=main
2024-11-12T04:03:27.507996Z DEBUG libp2p_gossipsub::behaviour: Running JOIN for topic topic=main
2024-11-12T04:03:27.508087Z DEBUG libp2p_gossipsub::behaviour: RANDOM PEERS: Got 0 peers
2024-11-12T04:03:27.508117Z DEBUG libp2p_gossipsub::behaviour: JOIN: Inserting 0 random peers into the mesh
2024-11-12T04:03:27.508235Z DEBUG libp2p_gossipsub::behaviour: Completed JOIN for topic topic=main
2024-11-12T04:03:27.508242Z DEBUG libp2p_gossipsub::behaviour: Subscribed to topic topic=main
2024-11-12T04:03:27.508497Z DEBUG libp2p_tcp: listening on 0.0.0.0:0
2024-11-12T04:03:27.508925Z  INFO Swarm::poll: libp2p_mdns::behaviour::iface: creating instance on iface address address=10.0.0.130
2024-11-12T04:03:27.509134Z DEBUG Swarm::poll: libp2p_tcp: New listen address address=/ip4/127.0.0.1/tcp/55955
2024-11-12T04:03:27.509182Z DEBUG Swarm::poll: libp2p_swarm: New listener address listener=ListenerId(1) address=/ip4/127.0.0.1/tcp/55955
Local node is listening on /ip4/127.0.0.1/tcp/55955
2024-11-12T04:03:27.509236Z DEBUG Swarm::poll: libp2p_tcp: New listen address address=/ip4/10.0.0.130/tcp/55955
2024-11-12T04:03:27.509250Z DEBUG Swarm::poll: libp2p_swarm: New listener address listener=ListenerId(1) address=/ip4/10.0.0.130/tcp/55955
Local node is listening on /ip4/10.0.0.130/tcp/55955
2024-11-12T04:03:28.296562Z  INFO Swarm::poll: libp2p_mdns::behaviour: discovered peer on address peer=12D3KooWEjgwKKx5BuUD4xWxsW7Df8xB1SSD9RmNwJeAy4NaBgEg address=/ip4/10.0.0.130/tcp/55956/p2p/12D3KooWEjgwKKx5BuUD4xWxsW7Df8xB1SSD9RmNwJeAy4NaBgEg
mDNS discovered a new peer: 12D3KooWEjgwKKx5BuUD4xWxsW7Df8xB1SSD9RmNwJeAy4NaBgEg
2024-11-12T04:03:28.296729Z DEBUG libp2p_gossipsub::behaviour: Adding explicit peer peer=12D3KooWEjgwKKx5BuUD4xWxsW7Df8xB1SSD9RmNwJeAy4NaBgEg
2024-11-12T04:03:28.296773Z DEBUG libp2p_gossipsub::behaviour: Connecting to explicit peer peer=12D3KooWEjgwKKx5BuUD4xWxsW7Df8xB1SSD9RmNwJeAy4NaBgEg
2024-11-12T04:03:28.296878Z DEBUG Swarm::poll: libp2p_tcp: dialing address address=10.0.0.130:55956
2024-11-12T04:03:28.297433Z DEBUG Transport::dial{address=/ip4/10.0.0.130/tcp/55956/p2p/12D3KooWEjgwKKx5BuUD4xWxsW7Df8xB1SSD9RmNwJeAy4NaBgEg}: multistream_select::dialer_select: Dialer: Proposed protocol: /noise    
2024-11-12T04:03:28.297468Z DEBUG Transport::dial{address=/ip4/10.0.0.130/tcp/55956/p2p/12D3KooWEjgwKKx5BuUD4xWxsW7Df8xB1SSD9RmNwJeAy4NaBgEg}: multistream_select::dialer_select: Dialer: Expecting proposed protocol: /noise    
2024-11-12T04:03:28.299001Z DEBUG Transport::dial{address=/ip4/10.0.0.130/tcp/55956/p2p/12D3KooWEjgwKKx5BuUD4xWxsW7Df8xB1SSD9RmNwJeAy4NaBgEg}: multistream_select::negotiated: Negotiated: Received confirmation for protocol: /noise    
2024-11-12T04:03:28.299794Z DEBUG Transport::dial{address=/ip4/10.0.0.130/tcp/55956/p2p/12D3KooWEjgwKKx5BuUD4xWxsW7Df8xB1SSD9RmNwJeAy4NaBgEg}: libp2p_core::upgrade::apply: Failed to upgrade outbound stream upgrade=/noise
2024-11-12T04:03:28.300116Z DEBUG Swarm::poll: libp2p_swarm: Connection attempt to peer failed with Transport([(/ip4/10.0.0.130/tcp/55956/p2p/12D3KooWEjgwKKx5BuUD4xWxsW7Df8xB1SSD9RmNwJeAy4NaBgEg, Other(Custom { kind: Other, error: Other(Left(Right(Apply(Io(Custom { kind: InvalidData, error: Input }))))) }))]). peer=12D3KooWEjgwKKx5BuUD4xWxsW7Df8xB1SSD9RmNwJeAy4NaBgEg
hello
Publish error: InsufficientPeers
2024-11-12T04:03:32.511227Z DEBUG Swarm::poll: libp2p_gossipsub::behaviour: Starting heartbeat
2024-11-12T04:03:32.511427Z DEBUG Swarm::poll: libp2p_gossipsub::behaviour: HEARTBEAT: Mesh low. Topic contains: 0 needs: 5 topic=main
2024-11-12T04:03:32.511493Z DEBUG Swarm::poll: libp2p_gossipsub::behaviour: RANDOM PEERS: Got 0 peers
2024-11-12T04:03:32.511543Z DEBUG Swarm::poll: libp2p_gossipsub::behaviour: Updating mesh, new mesh: {}
2024-11-12T04:03:32.511619Z DEBUG Swarm::poll: libp2p_gossipsub::behaviour: Completed Heartbeat
^C

> Terminal 2

    Finished `dev` profile [unoptimized + debuginfo] target(s) in 0.16s
     Running `target/debug/blockchain`
Peer Id: 12D3KooWEjgwKKx5BuUD4xWxsW7Df8xB1SSD9RmNwJeAy4NaBgEg
2024-11-12T04:03:28.292978Z  INFO libp2p_swarm: local_peer_id=12D3KooWEjgwKKx5BuUD4xWxsW7Df8xB1SSD9RmNwJeAy4NaBgEg
2024-11-12T04:03:28.293229Z DEBUG libp2p_gossipsub::behaviour: Subscribing to topic topic=main
2024-11-12T04:03:28.293378Z DEBUG libp2p_gossipsub::behaviour: Running JOIN for topic topic=main
2024-11-12T04:03:28.293549Z DEBUG libp2p_gossipsub::behaviour: RANDOM PEERS: Got 0 peers
2024-11-12T04:03:28.293601Z DEBUG libp2p_gossipsub::behaviour: JOIN: Inserting 0 random peers into the mesh
2024-11-12T04:03:28.293843Z DEBUG libp2p_gossipsub::behaviour: Completed JOIN for topic topic=main
2024-11-12T04:03:28.293858Z DEBUG libp2p_gossipsub::behaviour: Subscribed to topic topic=main
2024-11-12T04:03:28.294274Z DEBUG libp2p_tcp: listening on 0.0.0.0:0
2024-11-12T04:03:28.294957Z  INFO Swarm::poll: libp2p_mdns::behaviour::iface: creating instance on iface address address=10.0.0.130
2024-11-12T04:03:28.295350Z DEBUG Swarm::poll: libp2p_tcp: New listen address address=/ip4/127.0.0.1/tcp/55956
2024-11-12T04:03:28.295496Z DEBUG Swarm::poll: libp2p_swarm: New listener address listener=ListenerId(1) address=/ip4/127.0.0.1/tcp/55956
Local node is listening on /ip4/127.0.0.1/tcp/55956
2024-11-12T04:03:28.295675Z DEBUG Swarm::poll: libp2p_tcp: New listen address address=/ip4/10.0.0.130/tcp/55956
2024-11-12T04:03:28.295715Z DEBUG Swarm::poll: libp2p_swarm: New listener address listener=ListenerId(1) address=/ip4/10.0.0.130/tcp/55956
Local node is listening on /ip4/10.0.0.130/tcp/55956
2024-11-12T04:03:28.296564Z  INFO Swarm::poll: libp2p_mdns::behaviour: discovered peer on address peer=12D3KooWKkZzA7Bgi49uberYXfmFMbjeGST4JbHg7oVFpE17Pitq address=/ip4/10.0.0.130/tcp/55955/p2p/12D3KooWKkZzA7Bgi49uberYXfmFMbjeGST4JbHg7oVFpE17Pitq
mDNS discovered a new peer: 12D3KooWKkZzA7Bgi49uberYXfmFMbjeGST4JbHg7oVFpE17Pitq
2024-11-12T04:03:28.296715Z DEBUG libp2p_gossipsub::behaviour: Adding explicit peer peer=12D3KooWKkZzA7Bgi49uberYXfmFMbjeGST4JbHg7oVFpE17Pitq
2024-11-12T04:03:28.296756Z DEBUG libp2p_gossipsub::behaviour: Connecting to explicit peer peer=12D3KooWKkZzA7Bgi49uberYXfmFMbjeGST4JbHg7oVFpE17Pitq
2024-11-12T04:03:28.296851Z DEBUG Swarm::poll: libp2p_tcp: dialing address address=10.0.0.130:55955
2024-11-12T04:03:28.297440Z DEBUG Transport::dial{address=/ip4/10.0.0.130/tcp/55955/p2p/12D3KooWKkZzA7Bgi49uberYXfmFMbjeGST4JbHg7oVFpE17Pitq}: multistream_select::dialer_select: Dialer: Proposed protocol: /noise    
2024-11-12T04:03:28.297472Z DEBUG Transport::dial{address=/ip4/10.0.0.130/tcp/55955/p2p/12D3KooWKkZzA7Bgi49uberYXfmFMbjeGST4JbHg7oVFpE17Pitq}: multistream_select::dialer_select: Dialer: Expecting proposed protocol: /noise    
2024-11-12T04:03:28.298987Z DEBUG Transport::dial{address=/ip4/10.0.0.130/tcp/55955/p2p/12D3KooWKkZzA7Bgi49uberYXfmFMbjeGST4JbHg7oVFpE17Pitq}: multistream_select::negotiated: Negotiated: Received confirmation for protocol: /noise    
2024-11-12T04:03:28.299720Z DEBUG Transport::dial{address=/ip4/10.0.0.130/tcp/55955/p2p/12D3KooWKkZzA7Bgi49uberYXfmFMbjeGST4JbHg7oVFpE17Pitq}: libp2p_core::upgrade::apply: Failed to upgrade outbound stream upgrade=/noise
2024-11-12T04:03:28.300257Z DEBUG Swarm::poll: libp2p_swarm: Connection attempt to peer failed with Transport([(/ip4/10.0.0.130/tcp/55955/p2p/12D3KooWKkZzA7Bgi49uberYXfmFMbjeGST4JbHg7oVFpE17Pitq, Other(Custom { kind: Other, error: Other(Left(Right(Apply(Io(Custom { kind: InvalidData, error: Input }))))) }))]). peer=12D3KooWKkZzA7Bgi49uberYXfmFMbjeGST4JbHg7oVFpE17Pitq
2024-11-12T04:03:33.293699Z DEBUG Swarm::poll: libp2p_gossipsub::behaviour: Starting heartbeat
2024-11-12T04:03:33.293907Z DEBUG Swarm::poll: libp2p_gossipsub::behaviour: HEARTBEAT: Mesh low. Topic contains: 0 needs: 5 topic=main
2024-11-12T04:03:33.293977Z DEBUG Swarm::poll: libp2p_gossipsub::behaviour: RANDOM PEERS: Got 0 peers
2024-11-12T04:03:33.294028Z DEBUG Swarm::poll: libp2p_gossipsub::behaviour: Updating mesh, new mesh: {}
2024-11-12T04:03:33.294103Z DEBUG Swarm::poll: libp2p_gossipsub::behaviour: Completed Heartbeat
^C

Well we have some errors here at least! It does look like it's failing to connect... There's a hello buried in the logs for Terminal 1, which was my attempted message.

I also waited and was able to produce logs when it was working for comparison:

> Terminal 1

    Finished `dev` profile [unoptimized + debuginfo] target(s) in 0.43s
     Running `target/debug/blockchain`
Peer Id: 12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh
2024-11-12T04:05:54.128767Z  INFO libp2p_swarm: local_peer_id=12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh
2024-11-12T04:05:54.129051Z DEBUG libp2p_gossipsub::behaviour: Subscribing to topic topic=main
2024-11-12T04:05:54.129228Z DEBUG libp2p_gossipsub::behaviour: Running JOIN for topic topic=main
2024-11-12T04:05:54.129428Z DEBUG libp2p_gossipsub::behaviour: RANDOM PEERS: Got 0 peers
2024-11-12T04:05:54.129487Z DEBUG libp2p_gossipsub::behaviour: JOIN: Inserting 0 random peers into the mesh
2024-11-12T04:05:54.129762Z DEBUG libp2p_gossipsub::behaviour: Completed JOIN for topic topic=main
2024-11-12T04:05:54.129780Z DEBUG libp2p_gossipsub::behaviour: Subscribed to topic topic=main
2024-11-12T04:05:54.130258Z DEBUG libp2p_tcp: listening on 0.0.0.0:0
2024-11-12T04:05:54.131036Z  INFO Swarm::poll: libp2p_mdns::behaviour::iface: creating instance on iface address address=10.0.0.130
2024-11-12T04:05:54.131436Z DEBUG Swarm::poll: libp2p_tcp: New listen address address=/ip4/127.0.0.1/tcp/55962
2024-11-12T04:05:54.131536Z DEBUG Swarm::poll: libp2p_swarm: New listener address listener=ListenerId(1) address=/ip4/127.0.0.1/tcp/55962
Local node is listening on /ip4/127.0.0.1/tcp/55962
2024-11-12T04:05:54.131644Z DEBUG Swarm::poll: libp2p_tcp: New listen address address=/ip4/10.0.0.130/tcp/55962
2024-11-12T04:05:54.131673Z DEBUG Swarm::poll: libp2p_swarm: New listener address listener=ListenerId(1) address=/ip4/10.0.0.130/tcp/55962
Local node is listening on /ip4/10.0.0.130/tcp/55962
2024-11-12T04:05:56.819336Z  INFO Swarm::poll: libp2p_mdns::behaviour: discovered peer on address peer=12D3KooWCMJafZUqnRNAMbutonKcXfCL1sUxThHCQBLVt5iUmAKr address=/ip4/10.0.0.130/tcp/55963/p2p/12D3KooWCMJafZUqnRNAMbutonKcXfCL1sUxThHCQBLVt5iUmAKr
mDNS discovered a new peer: 12D3KooWCMJafZUqnRNAMbutonKcXfCL1sUxThHCQBLVt5iUmAKr
2024-11-12T04:05:56.819526Z DEBUG libp2p_gossipsub::behaviour: Adding explicit peer peer=12D3KooWCMJafZUqnRNAMbutonKcXfCL1sUxThHCQBLVt5iUmAKr
2024-11-12T04:05:56.819640Z DEBUG libp2p_gossipsub::behaviour: Connecting to explicit peer peer=12D3KooWCMJafZUqnRNAMbutonKcXfCL1sUxThHCQBLVt5iUmAKr
2024-11-12T04:05:56.819771Z DEBUG Swarm::poll: libp2p_tcp: dialing address address=10.0.0.130:55963
2024-11-12T04:05:56.820360Z DEBUG Swarm::poll: libp2p_swarm: Connection attempt to peer failed with Transport([(/ip4/10.0.0.130/tcp/55963/p2p/12D3KooWCMJafZUqnRNAMbutonKcXfCL1sUxThHCQBLVt5iUmAKr, Other(Custom { kind: Other, error: Other(Left(Left(Os { code: 48, kind: AddrInUse, message: "Address already in use" }))) }))]). peer=12D3KooWCMJafZUqnRNAMbutonKcXfCL1sUxThHCQBLVt5iUmAKr
2024-11-12T04:05:56.820538Z DEBUG Swarm::poll: libp2p_tcp: Incoming connection from remote at local remote_address=/ip4/10.0.0.130/tcp/55963 local_address=/ip4/10.0.0.130/tcp/55962
2024-11-12T04:05:56.822147Z DEBUG new_incoming_connection{remote_addr=/ip4/10.0.0.130/tcp/55963 id=2}: multistream_select::listener_select: Listener: confirming protocol: /noise    
2024-11-12T04:05:56.822201Z DEBUG new_incoming_connection{remote_addr=/ip4/10.0.0.130/tcp/55963 id=2}: multistream_select::listener_select: Listener: sent confirmed protocol: /noise    
2024-11-12T04:05:56.828138Z DEBUG new_incoming_connection{remote_addr=/ip4/10.0.0.130/tcp/55963 id=2}: multistream_select::listener_select: Listener: confirming protocol: /yamux/1.0.0    
2024-11-12T04:05:56.828187Z DEBUG new_incoming_connection{remote_addr=/ip4/10.0.0.130/tcp/55963 id=2}: multistream_select::listener_select: Listener: sent confirmed protocol: /yamux/1.0.0    
2024-11-12T04:05:56.828229Z DEBUG new_incoming_connection{remote_addr=/ip4/10.0.0.130/tcp/55963 id=2}: yamux::connection: new connection: 6ea15786 (Server)    
2024-11-12T04:05:56.828513Z DEBUG Swarm::poll: libp2p_swarm: Connection established peer=12D3KooWCMJafZUqnRNAMbutonKcXfCL1sUxThHCQBLVt5iUmAKr endpoint=Listener { local_addr: /ip4/10.0.0.130/tcp/55962, send_back_addr: /ip4/10.0.0.130/tcp/55963 } total_peers=1
2024-11-12T04:05:56.828591Z DEBUG Swarm::poll: libp2p_gossipsub::behaviour: New peer connected peer=12D3KooWCMJafZUqnRNAMbutonKcXfCL1sUxThHCQBLVt5iUmAKr
2024-11-12T04:05:56.828646Z DEBUG new_established_connection{remote_addr=/ip4/10.0.0.130/tcp/55963 id=2 peer=12D3KooWCMJafZUqnRNAMbutonKcXfCL1sUxThHCQBLVt5iUmAKr}:Connection::poll: yamux::connection::rtt: sending ping 3840466744    
2024-11-12T04:05:56.828834Z DEBUG new_established_connection{remote_addr=/ip4/10.0.0.130/tcp/55963 id=2 peer=12D3KooWCMJafZUqnRNAMbutonKcXfCL1sUxThHCQBLVt5iUmAKr}:Connection::poll: multistream_select::listener_select: Listener: confirming protocol: /meshsub/1.1.0    
2024-11-12T04:05:56.828869Z DEBUG new_established_connection{remote_addr=/ip4/10.0.0.130/tcp/55963 id=2 peer=12D3KooWCMJafZUqnRNAMbutonKcXfCL1sUxThHCQBLVt5iUmAKr}:Connection::poll: multistream_select::listener_select: Listener: sent confirmed protocol: /meshsub/1.1.0    
2024-11-12T04:05:56.828973Z DEBUG Swarm::poll: libp2p_gossipsub::behaviour: New peer type found for peer peer=12D3KooWCMJafZUqnRNAMbutonKcXfCL1sUxThHCQBLVt5iUmAKr peer_type=Gossipsub v1.1
2024-11-12T04:05:56.829020Z DEBUG new_established_connection{remote_addr=/ip4/10.0.0.130/tcp/55963 id=2 peer=12D3KooWCMJafZUqnRNAMbutonKcXfCL1sUxThHCQBLVt5iUmAKr}:Connection::poll: yamux::connection::rtt: received pong 3840466744, estimated round-trip-time 376.791µs    
2024-11-12T04:05:56.829056Z DEBUG new_established_connection{remote_addr=/ip4/10.0.0.130/tcp/55963 id=2 peer=12D3KooWCMJafZUqnRNAMbutonKcXfCL1sUxThHCQBLVt5iUmAKr}:Connection::poll: yamux::connection: 6ea15786: new outbound (Stream 6ea15786/2) of (Connection 6ea15786 Server (streams 1))    
2024-11-12T04:05:56.829103Z DEBUG new_established_connection{remote_addr=/ip4/10.0.0.130/tcp/55963 id=2 peer=12D3KooWCMJafZUqnRNAMbutonKcXfCL1sUxThHCQBLVt5iUmAKr}:Connection::poll: multistream_select::dialer_select: Dialer: Proposed protocol: /meshsub/1.1.0    
2024-11-12T04:05:56.829489Z DEBUG Swarm::poll: libp2p_gossipsub::behaviour: Handling subscriptions: [Subscription { action: Subscribe, topic_hash: TopicHash { hash: "main" } }] source=12D3KooWCMJafZUqnRNAMbutonKcXfCL1sUxThHCQBLVt5iUmAKr
2024-11-12T04:05:56.829584Z DEBUG Swarm::poll: libp2p_gossipsub::behaviour: SUBSCRIPTION: Adding gossip peer to topic peer=12D3KooWCMJafZUqnRNAMbutonKcXfCL1sUxThHCQBLVt5iUmAKr topic=main
2024-11-12T04:05:56.829646Z DEBUG new_established_connection{remote_addr=/ip4/10.0.0.130/tcp/55963 id=2 peer=12D3KooWCMJafZUqnRNAMbutonKcXfCL1sUxThHCQBLVt5iUmAKr}:Connection::poll: multistream_select::dialer_select: Dialer: Received confirmation for protocol: /meshsub/1.1.0    
hel2024-11-12T04:05:59.132570Z DEBUG Swarm::poll: libp2p_gossipsub::behaviour: Starting heartbeat
2024-11-12T04:05:59.132726Z DEBUG Swarm::poll: libp2p_gossipsub::behaviour: HEARTBEAT: Mesh low. Topic contains: 0 needs: 5 topic=main
2024-11-12T04:05:59.132844Z DEBUG Swarm::poll: libp2p_gossipsub::behaviour: RANDOM PEERS: Got 0 peers
2024-11-12T04:05:59.132882Z DEBUG Swarm::poll: libp2p_gossipsub::behaviour: Updating mesh, new mesh: {}
2024-11-12T04:05:59.132938Z DEBUG Swarm::poll: libp2p_gossipsub::behaviour: Completed Heartbeat
lo
2024-11-12T04:06:00.186710Z DEBUG libp2p_gossipsub::behaviour: Published message 313244334b6f6f574a317a766a324c715971394b7937344d636f6d6371747059524758377a6d6b6163364d72635656664469566831373331333834333534313237303139303031
^C

> Terminal 2

    Finished `dev` profile [unoptimized + debuginfo] target(s) in 0.13s
     Running `target/debug/blockchain`
Peer Id: 12D3KooWCMJafZUqnRNAMbutonKcXfCL1sUxThHCQBLVt5iUmAKr
2024-11-12T04:05:56.814689Z  INFO libp2p_swarm: local_peer_id=12D3KooWCMJafZUqnRNAMbutonKcXfCL1sUxThHCQBLVt5iUmAKr
2024-11-12T04:05:56.814950Z DEBUG libp2p_gossipsub::behaviour: Subscribing to topic topic=main
2024-11-12T04:05:56.815100Z DEBUG libp2p_gossipsub::behaviour: Running JOIN for topic topic=main
2024-11-12T04:05:56.815267Z DEBUG libp2p_gossipsub::behaviour: RANDOM PEERS: Got 0 peers
2024-11-12T04:05:56.815317Z DEBUG libp2p_gossipsub::behaviour: JOIN: Inserting 0 random peers into the mesh
2024-11-12T04:05:56.815523Z DEBUG libp2p_gossipsub::behaviour: Completed JOIN for topic topic=main
2024-11-12T04:05:56.815536Z DEBUG libp2p_gossipsub::behaviour: Subscribed to topic topic=main
2024-11-12T04:05:56.815951Z DEBUG libp2p_tcp: listening on 0.0.0.0:0
2024-11-12T04:05:56.816658Z  INFO Swarm::poll: libp2p_mdns::behaviour::iface: creating instance on iface address address=10.0.0.130
2024-11-12T04:05:56.817102Z DEBUG Swarm::poll: libp2p_tcp: New listen address address=/ip4/127.0.0.1/tcp/55963
2024-11-12T04:05:56.817208Z DEBUG Swarm::poll: libp2p_swarm: New listener address listener=ListenerId(1) address=/ip4/127.0.0.1/tcp/55963
Local node is listening on /ip4/127.0.0.1/tcp/55963
2024-11-12T04:05:56.817406Z DEBUG Swarm::poll: libp2p_tcp: New listen address address=/ip4/10.0.0.130/tcp/55963
2024-11-12T04:05:56.817443Z DEBUG Swarm::poll: libp2p_swarm: New listener address listener=ListenerId(1) address=/ip4/10.0.0.130/tcp/55963
Local node is listening on /ip4/10.0.0.130/tcp/55963
2024-11-12T04:05:56.819350Z  INFO Swarm::poll: libp2p_mdns::behaviour: discovered peer on address peer=12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh address=/ip4/10.0.0.130/tcp/55962/p2p/12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh
mDNS discovered a new peer: 12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh
2024-11-12T04:05:56.819522Z DEBUG libp2p_gossipsub::behaviour: Adding explicit peer peer=12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh
2024-11-12T04:05:56.819569Z DEBUG libp2p_gossipsub::behaviour: Connecting to explicit peer peer=12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh
2024-11-12T04:05:56.819676Z DEBUG Swarm::poll: libp2p_tcp: dialing address address=10.0.0.130:55962
2024-11-12T04:05:56.820419Z DEBUG Transport::dial{address=/ip4/10.0.0.130/tcp/55962/p2p/12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh}: multistream_select::dialer_select: Dialer: Proposed protocol: /noise    
2024-11-12T04:05:56.820460Z DEBUG Transport::dial{address=/ip4/10.0.0.130/tcp/55962/p2p/12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh}: multistream_select::dialer_select: Dialer: Expecting proposed protocol: /noise    
2024-11-12T04:05:56.822275Z DEBUG Transport::dial{address=/ip4/10.0.0.130/tcp/55962/p2p/12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh}: multistream_select::negotiated: Negotiated: Received confirmation for protocol: /noise    
2024-11-12T04:05:56.827331Z DEBUG Transport::dial{address=/ip4/10.0.0.130/tcp/55962/p2p/12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh}: multistream_select::dialer_select: Dialer: Proposed protocol: /yamux/1.0.0    
2024-11-12T04:05:56.827360Z DEBUG Transport::dial{address=/ip4/10.0.0.130/tcp/55962/p2p/12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh}: multistream_select::dialer_select: Dialer: Expecting proposed protocol: /yamux/1.0.0    
2024-11-12T04:05:56.827474Z DEBUG Transport::dial{address=/ip4/10.0.0.130/tcp/55962/p2p/12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh}: yamux::connection: new connection: b521a4ba (Client)    
2024-11-12T04:05:56.827851Z DEBUG Swarm::poll: libp2p_swarm: Connection established peer=12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh endpoint=Dialer { address: /ip4/10.0.0.130/tcp/55962/p2p/12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh, role_override: Dialer, port_use: Reuse } total_peers=1
2024-11-12T04:05:56.827912Z DEBUG new_established_connection{remote_addr=/ip4/10.0.0.130/tcp/55962/p2p/12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh id=1 peer=12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh}:Connection::poll: yamux::connection::rtt: sending ping 192770500    
2024-11-12T04:05:56.827946Z DEBUG Swarm::poll: libp2p_gossipsub::behaviour: New peer connected peer=12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh
2024-11-12T04:05:56.828104Z DEBUG new_established_connection{remote_addr=/ip4/10.0.0.130/tcp/55962/p2p/12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh id=1 peer=12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh}:Connection::poll: yamux::connection: b521a4ba: new outbound (Stream b521a4ba/1) of (Connection b521a4ba Client (streams 0))    
2024-11-12T04:05:56.828160Z DEBUG new_established_connection{remote_addr=/ip4/10.0.0.130/tcp/55962/p2p/12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh id=1 peer=12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh}:Connection::poll: multistream_select::dialer_select: Dialer: Proposed protocol: /meshsub/1.1.0    
2024-11-12T04:05:56.828244Z DEBUG new_established_connection{remote_addr=/ip4/10.0.0.130/tcp/55962/p2p/12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh id=1 peer=12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh}:Connection::poll: multistream_select::negotiated: Negotiated: Received confirmation for protocol: /yamux/1.0.0    
2024-11-12T04:05:56.828832Z DEBUG new_established_connection{remote_addr=/ip4/10.0.0.130/tcp/55962/p2p/12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh id=1 peer=12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh}:Connection::poll: yamux::connection::rtt: received pong 192770500, estimated round-trip-time 918.625µs    
2024-11-12T04:05:56.829140Z DEBUG new_established_connection{remote_addr=/ip4/10.0.0.130/tcp/55962/p2p/12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh id=1 peer=12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh}:Connection::poll: multistream_select::dialer_select: Dialer: Received confirmation for protocol: /meshsub/1.1.0    
2024-11-12T04:05:56.829289Z DEBUG Swarm::poll: libp2p_gossipsub::behaviour: New peer type found for peer peer=12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh peer_type=Gossipsub v1.1
2024-11-12T04:05:56.829365Z DEBUG new_established_connection{remote_addr=/ip4/10.0.0.130/tcp/55962/p2p/12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh id=1 peer=12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh}:Connection::poll: multistream_select::listener_select: Listener: confirming protocol: /meshsub/1.1.0    
2024-11-12T04:05:56.829397Z DEBUG new_established_connection{remote_addr=/ip4/10.0.0.130/tcp/55962/p2p/12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh id=1 peer=12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh}:Connection::poll: multistream_select::listener_select: Listener: sent confirmed protocol: /meshsub/1.1.0    
2024-11-12T04:05:56.829921Z DEBUG Swarm::poll: libp2p_gossipsub::behaviour: Handling subscriptions: [Subscription { action: Subscribe, topic_hash: TopicHash { hash: "main" } }] source=12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh
2024-11-12T04:05:56.830040Z DEBUG Swarm::poll: libp2p_gossipsub::behaviour: SUBSCRIPTION: Adding gossip peer to topic peer=12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh topic=main
2024-11-12T04:06:00.189842Z DEBUG Swarm::poll: libp2p_gossipsub::behaviour: Handling message from peer peer=12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh 313244334b6f6f574a317a766a324c715971394b7937344d636f6d6371747059524758377a6d6b6163364d72635656664469566831373331333834333534313237303139303031
2024-11-12T04:06:00.190015Z DEBUG Swarm::poll: libp2p_gossipsub::behaviour: Put message in duplicate_cache and resolve promises 313244334b6f6f574a317a766a324c715971394b7937344d636f6d6371747059524758377a6d6b6163364d72635656664469566831373331333834333534313237303139303031
2024-11-12T04:06:00.190188Z DEBUG Swarm::poll: libp2p_gossipsub::behaviour: Sending received message to user
2024-11-12T04:06:00.190221Z DEBUG Swarm::poll: libp2p_gossipsub::behaviour: Forwarding message 313244334b6f6f574a317a766a324c715971394b7937344d636f6d6371747059524758377a6d6b6163364d72635656664469566831373331333834333534313237303139303031
2024-11-12T04:06:00.190304Z DEBUG Swarm::poll: libp2p_gossipsub::behaviour: Completed message handling for message 313244334b6f6f574a317a766a324c715971394b7937344d636f6d6371747059524758377a6d6b6163364d72635656664469566831373331333834333534313237303139303031
12D3Ko:303031:hello
2024-11-12T04:06:01.813469Z DEBUG Swarm::poll: libp2p_gossipsub::behaviour: Starting heartbeat
2024-11-12T04:06:01.813576Z DEBUG Swarm::poll: libp2p_gossipsub::behaviour: HEARTBEAT: Mesh low. Topic contains: 0 needs: 5 topic=main
2024-11-12T04:06:01.813623Z DEBUG Swarm::poll: libp2p_gossipsub::behaviour: RANDOM PEERS: Got 0 peers
2024-11-12T04:06:01.813649Z DEBUG Swarm::poll: libp2p_gossipsub::behaviour: Updating mesh, new mesh: {}
2024-11-12T04:06:01.813708Z DEBUG Swarm::poll: libp2p_gossipsub::behaviour: RANDOM PEERS: Got 0 peers
2024-11-12T04:06:01.813733Z DEBUG Swarm::poll: libp2p_gossipsub::behaviour: Gossiping IHAVE to 0 peers
2024-11-12T04:06:01.813763Z DEBUG Swarm::poll: libp2p_gossipsub::behaviour: Completed Heartbeat
2024-11-12T04:06:02.490951Z DEBUG Swarm::poll: libp2p_swarm: Connection closed with error IO(Custom { kind: Other, error: Error(Right(Closed)) }): Connected { endpoint: Dialer { address: /ip4/10.0.0.130/tcp/55962/p2p/12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh, role_override: Dialer, port_use: Reuse }, peer_id: PeerId("12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh") } total_peers=0
2024-11-12T04:06:02.491375Z DEBUG Swarm::poll: libp2p_gossipsub::behaviour: Peer disconnected peer=12D3KooWJ1zvj2LqYq9Ky74McomcqtpYRGX7zmkac6MrcVVfDiVh
^C

[Derrreks]

Hi @dariusc93 - sorry to bother, curious if you have any ideas here or anyone else we may be able to tag? Thanks so much.