panic in "ipfs bitswap reprovide" #9418
Comments
lidel
added
kind/bug
|
2022-12-13 converstaion:
|
|
2023-01-03 conversation: we suspect this isn't happening in the default configuration. After we have 0.18 RC2, we'll ask the original reporters to see if the issue still manifests. |
|
@AnnaArchivist: is this issue still happening with 0.18-rc2? |
|
Closing since don't have a reproducible case and haven't heard it happening in 0.18 and beyond. |
|
"ipfs bitswap reprovide" needs to be fixed, I got a similar problem with "Reprovider.Strategy" not set. (The default is "all", I belive). "ipfs bitswap reprovide" apparently "triggers reprovider to announce our data to network" and is a recommended way to make IPFS work better on forums. Having only a 20mb website (about 100 files) on IPFS, I set a cron job on two different servers, to do "ipfs bitswap reprovide" every hour on two different VPS's. Doing the command manually appeared to just hang, no info whatsoever, and I had to "ctrl+C" out of it, but tried it anyway. TL,DR: Don't. My website was always online when I visited it, but "Uptimia" told me, multiple times per day, there was a "503 service unavailable" error. i.e.: IPFS was crashing/restarting. So, I investigated. "journalctl -u ipfs" on server 1
"journalctl -u ipfs" on server 2
But no restarts since 4 days ago on server2? "ps aux | grep ipfs" on server2:
...gave me 26 instances of "ipfs bitswap reprovide" running Long story short: executing "ipfs bitswap reprovide", even for 20mb (about 200 files), is too much for 512mb or 1gb of ram, and will systematically crash your IPFS daemon every time. I cannot try that on servers with multiple cores and multiple gb's of ram, but... big server or not, this is definitely not the intended result. IPFS worked fine, stable, no crashes, for multiple months, without "ipfs bitswap reprovide" as a cron job. |
|
Hi, @LeDechaine, thank you for feedback, but this is unrelated to this already closed bug. Please see https://github.com/ipfs/kubo#minimal-system-requirements |
Problem
Panic manifests only when
Reprovider.Strategyis set torootsand/or some of the blocks are missing.
Version
Config
Click to expand
{ "API": { "HTTPHeaders": {} }, "Addresses": { "API": "/ip4/127.0.0.1/tcp/5001", "Announce": [], "AppendAnnounce": [], "Gateway": "/ip4/127.0.0.1/tcp/8080", "NoAnnounce": [], "Swarm": [ "/ip4/0.0.0.0/tcp/54957", "/ip6/::/tcp/54957", "/ip4/0.0.0.0/udp/54957/quic", "/ip6/::/udp/54957/quic" ] }, "AutoNAT": {}, "Bootstrap": [ "/dnsaddr/bootstrap.libp2p.io/p2p/QmNnooDu7bfjPFoTZYxMNLWUQJyrVwtbZg5gBMjTezGAJN", "/dnsaddr/bootstrap.libp2p.io/p2p/QmQCU2EcMqAqQPR2i9bChDtGNJchTbq5TbXJJ16u19uLTa", "/dnsaddr/bootstrap.libp2p.io/p2p/QmbLHAnMoJPWSCR5Zhtx6BHJX9KiKNN6tpvbUcqanj75Nb", "/dnsaddr/bootstrap.libp2p.io/p2p/QmcZf59bWwK5XFi76CZX8cbJ4BhTzzA3gU1ZjYZcYW3dwt", "/ip4/104.131.131.82/tcp/4001/p2p/QmaCpDMGvV2BGHeYERUEnRQAwe3N8SzbUtfsmvsqQLuvuJ", "/ip4/104.131.131.82/udp/4001/quic/p2p/QmaCpDMGvV2BGHeYERUEnRQAwe3N8SzbUtfsmvsqQLuvuJ" ], "DNS": { "Resolvers": {} }, "Datastore": { "BloomFilterSize": 0, "GCPeriod": "1h", "HashOnRead": false, "Spec": { "mounts": [ { "child": { "path": "blocks", "shardFunc": "/repo/flatfs/shard/v1/next-to-last/2", "sync": true, "type": "flatfs" }, "mountpoint": "/blocks", "prefix": "flatfs.datastore", "type": "measure" }, { "child": { "compression": "none", "path": "datastore", "type": "levelds" }, "mountpoint": "/", "prefix": "leveldb.datastore", "type": "measure" } ], "type": "mount" }, "StorageGCWatermark": 90, "StorageMax": "10GB" }, "Discovery": { "MDNS": { "Enabled": true } }, "Experimental": { "AcceleratedDHTClient": false, "FilestoreEnabled": true, "GraphsyncEnabled": false, "Libp2pStreamMounting": false, "P2pHttpProxy": false, "StrategicProviding": false, "UrlstoreEnabled": false }, "Gateway": { "APICommands": [], "HTTPHeaders": { "Access-Control-Allow-Headers": [ "X-Requested-With", "Range", "User-Agent" ], "Access-Control-Allow-Methods": [ "GET" ], "Access-Control-Allow-Origin": [ "*" ] }, "NoDNSLink": false, "NoFetch": false, "PathPrefixes": [], "PublicGateways": null, "RootRedirect": "", "Writable": false }, "Identity": { "PeerID": "<redacted>" }, "Internal": {}, "Ipns": { "RecordLifetime": "", "RepublishPeriod": "", "ResolveCacheSize": 128 }, "Migration": { "DownloadSources": [], "Keep": "" }, "Mounts": { "FuseAllowOther": false, "IPFS": "/ipfs", "IPNS": "/ipns" }, "Peering": { "Peers": null }, "Pinning": { "RemoteServices": {} }, "Plugins": { "Plugins": null }, "Provider": { "Strategy": "" }, "Pubsub": { "DisableSigning": false, "Router": "" }, "Reprovider": { "Interval": "12h", "Strategy": "roots" }, "Routing": { "Methods": null, "Routers": null, "Type": "dhtclient" }, "Swarm": { "AddrFilters": null, "ConnMgr": { "GracePeriod": "20s", "HighWater": 900, "LowWater": 600, "Type": "basic" }, "DisableBandwidthMetrics": false, "DisableNatPortMap": false, "RelayClient": {}, "RelayService": {}, "ResourceMgr": {}, "Transports": { "Multiplexers": {}, "Network": {}, "Security": {} } } }Description
Sometimes, but not always, the
ipfs bitswap reprovidestep mentioned above crashes the daemon with the following message:The text was updated successfully, but these errors were encountered: