try-runtime-cli error Invalid input: Batch failed

[ggwpez]

Error from CI fails at 94% when inserting keys:

  INFO main remote-ext: inserting keys progress = 94% [950000 / 1015227]    
ERROR main remote-ext: Batch processing failed: "Networking or low-level protocol error: The request body was too large"    
Error: 
   0: Invalid input: Batch failed.

  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ BACKTRACE ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
                                ⋮ 3 frames hidden ⋮                               
   4: polkadot::main::h6b7329bd573c7d4a
      at <unknown source file>:<unknown line>
   5: std::sys_common::backtrace::__rust_begin_short_backtrace::hbf9819656ca822bf
      at <unknown source file>:<unknown line>
   6: std::rt::lang_start::{{closure}}::hb3de3ec96a11b220
      at <unknown source file>:<unknown line>
   7: core::ops::function::impls::<impl core::ops::function::FnOnce<A> for &F>::call_once::h203afb3af230319a
      at /rustc/9eb3afe9ebe9c7d2b84b71002d44f4a0edac95e0/library/core/src/ops/function.rs:287
   8: std::panicking::try::do_call::hf68e87013b70f3c5
      at /rustc/9eb3afe9ebe9c7d2b84b71002d44f4a0edac95e0/library/std/src/panicking.rs:483
   9: std::panicking::try::h040ea8f298390ba2
      at /rustc/9eb3afe9ebe9c7d2b84b71002d44f4a0edac95e0/library/std/src/panicking.rs:447
  10: std::panic::catch_unwind::h1e17b198887a05fa
      at /rustc/9eb3afe9ebe9c7d2b84b71002d44f4a0edac95e0/library/std/src/panic.rs:140
  11: std::rt::lang_start_internal::{{closure}}::hfb902d8927e51b86
      at /rustc/9eb3afe9ebe9c7d2b84b71002d44f4a0edac95e0/library/std/src/rt.rs:148
  12: std::panicking::try::do_call::h354e6eb41f2e7d42
      at /rustc/9eb3afe9ebe9c7d2b84b71002d44f4a0edac95e0/library/std/src/panicking.rs:483
  13: std::panicking::try::h4a39749cd018228c
      at /rustc/9eb3afe9ebe9c7d2b84b71002d44f4a0edac95e0/library/std/src/panicking.rs:447
  14: std::panic::catch_unwind::h30bce83b8de61cca
      at /rustc/9eb3afe9ebe9c7d2b84b71002d44f4a0edac95e0/library/std/src/panic.rs:140
  15: std::rt::lang_start_internal::h8f7e70b1a2558118
      at /rustc/9eb3afe9ebe9c7d2b84b71002d44f4a0edac95e0/library/std/src/rt.rs:148
  16: main<unknown>
      at <unknown source file>:<unknown line>
  17: __libc_start_main<unknown>
      at <unknown source file>:<unknown line>
  18: _start<unknown>
      at <unknown source file>:<unknown line>

Run with COLORBT_SHOW_HIDDEN=1 environment variable to disable frame filtering.
Run with RUST_BACKTRACE=full to include source snippets.

@liamaharon please manually test all changes for the try-runtime CLI on Polkadot + Kusama from now on until we have automatic testing in place.
I disabled it on Polkadot for now paritytech/polkadot#7114 (comment)

[liamaharon]

Hey, thanks for raising this to my attention.

I have been testing try-runtime against local Polkadot and Kusama before opening any PRs, I was not aware of any CI environments that it was also running in.

It's definitely a bug that it doesn't work as intended in the CI environment, I'm looking into replicating and fixing this now.

[ggwpez]

Yea the CI is just doing it against live network Polkadot, Kusama and Westend.
You can even use the same RPC endpoints from https://gist.github.com/ggwpez/81db110fe4390ed9a7622f5857dfc4ff without VPN.

[niklasad1]

Just do:

	HttpClientBuilder::default()
		.max_request_body_size(u32::MAX)
		.request_timeout(std::time::Duration::from_secs(60 * 10))
                .build(url)?

should fix this