Skip to content

Commit

Permalink
Simplify error message
Browse files Browse the repository at this point in the history
Remove mention to `max_batch_weight` so as not to confuse users.

Signed-off-by: Maximilien de Bayser <mbayser@br.ibm.com>
  • Loading branch information
maxdebayser authored Jun 27, 2024
1 parent a98f04c commit 01c6ec6
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion router/src/server.rs
Original file line number Diff line number Diff line change
Expand Up @@ -222,7 +222,7 @@ impl<'a, B: BatchType> BatchConfigValidator<'a, B> {
self.batch_type.prefill_weight(&single_request_stats, 1);
if max_batch_weight < single_request_prefill_weight {
panic!(
"The provided max_sequence length ({}) results in a prefill batch weight that exceeds the estimated capacity (max_batch_weight: {})",
"The provided max_sequence length ({}) results in a prefill batch weight that exceeds the estimated capacity ({})",
max_sequence_length, max_batch_weight
)
}
Expand Down

0 comments on commit 01c6ec6

Please sign in to comment.