Skip to content

Commit

Permalink
Increase S3 connection in Iceberg MinIO tests
Browse files Browse the repository at this point in the history
The limit was decreased in a33044e, but
it's too low. It's causing a congestion when working with Iceberg manifest
files during optimize. Revert it back to the previous value.
  • Loading branch information
nineinchnick authored and wendigo committed Jul 25, 2024
1 parent f1fca9e commit 93293d0
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -72,7 +72,7 @@ protected QueryRunner createQueryRunner()
.put("s3.endpoint", minio.getMinioAddress())
.put("s3.path-style-access", "true")
.put("s3.streaming.part-size", "5MB") // minimize memory usage
.put("s3.max-connections", "2") // verify no leaks
.put("s3.max-connections", "8") // verify no leaks
.put("iceberg.register-table-procedure.enabled", "true")
// Allows testing the sorting writer flushing to the file system with smaller tables
.put("iceberg.writer-sort-buffer-size", "1MB")
Expand Down

0 comments on commit 93293d0

Please sign in to comment.