Skip to content

Commit

Permalink
Increase S3 connection in Iceberg MinIO tests
Browse files Browse the repository at this point in the history
The limit was decreased in a33044e, but
it's too low. It's causing a congestion when working with Iceberg manifest
files during optimize. Revert it back to the previous value.
  • Loading branch information
nineinchnick committed Jul 25, 2024
1 parent 2f8ea8c commit 948de9b
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -72,7 +72,7 @@ protected QueryRunner createQueryRunner()
.put("s3.endpoint", minio.getMinioAddress())
.put("s3.path-style-access", "true")
.put("s3.streaming.part-size", "5MB") // minimize memory usage
.put("s3.max-connections", "2") // verify no leaks
.put("s3.max-connections", "8") // verify no leaks
.put("iceberg.register-table-procedure.enabled", "true")
// Allows testing the sorting writer flushing to the file system with smaller tables
.put("iceberg.writer-sort-buffer-size", "1MB")
Expand Down

0 comments on commit 948de9b

Please sign in to comment.