3.85

Seaweed Admin

A close-source SeaweedAdmin server for flexible metadata management:

• Flexible and efficient TTL management.
• Point-in-time recovery of any file to any point of time.
• Off-site continuous file metadata backup.

What's Changed

• Volume Server
  • fix: The free disk size and percentage are quite different from the output of df -h. by @zouyixiong in #6550
• Misc
  • Nit: fix missing newline on EC balancing warnings regarding replica settings by @proton-lisandro-pin in #6509
  • fix: bucket-hook fails with gnu wget by @emosbaugh in #6521
• S3 API
  • use X-Forwarded-Host and X-Forwarded-Port to determine correct host for AWS signature by @tcrasset in #6514
  • fix: record and delete bucket metrics after inactive by @zouyixiong in #6523
  • add s3 signature tests and prepare implementation of STREAMING-UNSIGNED-PAYLOAD-TRAILER by @tcrasset in #6525
  • omit http and https ports when using X-Forwarded-Port by @tcrasset in #6527
  • implement s3 streaming-unsigned-payload-trailer by @tcrasset in #6539
  • fix: s3 command ignore -tlsVerifyClientCert and -cacert.file arguments by @KarolBedkowski in #6547
• Shell
  • Remove warning on EC balancing if no replica placement settings are found. by @proton-lisandro-pin in #6516
  • Nit: remove missing newlines on weed shell commands output. by @proton-lisandro-pin in #6524
  • ec.encode: Explictly mount EC shards after volume conversion. by @proton-lisandro-pin in #6528
• Helm Charts
  • fix helm: s3 allowEmptyFolder flag if (#6204) by @FQHSLycopene in #6206
  • Helm: Support map format for image pull secrets by @gtudan in #6546
• Filer
  • stop retry when all nodes have tried it by @Numblgw in #6551

New Contributors

• @emosbaugh made their first contribution in #6521
• @FQHSLycopene made their first contribution in #6206
• @KarolBedkowski made their first contribution in #6547

Full Changelog: 3.84...3.85

3.84

What's Changed

• reverting this change in S3 API #6489

Full Changelog: 3.83...3.84

3.83 (Need a fix in 3.84)

Seaweed Admin

A close-source SeaweedAdmin server for flexible metadata management:

• Flexible and efficient TTL management.
• Point-in-time recovery of any file to any point of time.
• Off-site continuous file metadata backup.

What's Changed

• Cloud Tier
  • cloud tier: support for Alibaba Cloud OSS by @ludwigxia in #6466
• Filer Store
  • filer store YDB: fix upsert with TTL by @MaratKarimov in #6469
• Misc
  • Update README.md - space for label creation by @dooblem in #6471
• S3 API
  • Add metrics for uploaded and deleted s3 objects by @hadizamani021 in #6475
  • return error on invalid action in PutUserPolicy by @tcrasset in #6482
  • verify if bucket exists in GetBucketLocationHandler by @tcrasset in #6485
• Erasure Coding
  • ec.encode: Display a warning on EC balancing if no replica placement settings are found. by @proton-lisandro-pin in #6487
  • ec.balance: Allow EC balancing without collections. by @proton-lisandro-pin in #6488
  • Improve EC shards balancing logic regarding replica placement settings. by @proton-lisandro-pin in #6491
• Filer
  • Add content length to filer's requests by @hadizamani021 in #6489
• Master
  • Remove rate limit semaphore on master's leader selection logic. by @proton-lisandro-pin in #6494

New Contributors

• @ludwigxia made their first contribution in #6466
• @MaratKarimov made their first contribution in #6469
• @dooblem made their first contribution in #6471

Full Changelog: 3.82...3.83

3.82

Seaweed Admin

A close-source SeaweedAdmin server for flexible metadata management:

• Flexible and efficient TTL management.
• Point-in-time recovery of any file to any point of time.
• Off-site continuous file metadata backup.

What's Changed

• Shell

  • [weed] change -n to -force by @dsd2077 in #6421
  • fix force arg dropped during volume balance command by @ftong2020 in #6432
  • ec.encode: Fix bug causing source volumes not being deleted after EC conversion. by @proton-lisandro-pin in #6447
  • Add JWT authentication to fs.mergeVolumes command by @hadizamani021 in #6461

• S3

  • Bugfix s3 audit missing requester for PUT requests by @ftong2020 in #6434
  • improve iam error handling by @tcrasset in #6446
  • Add bucket's traffic metrics by @hadizamani021 in #6444
  • fix S3 per-user-directory Policy by @tcrasset in #6443

New Contributors

• @ftong2020 made their first contribution in #6432
• @tcrasset made their first contribution in #6446
• @hadizamani021 made their first contribution in #6444

Full Changelog: 3.81...3.82

3.81

In this release, @proton-lisandro-pin re-engineered the EC operations! Thanks!

Seaweed Admin

A close-source SeaweedAdmin server for flexible metadata management:

• Flexible and efficient TTL management.
• Point-in-time recovery of any file to any point of time.
• Off-site continuous file metadata backup.

What's Changed

• Erasure Coding

  • Introduce logic to resolve volume replica placement within EC rebalancing. by @proton-lisandro-pin in #6254
  • Unify usage of shell.EcNode.dc as DataCenterId. by @proton-lisandro-pin in #6258
  • Improve EC shards rebalancing logic across racks by @proton-lisandro-pin in #6270
  • fix EcVolumes sorting in volume UI by @trim21 in #6275
  • Improve EC shards rebalancing logic across nodes by @proton-lisandro-pin in #6297
  • Display details upon failures to re-balance EC shards racks. by @proton-lisandro-pin in #6299
  • Resolve replica placement for EC volumes from master server defaults. by @proton-lisandro-pin in #6303
  • Account for replication placement settings when balancing EC shards across racks. by @proton-lisandro-pin in #6316
  • Account for replication placement settings when balancing EC shards within the same rack. by @proton-lisandro-pin in #6317
  • Share common parameters for EC re-balancing functions under a single struct. by @proton-lisandro-pin in #6319
  • Remove average constraints when selecting nodes/racks to balance EC shards into. by @proton-lisandro-pin in #6325
  • Unify the re-balancing logic for ec.encode with ec.balance. by @proton-lisandro-pin in #6339
  • Delete legacy balancing code for ec.encode. by @proton-lisandro-pin in #6344
  • Limit EC re-balancing for ec.encode to relevant collections when a volume ID argument is provided. by @proton-lisandro-pin in #6347
  • Begin implementing EC balancing parallelization support. by @proton-lisandro-pin in #6342
  • Parallelize EC balancing for racks. by @proton-lisandro-pin in #6351
  • Parallelize EC shards balancing across racks. by @proton-lisandro-pin in #6352
  • Parallelize EC shards balancing within racks by @proton-lisandro-pin in #6354
  • fatal error: concurrent map iteration and map write by @coffeecloudgit in #6358 #6359
  • Rework shell.EcBalance()'s waitgroup code into a standalone type. by @proton-lisandro-pin in #6373
  • Parallelize volume replica operations within ec.encode. by @proton-lisandro-pin in #6374
  • Allow configuring the maximum number of concurrent tasks for EC parallelization. by @proton-lisandro-pin in #6376
  • Fix volume replica parallelization within ec.encode. by @proton-lisandro-pin in #6377

• Shell

  • [shell] add noLock param for volume.move by @kmlebedev in #6261
  • [shell] don't require lock when there are no changes for volume.fix.replication by @kmlebedev in #6266
  • [shell] use constant for hdd of type by @kmlebedev in #6337
  • volume.list avoid output empty data center and rack and disk info by @kmlebedev in #6341
  • [shell] volume.list show only writable volumes by @kmlebedev in #6338
  • [shell] feat:stop vacuum immediately once volume.vacuum.disable was executed by @dsd2077 in #6375
  • [shell] only apply the balancing for writable volumes by @kmlebedev in #6346
  • Moving the warning report after the code sees if the file is on the source volume. by @bradmurray in #6406

• Master

  • [master] avoid crowded more writable for auto grow by @kmlebedev in #6214
  • [master] Revert back automatic volume grow in case of compensate for crowded volumes by @kmlebedev in #6267
  • fix missing register master metric MasterPickForWriteErrorCounter by @kmlebedev in #6277
  • use ShouldGrowVolumesByDcAndRack by @kmlebedev in #6280
  • [master] update LastLeaderChangeTime for hashicorp raft by @kmlebedev in #6292
  • [master] avoid timeout when assigning for main request with filter by DC or rack by @kmlebedev in #6291
  • [security] reload whiteList on http seerver by @kmlebedev in #6302

• Filer Sync

  • filer sync: source path and exclude path support dir suffix by @Numblgw in #6268

• S3 API

  • fix: record and delete bucket metrics after inactive by @zouyixiong in #6349
  • fix: filer may crash by bucketLastActiveTsNs concurrency access. by @zouyixiong in #6350
  • Fix for DeleteMultipleObjectsHandler wrongly deleting parent folders by @warrenhodg in #6380

• FUSE Mount

  • mount metacache add ttl by @zemul in #6360

• Volume Server

  • skip error while executing volume.fix.replication by @dsd2077 in #6382

• Filer WORM support

  • worm grace period and retention time support by @27149chen in #6404

• Misc

  • ExclusiveLocker only create one renew goroutine by @Numblgw in #6269
  • use readable bytes size string in shell output by @trim21 in #6288
  • change comment for expect header by @CodeRusher in #6289
  • Replaced https.client.enabled with false in scaffold/security by @vadimartynov in #6320
  • Replace bolt dependency with bbolt by @hack3ric in #6387
  • use same time format in volume volume UI and filter UI by @trim21 in #6395
  • Update LICENSE, fix copyright license year by @JasonnnW3000 in #6405

New Contributors

• @trim21 made their first contribution in #6275
• @warrenhodg made their first contribution in #6380
• @hack3ric made their first contribution in #6387
• @JasonnnW3000 made their first contribution in #6405

Full Changelog: 3.80...3.81

3.80

Seaweed Admin

A close-source SeaweedAdmin server for flexible metadata management:

• Flexible and efficient TTL management.
• Point-in-time recovery of any file to any point of time.
• Off-site continuous file metadata backup.

What's Changed

• Filer
  • SubscribeMetadata can miss some events when big files are written by @half-life666 in #6183
  • When uploading a file named ".txt" in chunks in Seaweed Java client, an error occurs when reading the uploaded file by @liangyihan in #6188
  • Fix/parse upload filename by @KevinBLT in #6241
• Shell
  • [shell] volume.balance collect volume servers by dc rack node by @kmlebedev in #6191
  • Refactor ec.balance logic into a weed/shell/command_ec_common.go… by @proton-lisandro-pin in #6195
  • [shell] add admin noLock for balance by @kmlebedev in #6209
• Master
  • fix deadlock hang when broadcast to clients by @kungf in #6184
• Helm Charts
  • [helm] fix s3 servicemonitor label matching by @glycerine102 in #6218
  • Add a loop to wait for master and filer services in post-install-bucket-hook by @ScribblerCoder in #6240
• Volume Server
  • delete aborted ec shards from both source and target servers by @chrislusf in #6221
  • added backward compatible CRC check and extra explanatory comments by @evgmik in #6233
• Misc
  • feat(filer.backup): add ignore errors option by @mdenushev in #6235
  • fix java.lang.IllegalArgumentException: Comparison method violates its general contract! by @fo40225 in #6239
  • Adjust threshold config by @zemul in #6246
• Minor
  • fix format by @kungf in #6185
  • remove dup code for section.reader access by @half-life666 in #6169

New Contributors

• @liangyihan made their first contribution in #6188
• @proton-lisandro-pin made their first contribution in #6195
• @glycerine102 made their first contribution in #6218
• @fo40225 made their first contribution in #6239
• @ScribblerCoder made their first contribution in #6240

Full Changelog: 3.79...3.80

3.79

Seaweed Admin

A close-source SeaweedAdmin server for flexible metadata management:

• Flexible and efficient TTL management.
• Point-in-time recovery of any file to any point of time.
• Off-site continuous file metadata backup.

What's Changed

• Volume Server

  • feat: add in-flight metric for s3/file/volume-server by @CodeRusher in #6120
  • fix(volume): to avoid duplicate write a same needle by @dsd2077 in #6138

• Filer

  • Fix invalid metric name by @bradmurray in #6141
  • fix permission check in put request by @27149chen in #6142
  • stop renaming worm files by @27149chen in #6154

• Heml Chart

  • Fix dataDirs.maxVolumes default value when not included in a values.yaml by @rschnei87 in #6119
  • Support topologySpreadConstraints in helm chart by @dominikgrygiel in #6132
  • feat: add resource annotations by @oldgiova in #6134
  • Support specifying rack and dataCenter for filers in helm chart by @dominikgrygiel in #6144
  • [helm] Allow setting notification.toml config by @dacalabrese in #6159

New Contributors

• @rschnei87 made their first contribution in #6119
• @dominikgrygiel made their first contribution in #6132
• @oldgiova made their first contribution in #6134
• @bradmurray made their first contribution in #6141
• @dacalabrese made their first contribution in #6159

Full Changelog: 3.77...3.78

3.77

Seaweed Admin

A close-source SeaweedAdmin server for flexible metadata management:

• Flexible and efficient TTL management.
• Point-in-time recovery of any file to any point of time.
• Off-site continuous file metadata backup.

What's Changed

• Helm Chart
  • feat: Add support for "custom" dataDirs type for volume server in kubernetes helm chart by @TheHackmeister in #6094
• FUSE Mount
  • Fix nil issue #6110

New Contributors

• @TheHackmeister made their first contribution in #6094

Full Changelog: 3.76...3.77

3.76

Seaweed Admin

A close-source SeaweedAdmin server for flexible metadata management:

• Flexible and efficient TTL management.
• Point-in-time recovery of any file to any point of time.
• Off-site continuous file metadata backup.

What's Changed

• S3

  • [s3] add {Get,Put,Delete}BucketTagging and PublicAccessBlock Handlers by @kmlebedev in #6088

• FUSE Mount

  • Fix cross mount file synchronization introduced in 3.74

Full Changelog: 3.75...3.76

3.75

Seaweed Admin

A close-source SeaweedAdmin server for flexible metadata management:

• Flexible and efficient TTL management.
• Point-in-time recovery of any file to any point of time.
• Off-site continuous file metadata backup.

What's Changed

• Mount

  • Fix weed mount - no entry is found in filer store #6089

• Helm Chart

  • k8s/charts/seaweedfs/templates: s3 deployment: rm blocking matchLabel by @ayzatziko in #6090

• S3

  • s3api: Fix signature v4 with reverse proxy at sub-path by @er2off in #6092
  • [s3] add skip bucket encryption handlers by @kmlebedev in #6091

New Contributors

• @ayzatziko made their first contribution in #6090
• @er2off made their first contribution in #6092

Full Changelog: 3.74...3.75