3.80

Seaweed Admin

A close-source SeaweedAdmin server for flexible metadata management:

• Flexible and efficient TTL management.
• Point-in-time recovery of any file to any point of time.
• Off-site continuous file metadata backup.

What's Changed

• Filer
  • SubscribeMetadata can miss some events when big files are written by @half-life666 in #6183
  • When uploading a file named ".txt" in chunks in Seaweed Java client, an error occurs when reading the uploaded file by @liangyihan in #6188
  • Fix/parse upload filename by @KevinBLT in #6241
• Shell
  • [shell] volume.balance collect volume servers by dc rack node by @kmlebedev in #6191
  • Refactor ec.balance logic into a weed/shell/command_ec_common.go… by @proton-lisandro-pin in #6195
  • [shell] add admin noLock for balance by @kmlebedev in #6209
• Master
  • fix deadlock hang when broadcast to clients by @kungf in #6184
• Helm Charts
  • [helm] fix s3 servicemonitor label matching by @glycerine102 in #6218
  • Add a loop to wait for master and filer services in post-install-bucket-hook by @ScribblerCoder in #6240
• Volume Server
  • delete aborted ec shards from both source and target servers by @chrislusf in #6221
  • added backward compatible CRC check and extra explanatory comments by @evgmik in #6233
• Misc
  • feat(filer.backup): add ignore errors option by @mdenushev in #6235
  • fix java.lang.IllegalArgumentException: Comparison method violates its general contract! by @fo40225 in #6239
  • Adjust threshold config by @zemul in #6246
• Minor
  • fix format by @kungf in #6185
  • remove dup code for section.reader access by @half-life666 in #6169

New Contributors

• @liangyihan made their first contribution in #6188
• @proton-lisandro-pin made their first contribution in #6195
• @glycerine102 made their first contribution in #6218
• @fo40225 made their first contribution in #6239
• @ScribblerCoder made their first contribution in #6240

Full Changelog: 3.79...3.80

3.79

Seaweed Admin

A close-source SeaweedAdmin server for flexible metadata management:

• Flexible and efficient TTL management.
• Point-in-time recovery of any file to any point of time.
• Off-site continuous file metadata backup.

What's Changed

• Volume Server

  • feat: add in-flight metric for s3/file/volume-server by @CodeRusher in #6120
  • fix(volume): to avoid duplicate write a same needle by @dsd2077 in #6138

• Filer

  • Fix invalid metric name by @bradmurray in #6141
  • fix permission check in put request by @27149chen in #6142
  • stop renaming worm files by @27149chen in #6154

• Heml Chart

  • Fix dataDirs.maxVolumes default value when not included in a values.yaml by @rschnei87 in #6119
  • Support topologySpreadConstraints in helm chart by @dominikgrygiel in #6132
  • feat: add resource annotations by @oldgiova in #6134
  • Support specifying rack and dataCenter for filers in helm chart by @dominikgrygiel in #6144
  • [helm] Allow setting notification.toml config by @dacalabrese in #6159

New Contributors

• @rschnei87 made their first contribution in #6119
• @dominikgrygiel made their first contribution in #6132
• @oldgiova made their first contribution in #6134
• @bradmurray made their first contribution in #6141
• @dacalabrese made their first contribution in #6159

Full Changelog: 3.77...3.78

3.77

Seaweed Admin

A close-source SeaweedAdmin server for flexible metadata management:

• Flexible and efficient TTL management.
• Point-in-time recovery of any file to any point of time.
• Off-site continuous file metadata backup.

What's Changed

• Helm Chart
  • feat: Add support for "custom" dataDirs type for volume server in kubernetes helm chart by @TheHackmeister in #6094
• FUSE Mount
  • Fix nil issue #6110

New Contributors

• @TheHackmeister made their first contribution in #6094

Full Changelog: 3.76...3.77

3.76

Seaweed Admin

A close-source SeaweedAdmin server for flexible metadata management:

• Flexible and efficient TTL management.
• Point-in-time recovery of any file to any point of time.
• Off-site continuous file metadata backup.

What's Changed

• S3

  • [s3] add {Get,Put,Delete}BucketTagging and PublicAccessBlock Handlers by @kmlebedev in #6088

• FUSE Mount

  • Fix cross mount file synchronization introduced in 3.74

Full Changelog: 3.75...3.76

3.75

Seaweed Admin

A close-source SeaweedAdmin server for flexible metadata management:

• Flexible and efficient TTL management.
• Point-in-time recovery of any file to any point of time.
• Off-site continuous file metadata backup.

What's Changed

• Mount

  • Fix weed mount - no entry is found in filer store #6089

• Helm Chart

  • k8s/charts/seaweedfs/templates: s3 deployment: rm blocking matchLabel by @ayzatziko in #6090

• S3

  • s3api: Fix signature v4 with reverse proxy at sub-path by @er2off in #6092
  • [s3] add skip bucket encryption handlers by @kmlebedev in #6091

New Contributors

• @ayzatziko made their first contribution in #6090
• @er2off made their first contribution in #6092

Full Changelog: 3.74...3.75

3.74

Seaweed Admin

A close-source SeaweedAdmin server for better metadata management:

• Flexible and efficient TTL management.
• Point-in-time recovery of any file to any point of time.
• Off-site continuous file metadata backup.

What's Changed

• Helm Chart

  • helm chart: add s3 and s3-tls ports where missing by @ErwanDL in #6016
  • Bump chart version by @facorazza in #6033

• Filer Store

  • changing FindEntry error handling in cassandra store by @Werberus in #6015
  • improve worm support by @27149chen in #5983
  • [filer] fix return 204 for DELETE on entry not found by @kmlebedev in #6023
  • Feat:merge small chunk by @zemul in #6049
  • [filer] avoid 500 if table doesn't exist by @kmlebedev in #6075

• Master

  • [master] master missing start LoopPushingMetric routine fixed. by @zouyixiong in #6018
  • fix unclaimed spaces calculation when volumePreallocate is enabled by @shichanglin5 in #6063
  • Fix/copy before delete replication by @mdenushev in #6064
  • master:fix empty target in Build() by @neo-v in #6069
  • fix 'no space left' bug by @coffeecloudgit in #6073, #6077

• Mount, CSI-Driver

  • fix file read crash by @half-life666 in #6021
  • fix invalid file read by @27149chen in #6024

• Volume Server

  • Feature: compress before encryption by @evgmik in #6013
  • [volume] remove truncate idx file if size not healthy by @kmlebedev in #6043
  • Vol check disk bug by @dsd2077 in #6044
  • fix(volume): don't persist RO state in specific cases by @mdenushev in #6058

• S3

  • fix: Prevent potential metadata change events from being lost. by @CodeRusher in #6066

• Misc

  • Bump COSI-driver version v0.1.2 by @kvaps in #6074

New Contributors

• @ErwanDL made their first contribution in #6016
• @Werberus made their first contribution in #6015
• @27149chen made their first contribution in #6024
• @facorazza made their first contribution in #6033
• @mdenushev made their first contribution in #6058
• @coffeecloudgit made their first contribution in #6073

Full Changelog: 3.73...3.74

3.73

Seaweed Admin

A close-source SeaweedAdmin server for better metadata management:

• Flexible and efficient TTL management.
• Point-in-time recovery of any file to any point of time.
• Off-site continuous file metadata backup.

What's Changed

• Master

  • add http endpoint to get the size of a collection by @rikigigi in #5910
  • [master] refactor func ShouldGrowVolumes by @kmlebedev in #5884
  • [master] process grow request with must grow by @kmlebedev in #5999
  • prevent dead loop for followers of master node by @dsd2077 in #6007

• Helm Charts

  • Allow using a PVC to store filer and master logs - changes in values.yaml by @aniketwdubey in #5918
  • [Helm chart] use /healthz as default route in readiness/liveness by @DG-Wangtao in #5990

• S3

  • Fix get dir metadata by @zemul in #5923
  • [s3] reducing the number of metrics for 403 by @kmlebedev in #5961

• Misc

  • Add release for OpenBSD by @mrusme in #5993
  • change math/rand => math/rand/v2 in volume_layout.go where is a perfo… by @dsd2077 in #6006
  • filer.remote.gateway not filer.remote.sync for remote.mount.buckets help string. by @sierra-alpha in #5934
  • filer.remote.gateway not filer.remote.sync for filer.remote.gateway help string. by @sierra-alpha in #5935

• Volume Server

  • update metric for ErrorCRC if it happens during volume readNeedleDataInto by @evgmik in #5957
  • fix volume.move io.EOF by @kungf in #5960
  • Skip volume data integrity check for volume which has remote file by @half-life666 in #5976
  • persist readonly state to volume info by @half-life666 in #5977
  • Do CRC check if the buffer contains the full needle data before it is sent by @evgmik in #5980
  • Remove "Content-Length" header if http.Error is issued by @evgmik in #5981

• Shell

  • Show volume server which failed to verify a chunk by @evgmik in #5958
  • [shell] fix volume grow in shell by @kmlebedev in #5992

• Filer

  • bug fixed to filer store elastic deleteEntry by @zouyixiong in #5988

• Mount

  • bug fix in the data received from cache processing by @evgmik in #6002
  • Feature limit caching to prescribed number of bytes per file by @evgmik in #6009

New Contributors

• @aniketwdubey made their first contribution in #5918
• @sierra-alpha made their first contribution in #5934
• @evgmik made their first contribution in #5957
• @half-life666 made their first contribution in #5976
• @zouyixiong made their first contribution in #5988
• @mrusme made their first contribution in #5993
• @DG-Wangtao made their first contribution in #5990
• @dsd2077 made their first contribution in #6006

Full Changelog: 3.72...3.73

3.72

Seaweed Admin

Added a close-source SeaweedAdmin server:

• Flexible and efficient TTL management.
• Point-in-time recovery of any file to any point of time.
• Off-site continuous file metadata backup.

What's Changed

• Master

  • Check ShouldGrowVolumes before returning error in assign. by @eliphatfs in #5819
  • fix allocate reduplicated volumeId to different volume by @kungf in #5811
  • [master] do sync grow request only if absolutely necessary by @kmlebedev in #5821
  • [master] fix master panic by @wusongANKANG in #5893
  • EC volume supports expiration and displays expiration message when executing volume.list by @augustazz in #5895
  • fix ec volume lookup data sync by @augustazz in #5900

• FUSE Mount

  • Fix dead lock by @chrislusf in #5815

• Volume Server

  • fix delete chunk failed if volumeSever specified grpc.port by @kungf in #5820
  • fsck: only check the appendNs of deleted needle by @kungf in #5841

• Shell

  • fix evacuate volume to different disk types by @kungf in #5530
  • [shell] volume.grow by @kmlebedev in #5855

• Filer

  • [filer] fix panic filer on webdav.maxMB by @kmlebedev in #5822
  • [filer] Added a version to the title of Filer UI by @JiffsMaverick in #5836

• Helm Charts

  • fix case for keyAlgorithm in Helm chart by @kvaps in #5835
  • Fix: Resolve conflicts for deployment in different namespaces by @kvaps in #5862
  • Add volume-resize-hook by @kvaps in #5868

• COSI driver

  • Add seaweedfs-cosi-driver by @kvaps in #5843
  • Update COSI driver v0.1.1 by @kvaps in #5845
  • Fix secretName for seaweedfs-cosi-driver by @kvaps in #5850
  • Add: COSI BucketClass and BucketAccessClass by @kvaps in #5863

• S3

  • Fix KeyMaterial nil bug by @qinguoyi in #5848
  • Fix KeyMaterial nil bug by @qinguoyi in #5849
  • added access-control-expose-headers to put request by @kamransarwar47 in #5876
  • Dont try lazy decode content in proxyToFiler if no accept-encoding provided by @blackbass1988 in #5907

• WebDAV

  • [webdav] status code 500 if internal error from filer by @kmlebedev in #5865

• Misc

  • Fix extractToFile gz file nil bug by @qinguoyi in #5847
  • add command backup destory volume error log by @qinguoyi in #5846
  • fix CVE-2016-2183 by @zuzuviewer in #5844
  • Add SVG logo by @kvaps in #5827
  • Correct gopher on SVG logo by @kvaps in #5833

New Contributors

• @eliphatfs made their first contribution in #5819
• @kvaps made their first contribution in #5827
• @qinguoyi made their first contribution in #5846
• @kamransarwar47 made their first contribution in #5876
• @augustazz made their first contribution in #5895
• @blackbass1988 made their first contribution in #5907

Full Changelog: 3.71...3.72

3.71

What's Changed

• S3

  • Fix S3 deletion in deep folders, and names with empty spaces, fix #5748
  • add s3test for sql by @kmlebedev in #5718
  • [s3] revert skip deletion error, since the error file was not found is already skipped on the side of the grpc function by @kmlebedev in #5760

• Master

  • Detect underflow when calculating unused space by @danfoster in #5758
  • Different disk labels should not use the same DiskUsages instance while master received volume heatbeat by @chocotan in #5770
  • Fix "no more writable volumes" error when volume grows and master leader changed at the same time by @chocotan in #5771
  • fix: avoid timeout if datacenter does not exist in topology by @kmlebedev in #5772
  • metrics stats of volume layout depends on the data center by @kmlebedev in #5775
  • [master] refactor HasGrowRequest to atomic bool by @kmlebedev in #5782
  • [master] Do Automatic Volume Grow in background by @kmlebedev in #5781

• Helm Charts

  • helm: restart filer when the s3-configuration changes by @gtudan in #5768

• FUSE Mount

  • Fix mmap write fail by @wusongANKANG in #5791

• Filer.remote.sync and Filer.sync

  • Azure sink: avoid overwriting existing file
  • Filer sink: avoid overwriting existing file

• Filer

  • ensure metadata follow a specific folder, fix #5774

• Volume Server

  • always copy ecj files during ec encoding

• Shell

  • volume.tier.upload: Fix deleting replicated volumes by @rhysm in #5743
  • Add warning with hints to why a EC shard cant be moved by @danfoster in #5790

• Minor

  • Added tls for http handlers by @vadimartynov in #5764
  • refactor all methods strings to const by @kmlebedev in #5726
  • -metricsIp cmd flag by @vadimartynov in #5773
  • Added loadSecurityConfigOnce by @vadimartynov in #5792
  • Added tls for http clients by @vadimartynov in #5766

New Contributors

• @rhysm made their first contribution in #5743
• @danfoster made their first contribution in #5758
• @chocotan made their first contribution in #5770

Full Changelog: 3.69...3.71

3.69

What's Changed

• Filer

  • Fixed bootstrapping new filer from existing filer peer.
  • fix issue: sometimes volume.fsck report 'volume not found' by @ehooi in #5537

• Misc

  • Added context for the MasterClient's methods to avoid endless loops by @vadimartynov in #5628

• Helm Charts

  • fix #5681 convert all resources parameters to maps instead of strings by @jessebot in #5689
  • Helm-Chart: clean up image handling by @gtudan in #5720
  • Move cluster role to a separate template. by @gtudan in #5721
  • [Helm chart] Remove createClusterRole dependency from serviceAccount usage from filer statefulset by @rgaduput in #5724

• Admin Shell

  • [fs.verify] getmeta data from filer log by @kmlebedev in #5678
  • [fs.verify] skip failed files if entry not found on filerStore by @kmlebedev in #5693
  • chore: hot fix panic fs.verify by @kmlebedev in #5696

• Volume Server

  • bugfix: unregister ec shards when volume server disconnected by @Numblgw in #5697
  • fixed fail to initialize existing ec volume when volume server has separate index dictory by @ehooi in #5723

• Master

  • fix: correct command flag for master.raftBootstrap option in server.go by @sample in #5701

• S3

  • check bucket name in sql backend #5710

• filer.backup, filer.meta.backup, filer.remote.gateway, filer.remote.sync

  • adjust error handling to keep retrying to fix #5677

New Contributors

• @MeenakshiSachdeva made their first contribution in #5663
• @ehooi made their first contribution in #5537
• @vadimartynov made their first contribution in #5628
• @Numblgw made their first contribution in #5697
• @rgaduput made their first contribution in #5724

Full Changelog: 3.68...3.69