Skip to content

fix: disable S3 flexible checksums for s3proxy compatibility#3747

Open
vedranjukic wants to merge 1 commit intomainfrom
checksums-s3proxy-compatibility
Open

fix: disable S3 flexible checksums for s3proxy compatibility#3747
vedranjukic wants to merge 1 commit intomainfrom
checksums-s3proxy-compatibility

Conversation

@vedranjukic
Copy link
Member

Description

Disable AWS SDK v3 flexible checksums to fix compatibility with s3proxy (S3 compatibility layer for Azure Blob Storage).

AWS SDK v3's @aws-sdk/middleware-flexible-checksums sends x-amz-checksum-algorithm and related headers by default on every request. s3proxy does not implement these headers, causing requests to fail when using Azure Blob Storage as the backend.

Documentation

  • This change requires a documentation update
  • I have made corresponding changes to the documentation

Notes

This is safe because Azure Blob Storage has its own built-in integrity checks, making the S3 flexible checksums redundant. WHEN_REQUIRED ensures checksums are only sent when S3 explicitly mandates them (which s3proxy never will).

No documentation changes needed — this is an internal configuration fix with no user-facing API changes.

  • The mount-s3 binary supports --upload-checksums off (alternatives: crc32c which is the default)
  • The AWS SDK v3 requestChecksumCalculation / responseChecksumValidation options accept 'WHEN_REQUIRED' or 'WHEN_SUPPORTED' — we use 'WHEN_REQUIRED' to minimize unnecessary headers
  • If s3proxy is eventually replaced with a full S3 implementation, these settings can be safely removed

brunogrbavac
brunogrbavac previously approved these changes Feb 13, 2026
Signed-off-by: Vedran Jukic <vedran.jukic@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants