Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix/md5 management #108

Merged
merged 17 commits into from
Jul 9, 2024
Merged

Fix/md5 management #108

merged 17 commits into from
Jul 9, 2024

Conversation

gedl
Copy link
Contributor

@gedl gedl commented Jun 5, 2024

This PR aims to:

1 - replace user defined metadata by S3's etag for md5 matching
2 - Improve md5 logging
3 - Reject the destination file if md5 mismatches

gedl added 5 commits June 5, 2024 08:31
…This is because we can only know the md5 *after* the upload has completed, and we must set meta at the time of the upload, so we were using the

original file's md5 instead of the transferred file md5
Copy link

codecov bot commented Jun 5, 2024

Codecov Report

Attention: Patch coverage is 48.64865% with 19 lines in your changes missing coverage. Please review.

Project coverage is 58.78%. Comparing base (b2e6e1b) to head (88784f8).

Files Patch % Lines
...technology/dice/dicewhere/downloader/Download.java 0.00% 11 Missing ⚠️
.../dice/dicewhere/downloader/source/s3/S3Source.java 0.00% 4 Missing ⚠️
...ownloader/destination/local/LocalFileAcceptor.java 50.00% 1 Missing and 1 partial ⚠️
...here/downloader/destination/s3/S3FileAcceptor.java 88.23% 1 Missing and 1 partial ⚠️
Additional details and impacted files
@@              Coverage Diff              @@
##             master     #108       +/-   ##
=============================================
- Coverage     72.64%   58.78%   -13.86%     
- Complexity      338      370       +32     
=============================================
  Files            65       97       +32     
  Lines          1378     1912      +534     
  Branches        147      167       +20     
=============================================
+ Hits           1001     1124      +123     
- Misses          323      729      +406     
- Partials         54       59        +5     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

brunocorreiaweb
brunocorreiaweb previously approved these changes Jun 5, 2024
styxtwo
styxtwo previously approved these changes Jun 5, 2024
@gedl gedl dismissed stale reviews from styxtwo and lbertrand-endeavorco via 1aae2ad July 5, 2024 16:16
styxtwo
styxtwo previously approved these changes Jul 8, 2024
brunocorreiaweb
brunocorreiaweb previously approved these changes Jul 8, 2024
@gedl gedl dismissed stale reviews from brunocorreiaweb and styxtwo via 939d70e July 8, 2024 09:02
brunocorreiaweb
brunocorreiaweb previously approved these changes Jul 8, 2024
gedl and others added 2 commits July 8, 2024 16:10
wermajew
wermajew previously approved these changes Jul 8, 2024
@wermajew wermajew merged commit 7e098d6 into master Jul 9, 2024
1 of 3 checks passed
@wermajew wermajew deleted the fix/md5_management branch July 9, 2024 08:56
lcardito added a commit that referenced this pull request Jul 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants