Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BUG: use trim to remove any extraneous spaces while parsing s3 url in manifest #116

Merged
merged 2 commits into from
Aug 21, 2024

Conversation

vkt1414
Copy link
Collaborator

@vkt1414 vkt1414 commented Aug 21, 2024

Addresses #115

extraneous spaces throws off the s3 url comparison b/w manifest and index. While I did not investigate much further, this shows that https://github.com/ImagingDataCommons/idc-index/blob/main/idc_index/index.py#L808 is not robust enough, as the validation function was returning 'gcs' endpoint for aws urls.

@vkt1414 vkt1414 requested a review from fedorov August 21, 2024 01:03
@vkt1414 vkt1414 marked this pull request as ready for review August 21, 2024 01:03
@fedorov
Copy link
Member

fedorov commented Aug 21, 2024

Thank you @vkt1414 for pinpointing the problem - you beat me to it!

@fedorov fedorov merged commit ab2d1d0 into main Aug 21, 2024
10 checks passed
@fedorov fedorov linked an issue Aug 21, 2024 that may be closed by this pull request
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Download fails for a manifest that works with s5cmd
2 participants