HADOOP-19309: S3A CopyFromLocalFile operation fails when the source file does not contain file scheme #7113
+13
−1
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description of PR
When the sourcePath does not contain any file scheme information, S3A CopyFromLocalFile operation fails. Additionally the failure is seen only when the config
fs.s3a.optimized.copy.from.local.enabled
is enabled (which is by default). This happens only when the local source file is given without any file scheme for example :/tmp/file.txt
instead offile:///tmp/file.txt.
How was this patch tested?
Added a test case to validate the issue and the fix. Ran the test
ITestS3ACopyFromLocalFile
in us-east-1For code changes:
LICENSE
,LICENSE-binary
,NOTICE-binary
files?