19 lines
394 B
Markdown
19 lines
394 B
Markdown
|
# Info
|
||
|
|
|
||
|
|
Tar archiver for Hadoop HDFS.
|
||
|
|
|
||
|
|
# Build
|
||
|
|
|
||
|
|
mvn package
|
||
|
|
sudo mv target/hadoop-tar-*.jar /usr/local/share/hadoop-tar.jar
|
||
|
|
|
||
|
|
# Usage
|
||
|
|
|
||
|
|
Help:
|
||
|
|
|
||
|
|
hadoop jar /usr/local/share/hadoop-tar.jar --help
|
||
|
|
|
||
|
|
Streaming example with s3cmd:
|
||
|
|
|
||
|
|
hadoop jar /usr/local/share/hadoop-tar.jar -v -c hdfs:///user/hawking | pbzip2 | s3cmd --multipart-chunk-size-mb=100 put - s3://hador/user-hawking.tar.bz2
|