394 B

Raw Permalink Blame History

Info

Tar archiver for Hadoop HDFS.

Build

mvn package
sudo mv target/hadoop-tar-*.jar /usr/local/share/hadoop-tar.jar

Usage

Help:

hadoop jar /usr/local/share/hadoop-tar.jar --help

Streaming example with s3cmd:

hadoop jar /usr/local/share/hadoop-tar.jar -v -c hdfs:///user/hawking | pbzip2 | s3cmd --multipart-chunk-size-mb=100 put - s3://hador/user-hawking.tar.bz2