giambattista.bloisi
/
HADOOP-tar
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
2 Commits 1 Branch 0 Tags 33 KiB
Java 100%
Go to file
Giambattista Bloisi 238c9143fc Remove path prefix when "C" or "directory" options are passed 
Ensure that directories are terminated by a trailing '/'
 		2024-10-08 10:35:44 +02:00
src/main/java/org/apache/hadoop/tar Remove path prefix when "C" or "directory" options are passed 2024-10-08 10:35:44 +02:00
.gitignore Import main branch code 2024-10-08 10:30:54 +02:00
README.md Import main branch code 2024-10-08 10:30:54 +02:00
pom.xml Import main branch code 2024-10-08 10:30:54 +02:00

README.md

Info

Tar archiver for Hadoop HDFS.

Build

mvn package
sudo mv target/hadoop-tar-*.jar /usr/local/share/hadoop-tar.jar

Usage

Help:

hadoop jar /usr/local/share/hadoop-tar.jar --help

Streaming example with s3cmd:

hadoop jar /usr/local/share/hadoop-tar.jar -v -c hdfs:///user/hawking | pbzip2 | s3cmd --multipart-chunk-size-mb=100 put - s3://hador/user-hawking.tar.bz2