Skip to content
/ hadoopTemplate Public template
forked from kiat/hadoopTemplate

Hadoop Template project using maven

License

Notifications You must be signed in to change notification settings

amroKerkizz/hadoopTemplate

 
 

Repository files navigation

Please add your team members' names here.

Team members' names

  1. Student Name: Amro Kerkiz

    Student UT EID: ank2268 ...

Course Name: CS378 - Cloud Computing

Unique Number: 51515

Add your Project REPORT HERE

Top 10 word count: Top 10 Word Count

Project Template

Running on Laptop

Prerequisite:

  • Maven 3

  • JDK 1.6 or higher

  • (If working with eclipse) Eclipse with m2eclipse plugin installed

The java main class is:

edu.cs.utexas.HadoopEx.WordCount

Input file: Book-Tiny.txt

Specify your own Output directory like

Running:

Create a JAR Using Maven

To compile the project and create a single jar file with all dependencies:

mvn clean package

Run your application

Inside your shell with Hadoop

Running as Java Application:

java -jar target/MapReduce-WordCount-example-0.1-SNAPSHOT-jar-with-dependencies.jar SOME-Text-Fiel.txt output

Or has hadoop application

hadoop jar your-hadoop-application.jar edu.cs.utexas.HadoopEx.WordCount arg0 arg1 ...

Create a single JAR File from eclipse

Create a single gar file with eclipse

  • File export -> export -> export as binary -> "Extract generated libraries into generated JAR"

About

Hadoop Template project using maven

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Java 100.0%