Computer Tips - Programming, Cybersecurity and Tech Tutorials

After installing Hadoop you will go for MapReduce operations or Hive NoSQL implementation. Here I am going to demonstrate two mapreduce application already provided in hadoop to test the architecture which will help you getting familiar with it. First one is calculating value of Pi and other one is running Terasort test. 1. Calculate value of Pi. Hadoop jar /root/ Downloads/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.0.jar pi 2 10

In this tutorial I am going to demonstrate the steps to setup and install a single node hadoop cluster in kali linux. Installing Hadoop: Step 1: Install Java if it is not present on your machine. Step 2: Download Hadoop and extract it. Step 3: Set environment variables in ~/.bashrc. export HADOOP_HOME=/root/Downloads/hadoop export HADOOP_MAPRED_HOME=$HADOOP_HOME export HADOOP_COMMON_HOME=$HADOOP_HOME export HADOOP_HDFS_HOME=$HADOOP_HOME export YARN_HOME=$HADOOP_HOME export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME/lib/native export PATH=$PATH:$HADOOP_HOME/sbin:$HADOOP_HOME/bin:$JAVA_HOME/bin:$HIVE_HOME/bin:$DERBY_HOME/bin export JAVA_HOME=/usr/local/jdk1.7.0_79 Step 4: Apply the changes. source ~/.bashrc