Tuesday, November 10, 2015

Possible Errors & Resolutions : Hadoop

In this post, I would like to share the errors I faced & the possible solutions to resolve the same. Hope you will find it useful.

Scenario 1 :
User have installed the Hadoop and formatted the name node & done all necessary pre-checks. After kick-starting hadoop, he is trying to view list of daemons using jps command but that's not working.


Note: Assumed that he installed all necessary java packages, did set JAVA_HOME in .bashrc & compiled it.

1) bin/start-all.sh      // this command will start all necessary daemons

2) jps                        //this command will show you list of daemons that are running


hduser@hduser:~/hadoop-1.2.1$ jps
The program 'jps' can be found in the following packages:
 * openjdk-7-jdk
 * openjdk-6-jdk
Try: sudo apt-get install <selected package>
 

Solution : 
- Setup PATH variable in .bashrc like below.

1) vi .bashrc
2) export PATH=$PATH:$JAVA_HOME/bin
3) source .bashrc

you should be all set to go!..

Watch out this space for more, such errors & solutions..

Hope you find this useful, please comment/suggest & do not forget to like! .

Scenario 2: