Sunday, May 20, 2018

 Preparing for APACHE HADOOP 2.0

I:.  Install Java and  Secure Shell (SSH), secure shell is a UNIX-based command interface and protocol for securely log onto a remote computer

sudo apt-get update
sudo apt-get install default-jdk
update-alternatives --config java
sudo apt-get install ssh




II:. Update OS limits

   *        hard    nofile         50000
   *        soft    nofile          50000
   *        hard    nproc         10000
   *        soft    nproc          10000


III:.Workaround for "kill" command

hd@ubuntu:~$ cd  /etc/systemd
hd@ubuntu:/etc/systemd$ sudo vi logind.conf


KillUserProcesses=no

IV:.Add a group and two users others will be added later :one will be running Hadoop distributed file system(HDFS) and second will run  Yet Another Resources Negotiator (YARN) 


V:. Setup SSH for both hduser and yarnuser  



No comments:

Post a Comment

How to connect R with Apache spark

R interface  Step1. Install R-Base we begin with installation of R base programming language by simply dropping few line into terminal a...