Wednesday, 16 May 2018

setup hive in Hadoop

By default in new Hadoop, account HIVE will not work.

To Make Hive work, need to set the following.


$maprlogin password


the password should be the password for which the account you logged in.

Tuesday, 10 April 2018

Edge Node Hadoop Commands for SUDO connection

To connect Hadoop specific account in the real time environment, you should first have the sudo permission on hadoop account to your ID.


  1. First Apply SUDO permission to your id.
  2. Once all approvals done then you will have sudo access on that particular Hadoop account.
Below are the different Commands on SUDO

  • First connect the Edge Node with your credentials using putty/SSH/Xshell 5/ or any terminal
  • Once connected then use the below command
    • $sudo su - hadoopaccoutnname
  • Use your pwd or virtual PIN to connect to that account via from sudo

  $sudo -l   
     --This command will show  all hadoop accoutn which your id has sudo permission




Basic Hadoop and Hive Commands


    1. Executing the File in Background                                                                               $nohup sh XXCRM_TEST.sh &    --> nohup execute the script without Debug statements and Last & will run in the Background.
    2.  Executing the File      $sh XXCRM_TEST.sh
    3. The CONCAT function concatenates all the stings 
      Example: CONCAT('Sagar','-','hive') returns 'Sagar-hive 
      
      
      To see the Table script in Hive.
      
      
      $show create table TableName;   --This command will show the Table script to
      see the complete creation script.