To schedule a hive query on Crontab

Question

Can any one help me to schedule a job in Crontab which will execute a simple Hive query on specific time and provide me the output in text/log file.

I have created a batch script to execute a select query , but getting error("Hive command not found") while executing it in Crontab. However same script is running fine through shell. Below is my script :

ip.sh
#!/bin/bash
echo "Starting of Job"
cd /home/hadoop/work/hive/bin
hive -e 'select * from mytest.empl'
echo "Script ends here"

Crontab: 10 * * * * /home/hadoop/work/ip.sh >> /home/hadoop/work/quryout.log 2>&1

After executing the Crontab , I am getting below message in log:

Output(Queryout.log): Starting Of Job hive command not found in ip.sh at line number 4 Script ends here

Please format your question better, use text in between the ` character to inline code — Meghdeep Ray, May 29 '15 at 05:20

score 1 · Answer 1 · answered May 29 '15 at 06:18

1

Add these lines in your /home/hadoop/.bashrc:

export HIVE_HOME=/home/hadoop/work/hive
export PATH=$PATH:$HIVE_HOME/bin

Now, change your script like this:

#!/bin/bash
echo "Starting of Job"
hive -e 'select * from mytest.empl'
echo "Script ends here"

answered May 29 '15 at 06:18

Rajesh N

2,554
1
13
17

Thanks Rajesh. After adding the env variable, it worked fine. – Saumya May 30 '15 at 05:17
Mark it as answer if it helped you. – Rajesh N May 30 '15 at 17:11

score 0 · Answer 2 · answered May 29 '15 at 06:14

0

try this in shell script

/home/hadoop/work/hive/bin/hive -e 'select * from mytest.empl'

answered May 29 '15 at 06:14

Sravan K Reddy

1,082
1
10
19

To schedule a hive query on Crontab

2 Answers2

Linked