Disable Hadoop log messages in the console

If you are a beginner to Hadoop/map-reduce ecosystem, you must have seen the messages that are displayed in the console when you run commands. It could be useful for a beginner and sometimes help you to understand the functionality.  But these log outputs are annoying once you are familiarized with the working of the system or you are using a production system.

These messages can be  suppressed using Ambari. I will just list the steps you have to go through to disable them.

  1. Log into Ambari console and go to Mapreduce2 tab in the left side.

ambari_1

2. In the Mapreduce2 page, click on configs tab and then go to advanced.

ambari_2

3. There you can see “Advanced mapred-site” push down list and click on it.

ambari_3

4. Scroll down and then change the value of below two parameters to ‘OFF’

ambari_5

ambari_75. Once done, save the changes and restart the components required.

Now if you login to Hive/Pig Console you don’t see all those INFO messages when running the queries.

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s