Building Cloudera cdh5.1.3 – Hadoop Native – [Ubuntu 14.04 Server x64]


WARN: Unable to load native-hadoop library for your platform… using builtin-java classes where app

On starting Cloudera cdh5 hadoop if you get above warning – then either your hadoop native is not on path or you don’t have native library available in your distribution.

For case 1: solution is simple.

export HADOOP_OPTS="$HADOOP_OPTS -Djava.library.path=$HADOOP_HOME/lib/native"

For case 2: follow below steps

  1. Install jdk7 and maven [skip if already installed]
  2. sudo apt-get install build-essential
  3. apt-get install cmake
  4. apt-get install pkg-config
  5. apt-get install libcurl4-openssl-dev
  6. install protobuf-2.5.0.tar.gz
  7. Goto “hadoop-2.3.0-cdh5.1.3/src” folder and run
    mvn package -Pdist,native -DskipTests -Dtar

check “hadoop-2.3.0-cdh5.1.3/src/hadoop-dist/target/hadoop-2.3.0-cdh5.1.3/lib/native”
or you can use – “hadoop-2.3.0-cdh5.1.3/src/hadoop-dist/target/hadoop-2.3.0-cdh5.1.3.tar.gz”

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s