Monday, 7 January 2013

util.NativeCodeLoader: Unable to load native-hadoop library for your platform.

Problem: when launching a hadoop-based app one can encounter message
WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... 
using builtin-java classes where applicable
Solution: type following command in the command line. The path may vary depending on your platform and hadoop version
export LD_LIBRARY_PATH=/usr/lib/hadoop-0.20-mapreduce/lib/native/Linux-amd64-64

46 comments:

  1. Hi,
    i am still getting:ERROR nativeio.NativeIO: Unable to initialize NativeIO libraries" after exporting LD_LIBRARY_PATH variable


    ReplyDelete
  2. this could not resolve my problem, it put error also...
    14/05/18 23:30:57 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

    ReplyDelete
  3. If you add this lines in bashrc, this problem might resolved.
    export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME/lib/native
    export HADOOP_OPTS="-Djava.library.path=$HADOOP_HOME/lib"

    Venu
    Bigdata analyst

    ReplyDelete
    Replies
    1. I have these environment variable setup but still having the same issue. Please note that when i type hadoop checknative - a then
      hadoop: False
      zlib : false
      snappy: false
      lz4: false
      bzip2: false
      openssl: false

      Delete
    2. I have same issue. Is that solved? Kindly tell me.

      Delete
  4. Any response to this post. I have the same problem...

    ReplyDelete
  5. Any response to this post. I have the same problem...

    ReplyDelete
  6. hduser@nj-VirtualBox:~$ hadoop checknative -a
    15/10/18 07:21:05 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
    Native library checking:
    hadoop: false
    zlib: false
    snappy: false
    lz4: false
    bzip2: false
    openssl: false
    15/10/18 07:21:07 INFO util.ExitUtil: Exiting with status 1

    ReplyDelete
  7. Apart from learning more about Hadoop at hadoop online training, this blog adds to my learning platforms. Great work done by the webmasters. Thanks for your research and experience sharing on a platform like this.

    ReplyDelete
  8. This comment has been removed by the author.

    ReplyDelete
  9. Even I have the same problem.Any solution found?

    ReplyDelete
  10. i have ubuntu i386 architecute . I am getting the same error . I have all the paths defined as suggested but still i am getting the same error.
    hduser@pb-Aspire-V5-571:~$ echo $HADOOP_OPTS
    -Djava.library.path=/usr/local/hadoop/hadoop-2.6.0/lib

    hduser@pb-Aspire-V5-571:~$ echo $HADOOP_COMMON_LIB_NATIVE_DIR
    /usr/local/hadoop/hadoop-2.6.0/lib/native


    ReplyDelete
  11. Remove :

    export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME/lib/native
    export HADOOP_OPTS="-Djava.library.path=$HADOOP_HOME/lib"

    from the bashrc.

    then run : source ~/.bashrc

    close terminal and open new terminal . It will resolve your problem.

    ReplyDelete
    Replies
    1. i have done the same but my problem is not resolve

      Delete
  12. WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform..

    i'm using R studio server. i'm getting above error. i tried all the above method to fix it, but still cant able to fixed it

    ReplyDelete
  13. Unable to load native-hadoop library for your platform... using builtin-java classes

    ReplyDelete
    Replies
    1. https://www.youtube.com/watch?v=k2BSuR__SKE&t=140s

      Delete
    2. This youtube video no longer available

      Delete
  14. This comment has been removed by the author.

    ReplyDelete
  15. https://www.youtube.com/watch?v=k2BSuR__SKE&t=140s
    this solved my problem

    ReplyDelete
    Replies
    1. it's been removede, would you please explain what was its solution to this problem?

      Delete
  16. This comment has been removed by the author.

    ReplyDelete
  17. Video removed. Can someone please point me in right direction?

    ReplyDelete
  18. Unable to load native : applying java where applicable,
    Can someone what should I do to remover the error

    ReplyDelete

  19. Thank you for sharing the article. The data that you provided in the blog is informative and effective.
    Best Devops Training Institute

    ReplyDelete
  20. Good Post! Thank you so much for sharing this pretty post, it was so good to read and useful to improve my knowledge as updated one, keep blogging.

    Devops Training
    Python Online Training
    AWS Training
    AWS Online Training
    Artificial Intelligence Training
    Data Science Training

    ReplyDelete
  21. Thanks for sharing this information!
    DevOps Training in Hyderabad
    If you want to see our training venue then click on links:
    http://iappsofttraining.com/devops-course-training/
    Call Now: 9030486677
    Drop Mail: training@iappsoftsolutions.com

    ReplyDelete
  22. Thanks for sharing this information!
    I totally agree with you. Your information is very interesting and important. I really like this information.
    Our easy web plans company is famous in Advanced AWS Online Training Institutes in Hyderabad.
    If you want to see our training venue then click on links:
    https://www.futureqtech.com/aws-online-training.php
    Call Now: 9581111796
    Drop Mail: online@futureqtech.com

    ReplyDelete
  23. Thanks for sharing this information!
    I totally agree with you. Your information is very interesting and important. I really like this information.
    Our easy web plans company is famous in Advanced Devops Online Training Institutes in Hyderabad.
    If you want to see our training venue then click on links:
    https://www.futureqtech.com/devops-online-training.php
    Call Now: 9581111796
    Drop Mail: online@futureqtech.com

    ReplyDelete
  24. Thank you for sharing wonderful information with us to get some idea about it.
    Google Cloud Platform Training
    GCP Online Training

    ReplyDelete

  25. Thanks for Sharing This Article.It is very so much valuable content. I hope these Commenting lists will help to my website
    best microservices online training

    ReplyDelete
  26. Washing Machine Service Center in Hyderabad. Contact No.+91 9347129433,040-66833003. Geyserservicecenter.com provides Reliable Doorstep Repair Services. 100% Customer Satisfaction and Quality Services

    ReplyDelete

  27. great post very helpful very much informative i like your posts bcs that is full of information keep it up educational job thank you....
    Data Science Training in Hyderabad

    Hadoop Training in Hyderabad

    Java Training in Hyderabad

    Python online Training in Hyderabad

    ReplyDelete