Search code examples
anacondadistributeddaskblaze

Can not find the shared library:libhdfs3.so

everyone. I'm try to used Dask with Distributed + HDFS for processing some files. when I installed the distributed try to install the HDFS3 plugins, the error was :

Can not find the shared library:libhdfs3.so

My environment is Ubuntu 16 Desktop version. I strict according to bewlo, but still not working. Hope someone can help! Thanks a lot 

conda install hdfs3 -c conda-forge
echo "deb https://dl.bintray.com/wangzw/deb trusty contrib" | sudo tee /etc/apt/sources.list.d/bintray-wangzw-deb.list
sudo apt-get install -y apt-transport-https
sudo apt-get update
sudo apt-get install libhdfs3 libhdfs3-dev
pip install hdfs3
Solution

  • Since no one answers this question and I figure out the solution by myself , at least it works for me.

    conda install libhdfs3
pip install libhdfs3
conda install -c clinicalgraphics libgcrypt11
conda install libprotobuf=2.5
conda update libhdfs3

    if still not work try to update. enter image description here