Mount HDFS as local directory on Ubuntu 16

Install hadoop-hdfs-fuse from Cloudera

  • wget https://archive.cloudera.com/cdh5/ubuntu/xenial/amd64/cdh/cloudera.list
  • sudo cp cloudera.list /etc/apt/sources.list.d/.
  • wget https://archive.cloudera.com/cdh5/ubuntu/xenial/amd64/cdh/archive.key -O archive.key
  • sudo apt-key add archive.key
  • sudo apt update
  • sudo apt-get install hadoop-hdfs-fuse
  • sudo vi /etc/fuse.conf
    • user_allow_other

Mount

  • sudo mkdir /mnt/hdfs
  • hadoop-fuse-dfs dfs://<name_node_hostname>:<namenode_port> <mount_point>
    • e.g. sudo hadoop-fuse-dfs dfs://10.240.0.63:9000 /mnt/hdfs/

My Testing Environment

  • Remote server: Apache Hadoop 3.1.2 on Ubuntu 18
  • Local server: Ubuntu 16

Reference

Theme by Danetsoft and Danang Probo Sayekti inspired by Maksimer