hadoop用pip上传文件失败

Question

这个问题该怎么解决，一直上传不了文件

>>> cli.upload('/test','test.txt')
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/yin/.local/lib/python3.6/site-packages/hdfs/client.py", line 631, in upload
    raise HdfsError('Local path %r does not exist.', local_path)
hdfs.util.HdfsError: Local path 'test.txt' does not exist.

Answer 1

【相关推荐】

• 这个问题的回答你可以参考下: https://ask.csdn.net/questions/200766
• 您还可以看一下 杨力老师的Hadoop大数据实战开发课程中的 命令行接口小节, 巩固相关知识点
  
• 除此之外, 这篇博客: 搭建Hadoop+Python的大数据开发环境中的 安装Python3.X [4] 部分也许能够解决你的问题, 你可以仔细阅读以下内容或跳转源博客中阅读:
  

  该项在各个节点使用root用户配置

  安装依赖包

  yum install -y zlib-devel bzip2-devel \
  openssl-devel ncurses-devel sqlite-devel \
  readline-devel tk-devel gcc make
  

  备份原Python可执行文件

  mv /usr/bin/python /usr/bin/python.bak
  

  下载并解压python3.x

  wget https://www.python.org/ftp/python/3.6.2/Python-3.6.2.tar.xz
  tar -xvJf Python-3.6.2.tar.xz
  cd Python-3.*
  

  编译安装

  ./configure prefix=/usr/local/python3
  make && make install
  

  创建软连接

  创建软连接

  ln -s /usr/local/python3/bin/python3 /usr/bin/python
  ln -s /usr/local/python3/bin/python3 /usr/bin/python3
  ln -s /usr/local/python3/bin/python3 /usr/bin/python3.6
  

  查看/usr/bin/目录下的python程序

  ls -l /usr/bin/python*
  

  

  输入命令查看各程序版本

  python -V
  python2 -V
  python2.7 -V
  python3 -V
  python3.6 -V
  

  

  修改对python2的依赖

  1. 修改yum配置

  vim /usr/bin/yum
  

  将#!/usr/bin/python修改为#!/usr/bin/python2

  

  1. 修改urlgrabber-ext-down配置

  vim /usr/libexec/urlgrabber-ext-down
  

  将#!/usr/bin/python修改为#!/usr/bin/python2

  

  配置pip3

  mv /usr/bin/pip /usr/bin/pip.bak
  ln -s /usr/local/python3/bin/pip3  /usr/bin/pip
  ln -s /usr/local/python3/bin/pip3  /usr/bin/pip3
  

  查看修改情况

  ls -l /usr/bin/pip*
  

  

  一键安装脚本

  centos7 安装Python3.x的脚本

  网速略差时不建议使用

  #!/bin/bash
  
  yum install -y zlib-devel bzip2-devel openssl-devel \
  ncurses-devel sqlite-devel readline-devel tk-devel gcc make
  
  mv /usr/bin/python /usr/bin/python.bak
  
  cd ~
  wget https://www.python.org/ftp/python/3.6.2/Python-3.6.2.tar.xz
  tar -xvJf Python-3.6.2.tar.xz
  cd ~/Python-3.6.2/
  
  ./configure prefix=/usr/local/python3
  make && make install
  
  ln -s /usr/local/python3/bin/python3 /usr/bin/python
  ln -s /usr/local/python3/bin/python3 /usr/bin/python3
  ln -s /usr/local/python3/bin/python3 /usr/bin/python3.6
  
  ls -l /usr/bin/python*
  python -V
  python2 -V
  python2.7 -V
  python3 -V
  python3.6 -V
  
  sed -i 's/#!\/usr\/bin\/python/#!\/usr\/bin\/python2/g' /usr/bin/yum
  sed -i 's/#!\/usr\/bin\/python/#!\/usr\/bin\/python2/g' /usr/libexec/urlgrabber-ext-down
  
  mv /usr/bin/pip /usr/bin/pip.bak
  ln -s /usr/local/python3/bin/pip3  /usr/bin/pip
  ln -s /usr/local/python3/bin/pip3  /usr/bin/pip3
  
  ls -l /usr/bin/pip*
  
  

如果你已经解决了该问题, 非常希望你能够分享一下解决方案, 写成博客, 将相关链接放在评论区, 以帮助更多的人 ^-^