线程“main”java.lang.illegalargumentexception中出现异常:错误的fs:应为:文件:///

sxpgvts3  于 2021-06-02  发布在  Hadoop
关注(0)|答案(1)|浏览(492)

我正在努力实现 copyFromLocal 命令使用java,下面是我的代码。

package com.hadoop;
import java.io.IOException;
import java.net.URI;
import java.net.URISyntaxException;
import org.apache.hadoop.conf.Configuration;
import org.apache.hadoop.fs.FileSystem;
import org.apache.hadoop.fs.Path;

public class CopyFromLocal {

public static void main(String[] args) throws IOException, URISyntaxException {

    Configuration conf =new Configuration();
    conf.addResource(new Path("/usr/hdp/2.3.0.0-2557/hadoop/conf/core-site.xml"));
    conf.addResource(new Path("/usr/hdp/2.3.0.0-2557/hadoop/conf/mapred-site.xml"));
    conf.addResource(new Path("/usr/hdp/2.3.0.0-2557/hadoop/conf/hdfs-site.xml"));
    FileSystem fs = FileSystem.get(conf);
    Path sourcePath = new Path("/root/sample.txt");
    Path destPath = new Path("hdfs://sandbox.hortonworks.com:8020/user/Deepthy");
    if(!(fs.exists(destPath)))
    {
        System.out.println("No Such destination exists :"+destPath);
        return;
    }
fs.copyFromLocalFile(sourcePath, destPath);

}

}
我得到以下例外:

Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: hdfs://sandbox.hortonworks.com:8020/user/Deepthy, expected: file:///
at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:305)
at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:47)
at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:357)
at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245)
at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:643)
at com.amal.hadoop.CopyFromLocal.main(CopyFromLocal.java:27)

我将这些jar添加到类路径:
hadoop-0.20.1-core.jar commons-logging-1.1.3.jar 请告诉我哪里出了问题。

qv7cva1a

qv7cva1a1#

更改配置如下

conf.set("fs.default.name","hdfs://sandbox.hortonworks.com:8020");

请在目标路径中给出一个相对路径,如

Path destPath = new Path("/user/Deepthy");

这将解决问题

相关问题