org.apache.hadoop.tools.DistCp.getFileListingPath()方法的使用及代码示例

x33g5p2x  于2022-01-18 转载在 其他  
字(2.1k)|赞(0)|评价(0)|浏览(117)

本文整理了Java中org.apache.hadoop.tools.DistCp.getFileListingPath()方法的一些代码示例,展示了DistCp.getFileListingPath()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。DistCp.getFileListingPath()方法的具体详情如下:
包路径:org.apache.hadoop.tools.DistCp
类名称:DistCp
方法名:getFileListingPath

DistCp.getFileListingPath介绍

[英]Get default name of the copy listing file. Use the meta folder to create the copy listing file
[中]获取副本列表文件的默认名称。使用meta文件夹创建副本列表文件

代码示例

代码示例来源:origin: org.apache.hadoop/hadoop-distcp

/**
 * Create input listing based on snapshot diff report.
 * @param job - Handle to job
 * @param distCpSync the class wraps the snapshot diff report
 * @return Returns the path where the copy listing is created
 * @throws IOException - If any
 */
private Path createInputFileListingWithDiff(Job job, DistCpSync distCpSync)
  throws IOException {
 Path fileListingPath = getFileListingPath();
 CopyListing copyListing = new SimpleCopyListing(job.getConfiguration(),
   job.getCredentials(), distCpSync);
 copyListing.buildListing(fileListingPath, context);
 return fileListingPath;
}

代码示例来源:origin: ch.cern.hadoop/hadoop-distcp

/**
 * Create input listing by invoking an appropriate copy listing
 * implementation. Also add delegation tokens for each path
 * to job's credential store
 *
 * @param job - Handle to job
 * @return Returns the path where the copy listing is created
 * @throws IOException - If any
 */
protected Path createInputFileListing(Job job) throws IOException {
 Path fileListingPath = getFileListingPath();
 CopyListing copyListing = CopyListing.getCopyListing(job.getConfiguration(),
   job.getCredentials(), inputOptions);
 copyListing.buildListing(fileListingPath, inputOptions);
 return fileListingPath;
}

代码示例来源:origin: org.apache.hadoop/hadoop-distcp

/**
 * Create input listing by invoking an appropriate copy listing
 * implementation. Also add delegation tokens for each path
 * to job's credential store
 *
 * @param job - Handle to job
 * @return Returns the path where the copy listing is created
 * @throws IOException - If any
 */
protected Path createInputFileListing(Job job) throws IOException {
 Path fileListingPath = getFileListingPath();
 CopyListing copyListing = CopyListing.getCopyListing(job.getConfiguration(),
   job.getCredentials(), context);
 copyListing.buildListing(fileListingPath, context);
 return fileListingPath;
}

相关文章