本文整理了Java中org.apache.hadoop.hive.ql.metadata.Hive.replaceFiles()
方法的一些代码示例,展示了Hive.replaceFiles()
的具体用法。这些代码示例主要来源于Github
/Stackoverflow
/Maven
等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。Hive.replaceFiles()
方法的具体详情如下:
包路径:org.apache.hadoop.hive.ql.metadata.Hive
类名称:Hive
方法名:replaceFiles
[英]Replaces files in the partition with new data set specified by srcf. Works by renaming directory of srcf to the destination file. srcf, destf, and tmppath should resident in the same DFS, but the oldPath can be in a different DFS.
[中]用srcf指定的新数据集替换分区中的文件。通过将srcf的目录重命名为目标文件来工作。srcf、destf和tmppath应驻留在同一个DFS中,但旧路径可以位于不同的DFS中。
代码示例来源:origin: apache/drill
if (replace || (oldPart == null && !isAcid)) {
boolean isAutoPurge = "true".equalsIgnoreCase(tbl.getProperty("auto.purge"));
replaceFiles(tbl.getPath(), loadPath, newPartPath, oldPartPath, getConf(),
isSrcLocal, isAutoPurge);
} else {
代码示例来源:origin: apache/drill
Path tableDest = tbl.getPath();
boolean isAutopurge = "true".equalsIgnoreCase(tbl.getProperty("auto.purge"));
replaceFiles(tableDest, loadPath, tableDest, tableDest, sessionConf, isSrcLocal, isAutopurge);
} else {
FileSystem fs;
代码示例来源:origin: apache/hive
boolean needRecycle = !tbl.isTemporary()
&& ReplChangeManager.isSourceOfReplication(Hive.get().getDatabase(tbl.getDbName()));
replaceFiles(tbl.getPath(), loadPath, destPath, oldPartPath, getConf(), isSrcLocal,
isAutoPurge, newFiles, FileUtils.HIDDEN_FILES_PATH_FILTER, needRecycle, isManaged);
} else {
代码示例来源:origin: apache/hive
boolean needRecycle = !tbl.isTemporary()
&& ReplChangeManager.isSourceOfReplication(Hive.get().getDatabase(tbl.getDbName()));
replaceFiles(tblPath, loadPath, destPath, tblPath, conf, isSrcLocal, isAutopurge,
newFiles, FileUtils.HIDDEN_FILES_PATH_FILTER, needRecycle, isManaged);
} else {
代码示例来源:origin: org.apache.hadoop.hive/hive-exec
/**
* Replaces the directory corresponding to the table by srcf. Works by
* deleting the table directory and renaming the source directory.
*
* @param srcf
* Source directory
* @param tmpd
* Temporary directory
*/
protected void replaceFiles(Path srcf) throws HiveException {
Path tableDest = new Path(getDataLocation().getPath());
Hive.replaceFiles(srcf, tableDest, tableDest, Hive.get().getConf());
}
代码示例来源:origin: org.apache.hadoop.hive/hive-exec
Hive.replaceFiles(loadPath, newPartPath, oldPartPath, getConf());
} else {
FileSystem fs = FileSystem.get(tbl.getDataLocation(), getConf());
代码示例来源:origin: com.facebook.presto.hive/hive-apache
Hive.replaceFiles(tbl.getPath(), loadPath, newPartPath, oldPartPath, getConf(),
isSrcLocal);
} else {
代码示例来源:origin: com.facebook.presto.hive/hive-apache
if (replace) {
Path tableDest = tbl.getPath();
replaceFiles(tableDest, loadPath, tableDest, tableDest, sessionConf, isSrcLocal);
} else {
FileSystem fs;
内容来源于网络,如有侵权,请联系作者删除!