本文整理了Java中org.apache.hadoop.hive.common.FileUtils.makeListBucketingDirName()
方法的一些代码示例,展示了FileUtils.makeListBucketingDirName()
的具体用法。这些代码示例主要来源于Github
/Stackoverflow
/Maven
等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。FileUtils.makeListBucketingDirName()
方法的具体详情如下:
包路径:org.apache.hadoop.hive.common.FileUtils
类名称:FileUtils
方法名:makeListBucketingDirName
[英]Makes a valid list bucketing directory name.
[中]生成一个有效的列表,用于设置目录名。
代码示例来源:origin: apache/hive
/**
* Calculate skewed value subdirectory directory which is used in
* FileSinkOperator.java createKeyForStatsPublisher()
* For example, create table test skewed by (key, value) on (('484','val_484')
* stored as DIRECTORIES;
* after the method, skewedValuesDirNames will contain 2 elements:
* key=484/value=val_484
* HIVE_LIST_BUCKETING_DEFAULT_DIR_NAME/HIVE_LIST_BUCKETING_DEFAULT_DIR_NAME
*/
public void calculateSkewedValueSubDirList() {
if (isSkewedStoredAsDir()) {
for (List<String> value : this.skewedColValues) {
skewedValuesDirNames.add(FileUtils.makeListBucketingDirName(this.skewedColNames, value));
}
// creat default dir
skewedValuesDirNames.add(FileUtils.makeDefaultListBucketingDirName(
this.skewedColNames,
ListBucketingPrunerUtils.HIVE_LIST_BUCKETING_DEFAULT_DIR_NAME));
}
}
代码示例来源:origin: apache/drill
/**
* Calculate skewed value subdirectory directory which is used in
* FileSinkOperator.java createKeyForStatsPublisher()
* For example, create table test skewed by (key, value) on (('484','val_484')
* stored as DIRECTORIES;
* after the method, skewedValuesDirNames will contain 2 elements:
* key=484/value=val_484
* HIVE_LIST_BUCKETING_DEFAULT_DIR_NAME/HIVE_LIST_BUCKETING_DEFAULT_DIR_NAME
*/
public void calculateSkewedValueSubDirList() {
if (isSkewedStoredAsDir()) {
for (List<String> value : this.skewedColValues) {
skewedValuesDirNames.add(FileUtils.makeListBucketingDirName(this.skewedColNames, value));
}
// creat default dir
skewedValuesDirNames.add(FileUtils.makeDefaultListBucketingDirName(
this.skewedColNames,
ListBucketingPrunerUtils.HIVE_LIST_BUCKETING_DEFAULT_DIR_NAME));
}
}
代码示例来源:origin: apache/hive
lbDirName = FileUtils.makeListBucketingDirName(skewedCols, skewedValsCandidate);
locationMap.put(skewedValsCandidate, lbDirName);
} else {
代码示例来源:origin: apache/drill
lbDirName = FileUtils.makeListBucketingDirName(skewedCols, skewedValsCandidate);
locationMap.put(skewedValsCandidate, lbDirName);
} else {
代码示例来源:origin: com.facebook.presto.hive/hive-apache
/**
* Calculate skewed value subdirectory directory which is used in
* FileSinkOperator.java createKeyForStatsPublisher()
* For example, create table test skewed by (key, value) on (('484','val_484')
* stored as DIRECTORIES;
* after the method, skewedValuesDirNames will contain 2 elements:
* key=484/value=val_484
* HIVE_LIST_BUCKETING_DEFAULT_DIR_NAME/HIVE_LIST_BUCKETING_DEFAULT_DIR_NAME
*/
public void calculateSkewedValueSubDirList() {
if (isSkewedStoredAsDir()) {
for (List<String> value : this.skewedColValues) {
skewedValuesDirNames.add(FileUtils.makeListBucketingDirName(this.skewedColNames, value));
}
// creat default dir
skewedValuesDirNames.add(FileUtils.makeDefaultListBucketingDirName(
this.skewedColNames,
ListBucketingPrunerUtils.HIVE_LIST_BUCKETING_DEFAULT_DIR_NAME));
}
}
代码示例来源:origin: com.facebook.presto.hive/hive-apache
lbDirName = FileUtils.makeListBucketingDirName(skewedCols, skewedValsCandidate);
locationMap.put(skewedValsCandidate, lbDirName);
} else {
内容来源于网络,如有侵权,请联系作者删除!