org.apache.hadoop.hive.common.FileUtils.makeListBucketingDirName()方法的使用及代码示例

x33g5p2x  于2022-01-19 转载在 其他  
字(3.2k)|赞(0)|评价(0)|浏览(107)

本文整理了Java中org.apache.hadoop.hive.common.FileUtils.makeListBucketingDirName()方法的一些代码示例,展示了FileUtils.makeListBucketingDirName()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。FileUtils.makeListBucketingDirName()方法的具体详情如下:
包路径:org.apache.hadoop.hive.common.FileUtils
类名称:FileUtils
方法名:makeListBucketingDirName

FileUtils.makeListBucketingDirName介绍

[英]Makes a valid list bucketing directory name.
[中]生成一个有效的列表,用于设置目录名。

代码示例

代码示例来源:origin: apache/hive

/**
 * Calculate skewed value subdirectory directory which is used in
 * FileSinkOperator.java createKeyForStatsPublisher()
 * For example, create table test skewed by (key, value) on (('484','val_484')
 * stored as DIRECTORIES;
 * after the method, skewedValuesDirNames will contain 2 elements:
 * key=484/value=val_484
 * HIVE_LIST_BUCKETING_DEFAULT_DIR_NAME/HIVE_LIST_BUCKETING_DEFAULT_DIR_NAME
 */
public void calculateSkewedValueSubDirList() {
 if (isSkewedStoredAsDir()) {
  for (List<String> value : this.skewedColValues) {
   skewedValuesDirNames.add(FileUtils.makeListBucketingDirName(this.skewedColNames, value));
  }
  // creat default dir
  skewedValuesDirNames.add(FileUtils.makeDefaultListBucketingDirName(
    this.skewedColNames,
    ListBucketingPrunerUtils.HIVE_LIST_BUCKETING_DEFAULT_DIR_NAME));
 }
}

代码示例来源:origin: apache/drill

/**
 * Calculate skewed value subdirectory directory which is used in
 * FileSinkOperator.java createKeyForStatsPublisher()
 * For example, create table test skewed by (key, value) on (('484','val_484')
 * stored as DIRECTORIES;
 * after the method, skewedValuesDirNames will contain 2 elements:
 * key=484/value=val_484
 * HIVE_LIST_BUCKETING_DEFAULT_DIR_NAME/HIVE_LIST_BUCKETING_DEFAULT_DIR_NAME
 */
public void calculateSkewedValueSubDirList() {
 if (isSkewedStoredAsDir()) {
  for (List<String> value : this.skewedColValues) {
   skewedValuesDirNames.add(FileUtils.makeListBucketingDirName(this.skewedColNames, value));
  }
  // creat default dir
  skewedValuesDirNames.add(FileUtils.makeDefaultListBucketingDirName(
    this.skewedColNames,
    ListBucketingPrunerUtils.HIVE_LIST_BUCKETING_DEFAULT_DIR_NAME));
 }
}

代码示例来源:origin: apache/hive

lbDirName = FileUtils.makeListBucketingDirName(skewedCols, skewedValsCandidate);
 locationMap.put(skewedValsCandidate, lbDirName);
} else {

代码示例来源:origin: apache/drill

lbDirName = FileUtils.makeListBucketingDirName(skewedCols, skewedValsCandidate);
 locationMap.put(skewedValsCandidate, lbDirName);
} else {

代码示例来源:origin: com.facebook.presto.hive/hive-apache

/**
 * Calculate skewed value subdirectory directory which is used in
 * FileSinkOperator.java createKeyForStatsPublisher()
 * For example, create table test skewed by (key, value) on (('484','val_484')
 * stored as DIRECTORIES;
 * after the method, skewedValuesDirNames will contain 2 elements:
 * key=484/value=val_484
 * HIVE_LIST_BUCKETING_DEFAULT_DIR_NAME/HIVE_LIST_BUCKETING_DEFAULT_DIR_NAME
 */
public void calculateSkewedValueSubDirList() {
 if (isSkewedStoredAsDir()) {
  for (List<String> value : this.skewedColValues) {
   skewedValuesDirNames.add(FileUtils.makeListBucketingDirName(this.skewedColNames, value));
  }
  // creat default dir
  skewedValuesDirNames.add(FileUtils.makeDefaultListBucketingDirName(
    this.skewedColNames,
    ListBucketingPrunerUtils.HIVE_LIST_BUCKETING_DEFAULT_DIR_NAME));
 }
}

代码示例来源:origin: com.facebook.presto.hive/hive-apache

lbDirName = FileUtils.makeListBucketingDirName(skewedCols, skewedValsCandidate);
 locationMap.put(skewedValsCandidate, lbDirName);
} else {

相关文章