org.apache.hadoop.mapred.lib.MultipleOutputs.addNamedOutput()方法的使用及代码示例

x33g5p2x  于2022-01-25 转载在 其他  
字(10.2k)|赞(0)|评价(0)|浏览(128)

本文整理了Java中org.apache.hadoop.mapred.lib.MultipleOutputs.addNamedOutput()方法的一些代码示例，展示了MultipleOutputs.addNamedOutput()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台，是从一些精选项目中提取出来的代码，具有较强的参考意义，能在一定程度帮忙到你。MultipleOutputs.addNamedOutput()方法的具体详情如下：
包路径：org.apache.hadoop.mapred.lib.MultipleOutputs
类名称：MultipleOutputs
方法名：addNamedOutput

MultipleOutputs.addNamedOutput介绍

[英]Adds a named output for the job.
[中]为作业添加命名输出。

代码示例

代码示例来源：origin: ch.cern.hadoop/hadoop-mapreduce-client-core

/**
 * Adds a multi named output for the job.
 *
 * @param conf              job conf to add the named output
 * @param namedOutput       named output name, it has to be a word, letters
 *                          and numbers only, cannot be the word 'part' as
 *                          that is reserved for the
 *                          default output.
 * @param outputFormatClass OutputFormat class.
 * @param keyClass          key class
 * @param valueClass        value class
 */
public static void addMultiNamedOutput(JobConf conf, String namedOutput,
               Class<? extends OutputFormat> outputFormatClass,
               Class<?> keyClass, Class<?> valueClass) {
 addNamedOutput(conf, namedOutput, true, outputFormatClass, keyClass,
  valueClass);
}

代码示例来源：origin: org.apache.hadoop/hadoop-mapred

/**
 * Adds a multi named output for the job.
 * <p/>
 *
 * @param conf              job conf to add the named output
 * @param namedOutput       named output name, it has to be a word, letters
 *                          and numbers only, cannot be the word 'part' as
 *                          that is reserved for the
 *                          default output.
 * @param outputFormatClass OutputFormat class.
 * @param keyClass          key class
 * @param valueClass        value class
 */
public static void addMultiNamedOutput(JobConf conf, String namedOutput,
               Class<? extends OutputFormat> outputFormatClass,
               Class<?> keyClass, Class<?> valueClass) {
 addNamedOutput(conf, namedOutput, true, outputFormatClass, keyClass,
  valueClass);
}

代码示例来源：origin: io.hops/hadoop-mapreduce-client-core

/**
 * Adds a named output for the job.
 *
 * @param conf              job conf to add the named output
 * @param namedOutput       named output name, it has to be a word, letters
 *                          and numbers only, cannot be the word 'part' as
 *                          that is reserved for the
 *                          default output.
 * @param outputFormatClass OutputFormat class.
 * @param keyClass          key class
 * @param valueClass        value class
 */
public static void addNamedOutput(JobConf conf, String namedOutput,
               Class<? extends OutputFormat> outputFormatClass,
               Class<?> keyClass, Class<?> valueClass) {
 addNamedOutput(conf, namedOutput, false, outputFormatClass, keyClass,
  valueClass);
}

代码示例来源：origin: com.facebook.hadoop/hadoop-core

/**
 * Adds a multi named output for the job.
 * <p/>
 *
 * @param conf              job conf to add the named output
 * @param namedOutput       named output name, it has to be a word, letters
 *                          and numbers only, cannot be the word 'part' as
 *                          that is reserved for the
 *                          default output.
 * @param outputFormatClass OutputFormat class.
 * @param keyClass          key class
 * @param valueClass        value class
 */
public static void addMultiNamedOutput(JobConf conf, String namedOutput,
               Class<? extends OutputFormat> outputFormatClass,
               Class<?> keyClass, Class<?> valueClass) {
 addNamedOutput(conf, namedOutput, true, outputFormatClass, keyClass,
  valueClass);
}

代码示例来源：origin: org.jvnet.hudson.hadoop/hadoop-core

/**
 * Adds a named output for the job.
 * <p/>
 *
 * @param conf              job conf to add the named output
 * @param namedOutput       named output name, it has to be a word, letters
 *                          and numbers only, cannot be the word 'part' as
 *                          that is reserved for the
 *                          default output.
 * @param outputFormatClass OutputFormat class.
 * @param keyClass          key class
 * @param valueClass        value class
 */
public static void addNamedOutput(JobConf conf, String namedOutput,
               Class<? extends OutputFormat> outputFormatClass,
               Class<?> keyClass, Class<?> valueClass) {
 addNamedOutput(conf, namedOutput, false, outputFormatClass, keyClass,
  valueClass);
}

代码示例来源：origin: io.hops/hadoop-mapreduce-client-core

/**
 * Adds a multi named output for the job.
 *
 * @param conf              job conf to add the named output
 * @param namedOutput       named output name, it has to be a word, letters
 *                          and numbers only, cannot be the word 'part' as
 *                          that is reserved for the
 *                          default output.
 * @param outputFormatClass OutputFormat class.
 * @param keyClass          key class
 * @param valueClass        value class
 */
public static void addMultiNamedOutput(JobConf conf, String namedOutput,
               Class<? extends OutputFormat> outputFormatClass,
               Class<?> keyClass, Class<?> valueClass) {
 addNamedOutput(conf, namedOutput, true, outputFormatClass, keyClass,
  valueClass);
}

代码示例来源：origin: com.github.jiayuhan-it/hadoop-mapreduce-client-core

/**
 * Adds a multi named output for the job.
 *
 * @param conf              job conf to add the named output
 * @param namedOutput       named output name, it has to be a word, letters
 *                          and numbers only, cannot be the word 'part' as
 *                          that is reserved for the
 *                          default output.
 * @param outputFormatClass OutputFormat class.
 * @param keyClass          key class
 * @param valueClass        value class
 */
public static void addMultiNamedOutput(JobConf conf, String namedOutput,
               Class<? extends OutputFormat> outputFormatClass,
               Class<?> keyClass, Class<?> valueClass) {
 addNamedOutput(conf, namedOutput, true, outputFormatClass, keyClass,
  valueClass);
}

代码示例来源：origin: io.prestosql.hadoop/hadoop-apache

/**
 * Adds a named output for the job.
 *
 * @param conf              job conf to add the named output
 * @param namedOutput       named output name, it has to be a word, letters
 *                          and numbers only, cannot be the word 'part' as
 *                          that is reserved for the
 *                          default output.
 * @param outputFormatClass OutputFormat class.
 * @param keyClass          key class
 * @param valueClass        value class
 */
public static void addNamedOutput(JobConf conf, String namedOutput,
               Class<? extends OutputFormat> outputFormatClass,
               Class<?> keyClass, Class<?> valueClass) {
 addNamedOutput(conf, namedOutput, false, outputFormatClass, keyClass,
  valueClass);
}

代码示例来源：origin: org.apache.hadoop/hadoop-mapred

/**
 * Adds a named output for the job.
 * <p/>
 *
 * @param conf              job conf to add the named output
 * @param namedOutput       named output name, it has to be a word, letters
 *                          and numbers only, cannot be the word 'part' as
 *                          that is reserved for the
 *                          default output.
 * @param outputFormatClass OutputFormat class.
 * @param keyClass          key class
 * @param valueClass        value class
 */
public static void addNamedOutput(JobConf conf, String namedOutput,
               Class<? extends OutputFormat> outputFormatClass,
               Class<?> keyClass, Class<?> valueClass) {
 addNamedOutput(conf, namedOutput, false, outputFormatClass, keyClass,
  valueClass);
}

代码示例来源：origin: com.facebook.hadoop/hadoop-core

/**
 * Adds a named output for the job.
 * <p/>
 *
 * @param conf              job conf to add the named output
 * @param namedOutput       named output name, it has to be a word, letters
 *                          and numbers only, cannot be the word 'part' as
 *                          that is reserved for the
 *                          default output.
 * @param outputFormatClass OutputFormat class.
 * @param keyClass          key class
 * @param valueClass        value class
 */
public static void addNamedOutput(JobConf conf, String namedOutput,
               Class<? extends OutputFormat> outputFormatClass,
               Class<?> keyClass, Class<?> valueClass) {
 addNamedOutput(conf, namedOutput, false, outputFormatClass, keyClass,
  valueClass);
}

代码示例来源：origin: ch.cern.hadoop/hadoop-mapreduce-client-core

/**
 * Adds a named output for the job.
 *
 * @param conf              job conf to add the named output
 * @param namedOutput       named output name, it has to be a word, letters
 *                          and numbers only, cannot be the word 'part' as
 *                          that is reserved for the
 *                          default output.
 * @param outputFormatClass OutputFormat class.
 * @param keyClass          key class
 * @param valueClass        value class
 */
public static void addNamedOutput(JobConf conf, String namedOutput,
               Class<? extends OutputFormat> outputFormatClass,
               Class<?> keyClass, Class<?> valueClass) {
 addNamedOutput(conf, namedOutput, false, outputFormatClass, keyClass,
  valueClass);
}

代码示例来源：origin: com.github.jiayuhan-it/hadoop-mapreduce-client-core

/**
 * Adds a named output for the job.
 *
 * @param conf              job conf to add the named output
 * @param namedOutput       named output name, it has to be a word, letters
 *                          and numbers only, cannot be the word 'part' as
 *                          that is reserved for the
 *                          default output.
 * @param outputFormatClass OutputFormat class.
 * @param keyClass          key class
 * @param valueClass        value class
 */
public static void addNamedOutput(JobConf conf, String namedOutput,
               Class<? extends OutputFormat> outputFormatClass,
               Class<?> keyClass, Class<?> valueClass) {
 addNamedOutput(conf, namedOutput, false, outputFormatClass, keyClass,
  valueClass);
}

代码示例来源：origin: io.prestosql.hadoop/hadoop-apache

/**
 * Adds a multi named output for the job.
 *
 * @param conf              job conf to add the named output
 * @param namedOutput       named output name, it has to be a word, letters
 *                          and numbers only, cannot be the word 'part' as
 *                          that is reserved for the
 *                          default output.
 * @param outputFormatClass OutputFormat class.
 * @param keyClass          key class
 * @param valueClass        value class
 */
public static void addMultiNamedOutput(JobConf conf, String namedOutput,
               Class<? extends OutputFormat> outputFormatClass,
               Class<?> keyClass, Class<?> valueClass) {
 addNamedOutput(conf, namedOutput, true, outputFormatClass, keyClass,
  valueClass);
}

代码示例来源：origin: org.jvnet.hudson.hadoop/hadoop-core

/**
 * Adds a multi named output for the job.
 * <p/>
 *
 * @param conf              job conf to add the named output
 * @param namedOutput       named output name, it has to be a word, letters
 *                          and numbers only, cannot be the word 'part' as
 *                          that is reserved for the
 *                          default output.
 * @param outputFormatClass OutputFormat class.
 * @param keyClass          key class
 * @param valueClass        value class
 */
public static void addMultiNamedOutput(JobConf conf, String namedOutput,
               Class<? extends OutputFormat> outputFormatClass,
               Class<?> keyClass, Class<?> valueClass) {
 addNamedOutput(conf, namedOutput, true, outputFormatClass, keyClass,
  valueClass);
}

代码示例来源：origin: org.apache.mahout/mahout-mrlegacy

MultipleOutputs.addNamedOutput(oldApiJob,
                OUTPUT_QHAT,
                org.apache.hadoop.mapred.SequenceFileOutputFormat.class,
                SplitPartitionedWritable.class,
                DenseBlockWritable.class);
MultipleOutputs.addNamedOutput(oldApiJob,
                OUTPUT_RHAT,
                org.apache.hadoop.mapred.SequenceFileOutputFormat.class,

代码示例来源：origin: org.apache.mahout/mahout-mr

MultipleOutputs.addNamedOutput(oldApiJob,
                OUTPUT_QHAT,
                org.apache.hadoop.mapred.SequenceFileOutputFormat.class,
                SplitPartitionedWritable.class,
                DenseBlockWritable.class);
MultipleOutputs.addNamedOutput(oldApiJob,
                OUTPUT_RHAT,
                org.apache.hadoop.mapred.SequenceFileOutputFormat.class,

代码示例来源：origin: org.apache.mahout/mahout-core

MultipleOutputs.addNamedOutput(oldApiJob,
                OUTPUT_QHAT,
                org.apache.hadoop.mapred.SequenceFileOutputFormat.class,
                SplitPartitionedWritable.class,
                DenseBlockWritable.class);
MultipleOutputs.addNamedOutput(oldApiJob,
                OUTPUT_RHAT,
                org.apache.hadoop.mapred.SequenceFileOutputFormat.class,

代码示例来源：origin: 01org/graphbuilder

MultipleOutputs.addNamedOutput(conf, outprefix + i,
  TextOutputFormat.class, Text.class, Text.class);

代码示例来源：origin: ch.cern.hadoop/hadoop-mapreduce-client-jobclient

MultipleOutputs.addNamedOutput(conf, "text", TextOutputFormat.class,
 Long.class, String.class);

代码示例来源：origin: ch.cern.hadoop/hadoop-mapreduce-client-jobclient

MultipleOutputs.addNamedOutput(conf, "text", TextOutputFormat.class,
 LongWritable.class, Text.class);
MultipleOutputs.addMultiNamedOutput(conf, "sequence",

内容来源于网络，如有侵权，请联系作者删除！

MultipleOutputs

相关文章

    查看更多

    热门标签

    更多
    JavaquerypythonNode开发语言requestUtil数据库Table后端算法LoggerMessageElementParser

    最新文章

    更多
    • 蜀ICP备2022004421号-2 NULL123 https://www.null123.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com