org.apache.hadoop.mapred.lib.MultipleOutputs.addMultiNamedOutput()方法的使用及代码示例

x33g5p2x  于2022-01-25 转载在 其他  
字(3.6k)|赞(0)|评价(0)|浏览(126)

本文整理了Java中org.apache.hadoop.mapred.lib.MultipleOutputs.addMultiNamedOutput()方法的一些代码示例,展示了MultipleOutputs.addMultiNamedOutput()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。MultipleOutputs.addMultiNamedOutput()方法的具体详情如下:
包路径:org.apache.hadoop.mapred.lib.MultipleOutputs
类名称:MultipleOutputs
方法名:addMultiNamedOutput

MultipleOutputs.addMultiNamedOutput介绍

[英]Adds a multi named output for the job.
[中]为作业添加多个命名的输出。

代码示例

代码示例来源:origin: ukwa/webarchive-discovery

conf.setNumReduceTasks(numReducers);
MultipleOutputs.addMultiNamedOutput(conf, FORMATS_SUMMARY_NAME,
    KeylessTextOutputFormat.class, Text.class, Text.class);
MultipleOutputs.addMultiNamedOutput(conf, FORMATS_FFB_NAME,
    KeylessTextOutputFormat.class, Text.class, Text.class);
MultipleOutputs.addMultiNamedOutput(conf, HOST_LINKS_NAME,
    KeylessTextOutputFormat.class, Text.class, Text.class);
MultipleOutputs.addMultiNamedOutput(conf, GEO_SUMMARY_NAME,
    KeylessTextOutputFormat.class, Text.class, Text.class);

代码示例来源:origin: ukwa/webarchive-discovery

conf.setNumReduceTasks(numReducers);
MultipleOutputs.addMultiNamedOutput(conf, FORMATS_SUMMARY_NAME,
    TextOutputFormat.class, Text.class, Text.class);
MultipleOutputs.addMultiNamedOutput(conf, FORMATS_FFB_NAME,
    TextOutputFormat.class, Text.class, Text.class);
MultipleOutputs.addMultiNamedOutput(conf, HOSTS_NAME,
    TextOutputFormat.class, Text.class, Text.class);
MultipleOutputs.addMultiNamedOutput(conf, HOST_LINKS_NAME,
    TextOutputFormat.class, Text.class, Text.class);
MultipleOutputs.addMultiNamedOutput(conf, GEO_SUMMARY_NAME,
    TextOutputFormat.class, Text.class, Text.class);
MultipleOutputs.addMultiNamedOutput(conf, FACES_NAME,
    TextOutputFormat.class, Text.class, Text.class);

代码示例来源:origin: ukwa/webarchive-discovery

conf.setNumReduceTasks(numReducers);
MultipleOutputs.addMultiNamedOutput(conf, GEO_NAME,
    KeylessTextOutputFormat.class, Text.class, Text.class);
MultipleOutputs.addMultiNamedOutput(conf, FORMATS_FFB_SAMPLE_NAME,
    KeylessTextOutputFormat.class, Text.class, Text.class);

代码示例来源:origin: lintool/Mr.LDA

conf.setJobName(ParseCorpus.class.getSimpleName() + " - tokenize document");
MultipleOutputs.addMultiNamedOutput(conf, DOCUMENT, SequenceFileOutputFormat.class, Text.class,
  HMapSIW.class);
MultipleOutputs.addMultiNamedOutput(conf, TITLE, SequenceFileOutputFormat.class, Text.class,
  NullWritable.class);

代码示例来源:origin: lintool/Mr.LDA

conf.setOutputValueClass(Text.class);
MultipleOutputs.addMultiNamedOutput(conf, TERM, SequenceFileOutputFormat.class,
  IntWritable.class, Text.class);

代码示例来源:origin: org.apache.hadoop/hadoop-mapred-test

MultipleOutputs.addMultiNamedOutput(conf, "sequence",
 SequenceFileOutputFormat.class, LongWritable.class, Text.class);

代码示例来源:origin: lintool/Mr.LDA

FileSystem fs = FileSystem.get(conf);
MultipleOutputs.addMultiNamedOutput(conf, DOCUMENT, SequenceFileOutputFormat.class, Text.class,
  ArrayListWritable.class);
MultipleOutputs.addMultiNamedOutput(conf, TITLE, SequenceFileOutputFormat.class, Text.class,
  NullWritable.class);

代码示例来源:origin: lintool/Mr.LDA

MultipleOutputs.addMultiNamedOutput(conf, Settings.BETA, SequenceFileOutputFormat.class,
  PairOfIntFloat.class, HMapIDW.class);
MultipleOutputs.addMultiNamedOutput(conf, Settings.GAMMA, SequenceFileOutputFormat.class,
  IntWritable.class, Document.class);

代码示例来源:origin: lintool/Mr.LDA

MultipleOutputs.addMultiNamedOutput(conf, Settings.BETA, SequenceFileOutputFormat.class,
  PairOfIntFloat.class, HMapIDW.class);
MultipleOutputs.addMultiNamedOutput(conf, Settings.GAMMA, SequenceFileOutputFormat.class,
  IntWritable.class, Document.class);

代码示例来源:origin: ch.cern.hadoop/hadoop-mapreduce-client-jobclient

MultipleOutputs.addMultiNamedOutput(conf, "sequence",
 SequenceFileOutputFormat.class, LongWritable.class, Text.class);

相关文章