hadoop\u mapreduce\u wordcount string to text或text to string

eiee3dmh  于 2021-06-03  发布在  Hadoop
关注(0)|答案(1)|浏览(255)

从f中选择count(*),其中a='lee'
我想使用wordcount示例将此查询生成代码。

public class WordCountDriver {
    public static void main(String[] args) throws Exception {
        Configuration conf = new Configuration();

        Job job = new Job(conf, "word count");      
        job.setJarByClass(WordCountDriver.class);
        job.setMapperClass(WordCountMapper.class);
        job.setInputFormatClass(TextInputFormat.class);
        FileInputFormat.addInputPath(job, new Path(args[1]));

        job.setReducerClass(WordCountReducer.class);
        job.setOutputKeyClass(Text.class);
        job.setOutputValueClass(IntWritable.class);
        FileOutputFormat.setOutputPath(job, new Path(args[2]));

        job.waitForCompletion(true);
    }
}

public class WordCountMapper extends Mapper<LongWritable, Text, Text, IntWritable> {
        private final static IntWritable one = new IntWritable(1);

        public void map(LongWritable key, Text value, Context context)
        throws IOException, InterruptedException {
            StringTokenizer itr = new StringTokenizer(value.toString());
            while (itr.hasMoreTokens()) {
                context.write(new Text(itr.nextToken()), one);
            }
        }
    }

public class WordCountReducer extends Reducer<Text, IntWritable, Text, IntWritable> {
    private IntWritable result = new IntWritable();

    public void reduce(Text key, Iterable<IntWritable> values, Context context) 
            throws IOException, InterruptedException {
        int sum = 0;

        Text a;
        String convertkey;
        convertkey = "Lee";
        a = new Text(convertkey);

        if( key == a){

        for (IntWritable val : values) {
            sum += val.get();
        }
        result.set(sum);
        context.write(key, result);
        }
    }
}

但如果循环不起作用如果我使用if(k),它就不能工作=a) ,它起作用了。为什么它知道k不是eqaul a??

eivnm1vs

eivnm1vs1#

您不想使用==。改用equals()方法。不过,请注意,该键是一个文本,而不是像“lee”那样的字符串。您需要对文本使用tostring()方法来获取要比较的字符串。

相关问题