在pig中获取emp记录

nqwrtyyt 于 2021-05-30 发布在 Hadoop

关注(0)|答案(1)|浏览(423)

EMP_ID  PRD_NO  PRD_DATE               PRD_TOTAL PRD_NORM

IND235  00020   28/Mar/2015 02:00:50    11  60.00

IND235  00018   27/Mar/2015 03:10:40    7   60.00

IND235  00019   28/Mar/2015 04:00:54    3   60.00

IND235  00020   27/Mar/2015 05:00:51    11  60.00

PUR266  00044   28/Mar/2015 01:20:50    85  100.00

PUR266  00024   28/Mar/2015 06:30:60    33  100.00

PUR266  00017   27/Mar/2015 05:30:05    11  100.00

PUR266  00038   27/Mar/2015 02:30:15    60  100.00

I would expect to get the output:

IND235,27/Mar/2015,60,18,42

IND235,28/Mar/2015,60,14,46

PUR266,27/Mar/2015,100,71,29

PUR266,28/Mar/2015,100,118,-18

last col is PRD_NORM-PRD_TOTAL:

PRD_TOTAL sum by PRD_DATE,GROUP BY EMP_ID

我刚刚开始学习pig拉丁语的来龙去脉-在pig或某个库中是否已经有了一种内在的方法来实现这一点，或者我应该考虑编写一个udf吗？

hadoop bigdata apache-pig latin

来源：https://stackoverflow.com/questions/29469243/get-emp-record-in-pig

1条答案

按热度按时间

xriantvc1#

试试看。。

A = load 'pigdeduct' using PigStorage(' ') as (a1:chararray,b1:int,c1:chararray,d1:chararray,e1:int,f1:int);

B = foreach A GENERATE a1,c1,e1,f1; 

C = group B by (a1,c1);

D = foreach C generate FLATTEN(group),SUM(B.f1)/2,SUM(B.e1),SUM(B.f1)/2 - SUM(B.e1);

dump D;

输入文件：

IND235 00020 28/Mar/2015 02:00:50 11 60.00
IND235 00018 27/Mar/2015 03:10:40 7 60.00
IND235 00019 28/Mar/2015 04:00:54 3 60.00
IND235 00020 27/Mar/2015 05:00:51 11 60.00
PUR266 00044 28/Mar/2015 01:20:50 85 100.00
PUR266 00024 28/Mar/2015 06:30:60 33 100.00
PUR266 00017 27/Mar/2015 05:30:05 11 100.00
PUR266 00038 27/Mar/2015 02:30:15 60 100.00

输出：

(IND235,27/Mar/2015,60,18,42)
(IND235,28/Mar/2015,60,14,46)
(PUR266,27/Mar/2015,100,71,29)
(PUR266,28/Mar/2015,100,118,-18)

赞(0）回复(0）举报 2021-05-30

我来回答

在pig中获取emp记录

1条答案

相关问题

热门标签

最新问答