hiveover子句可以同时运行多个reducer

nwlqm0z1  于 2021-05-29  发布在  Hadoop
关注(0)|答案(1)|浏览(359)

如何运行/激活这样的脚本来同时启动所有减速器?

`SELECT id, map(
 'r02', string(PERCENT_RANK() OVER (ORDER BY maps['k02']))
, 'r03', string(PERCENT_RANK() OVER (ORDER BY maps['k03']))
, 'r04', string(PERCENT_RANK() OVER (ORDER BY maps['k04']))
, 'r06', string(PERCENT_RANK() OVER (ORDER BY maps['k06']))
, 'r09', string(PERCENT_RANK() OVER (ORDER BY maps['k09']))
, 'r10', string(PERCENT_RANK() OVER (ORDER BY maps['k10']))
, 'r11', string(PERCENT_RANK() OVER (ORDER BY maps['k11'])))
FROM database

Map完成后,似乎一次只运行一个减速器

INFO  : Map 1: 3/3      Reducer 2: 1(+1)/2      Reducer 3: 0/2  Reducer 4: 0/2  Reducer 5: 0/2  Reducer 6: 0/2  Reducer 7: 0/2Reducer 8: 0/2

INFO  : Map 1: 3/3      Reducer 2: 2/2  Reducer 3: 1(+1)/2      Reducer 4: 0/2  Reducer 5: 0/2  Reducer 6: 0/2  Reducer 7: 0/2Reducer 8: 0/2

如何更改脚本以使所有减速器并行运行?谢谢大家。

相关问题