本文整理了Java中cz.seznam.euphoria.core.client.operator.FlatMap.getName()
方法的一些代码示例,展示了FlatMap.getName()
的具体用法。这些代码示例主要来源于Github
/Stackoverflow
/Maven
等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。FlatMap.getName()
方法的具体详情如下:
包路径:cz.seznam.euphoria.core.client.operator.FlatMap
类名称:FlatMap
方法名:getName
暂无
代码示例来源:origin: seznam/euphoria
@Override
@SuppressWarnings("unchecked")
public JavaRDD<?> translate(FlatMap operator, SparkExecutorContext context) {
final JavaRDD<?> input = context.getSingleInput(operator);
final UnaryFunctor<?, ?> mapper = operator.getFunctor();
final ExtractEventTime<?> evtTimeFn = operator.getEventTimeExtractor();
LazyAccumulatorProvider accumulators =
new LazyAccumulatorProvider(context.getAccumulatorFactory(), context.getSettings());
if (evtTimeFn != null) {
return input
.flatMap(new EventTimeAssigningUnaryFunctor(mapper, evtTimeFn, accumulators))
.setName(operator.getName() + "::event-time-and-apply-udf");
} else {
return input
.flatMap(new UnaryFunctorWrapper(mapper, accumulators))
.setName(operator.getName() + "::apply-udf");
}
}
}
代码示例来源:origin: seznam/euphoria
@Test
public void testBuild_ImplicitName() {
Flow flow = Flow.create("TEST");
Dataset<String> dataset = Util.createMockDataset(flow, 1);
Dataset<String> mapped = FlatMap.of(dataset)
.using((String s, Collector<String> c) -> c.collect(s))
.output();
FlatMap map = (FlatMap) flow.operators().iterator().next();
assertEquals("FlatMap", map.getName());
}
代码示例来源:origin: seznam/euphoria
@Test
public void testBuild() {
Flow flow = Flow.create("TEST");
Dataset<String> dataset = Util.createMockDataset(flow, 1);
Dataset<String> mapped = FlatMap.named("FlatMap1")
.of(dataset)
.using((String s, Collector<String> c) -> c.collect(s))
.output();
assertEquals(flow, mapped.getFlow());
assertEquals(1, flow.size());
FlatMap map = (FlatMap) flow.operators().iterator().next();
assertEquals(flow, map.getFlow());
assertEquals("FlatMap1", map.getName());
assertNotNull(map.getFunctor());
assertEquals(mapped, map.output());
assertNull(map.getEventTimeExtractor());
}
代码示例来源:origin: seznam/euphoria
@Test
public void testBuild_WithCounters() {
Flow flow = Flow.create("TEST");
Dataset<String> dataset = Util.createMockDataset(flow, 1);
Dataset<String> mapped = FlatMap.named("FlatMap1")
.of(dataset)
.using((String s, Collector<String> c) -> {
c.getCounter("my-counter").increment();
c.collect(s);
})
.output();
assertEquals(flow, mapped.getFlow());
assertEquals(1, flow.size());
FlatMap map = (FlatMap) flow.operators().iterator().next();
assertEquals(flow, map.getFlow());
assertEquals("FlatMap1", map.getName());
assertNotNull(map.getFunctor());
assertEquals(mapped, map.output());
}
代码示例来源:origin: seznam/euphoria
@Test
public void testBuild_EventTimeExtractor() {
Flow flow = Flow.create("TEST");
Dataset<String> dataset = Util.createMockDataset(flow, 1);
Dataset<BigDecimal> mapped = FlatMap.named("FlatMap2")
.of(dataset)
.using((String s, Collector<BigDecimal> c) -> c.collect(null))
.eventTimeBy(Long::parseLong) // ~ consuming the original input elements
.output();
assertEquals(flow, mapped.getFlow());
assertEquals(1, flow.size());
FlatMap map = (FlatMap) flow.operators().iterator().next();
assertEquals(flow, map.getFlow());
assertEquals("FlatMap2", map.getName());
assertNotNull(map.getFunctor());
assertEquals(mapped, map.output());
assertNotNull(map.getEventTimeExtractor());
}
内容来源于网络,如有侵权,请联系作者删除!