spark sql(1.1.0版)支持配置单元索引吗?

icnyk63a  于 2021-06-02  发布在  Hadoop
关注(0)|答案(1)|浏览(341)

我用的是sparksqlconnect配置单元,基本查询还可以,但是无法创建索引,sparksql会支持索引吗?

DROP TABLE test_tabe;
CREATE  TABLE test_tabe
(
....
,area   STRING
...
)
ROW FORMAT DELIMITED
FIELDS TERMINATED BY '\t'
LINES TERMINATED BY '\n'
STORED AS RCFILE
--STORED AS SEQUENCEFILE
;
CREATE INDEX idx_compact_index ON TABLE test_tabe (area) AS 'COMPACT' WITH DEFERRED REBUILD

# !!!!Execute always,no error,spark web page no corresponding job !!!!

ALTER INDEX idx_compact_index ON test_tabe REBUILD;

insert overwrite table test.test_tabe select * from test.new_mkt_browse_label_10m

谢谢。

oxalkeyp

oxalkeyp1#

spark中不支持配置单元索引。它们不那么重要,因为spark是内存计算。有没有在spark中运行索引配置单元查询和类似查询之间的比较?您可以在这里查看有关未实现索引的更多信息

相关问题