xml架构到配置单元架构

r9f1avp5 于 2021-06-01 发布在 Hadoop

关注(0)|答案(1)|浏览(385)

我正在尝试将xml文件加载到配置单元表中。我在这里使用xmlserde。我能够加载简单的平面xml文件。但是当xml中有嵌套元素时，我使用hive复杂数据类型来存储它们（例如。， array<struct> ). 下面是我尝试加载的示例xml。我的目标是将所有元素、属性和内容加载到配置单元表中。

<description action="up">
    <name action="aorup" ln="te">
    this is name1
    </name>
    <name action="aorup" ln="tm">
    this is name2
    </name>
    <name action="aorup" ln="hi">
    this is name2
    </name>
</description>

我想得到的Hive输出是。。。

{action:"up", name:[{action:"aorup", ln:"te", content:"this is name1"}, {action:"aorup", ln:"tm", content:"this is name2"}, {action:"aorup", ln:"hi", content:"this is name3"}]}

我想将整个xml加载到一个配置单元列中。我尝试了以下方法：

CREATE TABLE description(
description STRUCT<
Action:STRING, 
name:ARRAY<STRUCT<
    Action:STRING, ln:STRING, content:STRING
    >>
>)
ROW FORMAT SERDE 'com.ibm.spss.hive.serde2.xml.XmlSerDe'
WITH SERDEPROPERTIES (
"xml.processor.class"="com.ximpleware.hive.serde2.xml.vtd.XmlProcessor",
"column.xpath.description"="/description")
STORED AS INPUTFORMAT 'com.ibm.spss.hive.serde2.xml.XmlInputFormat'
OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.IgnoreKeyTextOutputFormat'
TBLPROPERTIES ("xmlinput.start"="<description ","xmlinput.end"= "</description>");

但我得到的值为空 Label 现场。有人能帮我吗？
谢谢

hadoop Hive xml hive-serde

来源：https://stackoverflow.com/questions/44458090/xml-schema-to-hive-schema

1条答案

按热度按时间

iqjalb3h1#

create external table description
(
    description struct<action:string,description:array<struct<action:string,ln:string,name:string>>>
)
row format serde 'com.ibm.spss.hive.serde2.xml.XmlSerDe'
with serdeproperties 
(
    "column.xpath.description" = "/description"
)
stored as 
inputformat     'com.ibm.spss.hive.serde2.xml.XmlInputFormat'
outputformat    'org.apache.hadoop.hive.ql.io.IgnoreKeyTextOutputFormat'
tblproperties   
(
    "xmlinput.start" = "<description "
   ,"xmlinput.end"   = "</description>"
)
;

select * from description
;

+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
|                                                                                         description                                                                                         |
+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| {"action":"up","description":[{"action":"aorup","ln":"te","name":"this is name1"},{"action":"aorup","ln":"tm","name":"this is name2"},{"action":"aorup","ln":"hi","name":"this is name2"}]} |
+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+

赞(0）回复(0）举报 2021-06-01

我来回答

xml架构到配置单元架构

1条答案

相关问题

热门标签

最新问答