使用python模块impyla连接到kerberized hadoop集群

hsvhsicv 于 2021-06-02 发布在 Hadoop

关注(0)|答案(1)|浏览(499)

我正在使用impyla模块连接到kerberized hadoop集群。我想进入
hiveserver2/hive，但出现以下错误：

测试连接件

from impala.dbapi import connect
import os
connection_string = 'hdp296m1.XXX.XXX.com'
conn = connect(host=connection_string, port=21050,auth_mechanism="GSSAPI",kerberos_service_name='testuser@Myrealm.COM',password='testuser')
cursor = conn.cursor()
cursor.execute('select count(*) form t_all_types_simple_t')
print cursor.description
results = cursor.fetchall()

堆栈跟踪：

[vagrant@localhost vagrant]$ python test_conn.py
Traceback (most recent call last):
  File "test_conn.py", line 4, in <module>
    conn = connect(host=connection_string, port=21050, auth_mechanism="GSSAPI",kerberos_service_name='testuser@Myrealm.COM',password='testuser')
  File "/usr/lib/python2.7/site-packages/impala/dbapi.py", line 147, in connect
    auth_mechanism=auth_mechanism)
  File "/usr/lib/python2.7/site-packages/impala/hiveserver2.py", line 758, in connect
    transport.open()
  File "/usr/lib/python2.7/site-packages/thrift_sasl/__init__.py", line 61, in open
    self._trans.open()
  File "/usr/lib64/python2.7/site-packages/thrift/transport/TSocket.py", line 101, in open
    message=message)
thrift.transport.TTransport.TTransportException: Could not connect to hdp296m1.XXX.XXX.com:21050

testuser是我的kerberos主体，我将使用它来完成这个任务。

hadoop python python-2.7 kerberos impyla

来源：https://stackoverflow.com/questions/41738526/connecting-to-kerberized-hadoop-cluster-using-python-module-impyla

1条答案

按热度按时间

ecfdbz9o1#

您的连接似乎不正确。。尝试，

from impala.dbapi import *
import sys, os

# set your parms

host=os.environ.get("CDH_HIVE",'x.x.x.x')
port=os.environ.get("CDH_HIVE_port",'10000')
auth_mechanism=os.environ.get("CDH_auth",'GSSAPI')
user='hive' 
db='mydb' 

# No password use kinit

password=''

# hive is principal with krb

kbservice='hive'  

class Hive:

    def __init__(self,db):
        self.database=db
        self.__conn = connect(host=host,
                            port=port,
                            auth_mechanism=auth_mechanism,
                            user=user,
                            password=password,
                            database=db,
                            kerberos_service_name=kbservice
                            )

        self.__cursor = self.__conn.cursor()

h = Hive(db)

赞(0）回复(0）举报 2021-06-02

我来回答

使用python模块impyla连接到kerberized hadoop集群

测试连接件

1条答案

相关问题

热门标签

最新问答