Zookeeper 使用pysolr连接到solr云集合

eivgtgni  于 2022-12-09  发布在  Apache
关注(0)|答案(3)|浏览(127)

我已经配置了一个多核solr云。创建了一个有2个碎片的集合,没有复制。

通过solr UI 192.168.1.56:8983,我能够获得查询的结果。
我想对pysolr做同样的事情,所以试着运行以下命令:

import pysolr
zookeeper = pysolr.ZooKeeper("192.168.1.56:2181,192.168.1.55:2182")
solr = pysolr.SolrCloud(zookeeper, "random_collection")

最后一行无法找到集合,即使它在那里。2下面是一个错误跟踪:

---------------------------------------------------------------------------
SolrError                                 Traceback (most recent call last)
<ipython-input-43-9f03eca3b645> in <module>()
----> 1 solr = pysolr.SolrCloud(zookeeper, "patent_colllection")

/usr/local/lib/python2.7/dist-packages/pysolr.pyc in __init__(self, zookeeper, collection, decoder, timeout, retry_timeout, *args, **kwargs)
   1176 
   1177     def __init__(self, zookeeper, collection, decoder=None, timeout=60, retry_timeout=0.2, *args, **kwargs):
-> 1178         url = zookeeper.getRandomURL(collection)
   1179 
   1180         super(SolrCloud, self).__init__(url, decoder=decoder, timeout=timeout, *args, **kwargs)

/usr/local/lib/python2.7/dist-packages/pysolr.pyc in getRandomURL(self, collname, only_leader)
   1315 
   1316     def getRandomURL(self, collname, only_leader=False):
-> 1317         hosts = self.getHosts(collname, only_leader=only_leader)
   1318         if not hosts:
   1319             raise SolrError('ZooKeeper returned no active shards!')

/usr/local/lib/python2.7/dist-packages/pysolr.pyc in getHosts(self, collname, only_leader, seen_aliases)
   1281         hosts = []
   1282         if collname not in self.collections:
-> 1283             raise SolrError("Unknown collection: %s", collname)
   1284         collection = self.collections[collname]
   1285         shards = collection[ZooKeeper.SHARDS]

SolrError: (u'Unknown collection: %s', 'random_collection')

Solr版本为6.6.2,Zookeeper版本为3.4.10

如何创建到solr云集合的连接?

ryoqjall

ryoqjall1#

Pysolr目前不支持外部zookeeper集群。Pysolr检查 clusterstate.json 中的集合,Solr已为每个集群临时设置了 state.json,并且 clusterstate.json 保持为空。
要解决单个集合的问题,您可以在www.example.com中对ZooKeeper.CLUSTER_STATE变量进行硬编码pysolr.py,如下所示:

ZooKeeper.CLUSTER_STATE = '/collections/random_collection/state.json'

pysolr.py 可以在 /usr/local/lib/python2.7/dist-packages 中找到,并且可以尝试使用

pip install -e /usr/local/lib/python2.7/dist-packages/pysolr.py
1wnzp6jl

1wnzp6jl2#

即使对于SolrCloud,常规HTTP客户端也能很好地工作。
使用Solr 7.5和PySolr 3.9.0对此进行了测试:

import pysolr

solr_url="https://my.solr.url"
collection = "my_collection"
solr_connection = pysolr.Solr("{}/solr/{}".format(solr_url, collection), timeout=10)
results = solr_connection.search(...)

print(results.docs)
xggvc2p6

xggvc2p63#

一个更好的方法是以一种通用的方式来填充这些集合:

import pysolr
import json

zookeeper = pysolr.ZooKeeper("ZK_STRING")
collections = {}
for c in zookeeper.zk.get_children("collections"):
    collections.update(json.loads(zookeeper.zk.get("collections/{}/state.json".format(c))[0].decode("ascii")))
zookeeper.collections = collections

相关问题