tensorflow 已超过grpc最后期限部署tf-serving问题

voase2hg  于 2022-12-13  发布在  其他
关注(0)|答案(1)|浏览(211)

帮助我与tensorflow 模型部署部分。I“我遇到了与最后期限有关问题。

Exception in thread Thread-3:
stream1        | Traceback (most recent call last):
stream1        |   File "/usr/lib/python3.6/threading.py", line 916, in _bootstrap_inner
stream1        |     self.run()
stream1        |   File "/usr/lib/python3.6/threading.py", line 864, in run
stream1        |     self._target(*self._args, **self._kwargs)
stream1        |   File "/app/camAppTF2.py", line 270, in frames
stream1        |     boxes, pred_conf = do_inference(image=image_data)
stream1        |   File "/app/tensorflow_client.py", line 36, in do_inference
stream1        |     result = stub.Predict(pred_request, 10) # 10 secs timeout
stream1        |   File "/usr/local/lib/python3.6/dist-packages/grpc/_channel.py", line 826, in __call__
stream1        |     return _end_unary_response_blocking(state, call, False, None)
stream1        |   File "/usr/local/lib/python3.6/dist-packages/grpc/_channel.py", line 729, in _end_unary_response_blocking
stream1        |     raise _InactiveRpcError(state)
stream1        | grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
stream1        |        status = StatusCode.DEADLINE_EXCEEDED
stream1        |        details = "Deadline Exceeded"
stream1        |        debug_error_string = " {"created":"@1611235122.120446804","description":"Error received from peer ipv4:192.168.112.3:8500","file":"src/core/lib/surface/call.cc","file_line":1056,"grpc_message":"Deadline Exceeded","grpc_status":4}"

这是运行tensorflow服务时发生的错误

pqwbnv8z

pqwbnv8z1#

当tensorflow服务客户端无法与服务器通信时会发生这种情况。或者这也可能是由于网络错误造成的。如果您使用Docker托管您的tensorflow模型服务器,您需要按照下面提到的打开容器中的端口。您也可以延长默认时间,因为在某些情况下,模型服务器在请求到达之前就关闭了。谢谢!

docker run --name=tensorflow_container -p 9020:9020 -it $USER/tensorflow-serving-devel

相关问题