hbase ipc.rpcserver响应低问题和区域服务器关闭

g6baxovj  于 2021-05-29  发布在  Hadoop
关注(0)|答案(1)|浏览(808)

我已经用hadoop2.7.4配置了hbase 1.2.6。我在上面配置了nutch。以下是两个hbase站点属性

<property>
  <name>hbase.rpc.timeout</name>
  <value>1200000</value>
  <description>Changed to 20 minutes</description>
</property>

<property>
  <name>hbase.client.scanner.timeout.period</name>
  <value>1200000</value>
  <description>Changed to 10 minutes</description>
</property>

当我开始工作的时候。一段时间后,以下警告开始,区域服务器关闭。这就是为什么乔布斯也失败了。

2017-12-22 17:39:25,660 WARN  [B.defaultRpcServer.handler=18,queue=0,port=16020] ipc.RpcServer: (responseTooSlow): {"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","starttimems":1513946351644,"responsesize":8238,"method":"Scan","param":"scanner_id: 65 number_of_rows: 2147483647 close_scanner: false next_call_seq: 5 client_handles_partials: true client_handles_heartbeats: true track_scan_metrics: false renew: false","processingtimems":14015,"client":"10.11.21.42:36388","queuetimems":0,"class":"HRegionServer","scandetails":"table: use_webpage region: use_webpage,com.blogsky.shayan-pix:http/category/cat-2,1513328565609.09e0aff4d1e1d0e5733825c90f289be5."}
2017-12-22 17:39:37,626 WARN  [B.defaultRpcServer.handler=24,queue=0,port=16020] ipc.RpcServer: (responseTooSlow): {"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","starttimems":1513946357681,"responsesize":8654,"method":"Scan","param":"scanner_id: 64 number_of_rows: 2147483647 close_scanner: false next_call_seq: 5 client_handles_partials: true client_handles_heartbeats: true track_scan_metrics: false renew: false","processingtimems":19945,"client":"10.11.21.42:56252","queuetimems":0,"class":"HRegionServer","scandetails":"table: use_webpage region: use_webpage,ir.persianblog.gae6:http/,1509943454203.6992fa37fa94574aa4797b9ae64a296b."}
qfe3c7zg

qfe3c7zg1#

注意那个地区的位置。如果局部性较低,则对该特定区域进行区域压缩。如果这还不能解决这个问题,请对该表运行主压缩。您可以看到几乎所有区域的位置都变为1。这对我有用。

相关问题