org.apache.hadoop.hdfs.server.namenode.LeaseExpiredException: org.apache.hadoop.hdfs.server.namenode
来源:互联网 发布:mac 压力测试 编辑:程序博客网 时间:2024/06/10 11:43
1.最近hbase的rgion经常挂掉一个,查看该节点日志发现如下错误:
2014-02-22 01:52:02,194 ERROR org.apache.Hadoop.hbase.regionserver.HRegionServer: Close and delete failed
org.apache.hadoop.hdfs.server.namenode.LeaseExpiredException: org.apache.hadoop.hdfs.server.namenode.LeaseExpiredException: No lease on /hbase/.logs/testhd3,60020,1392948100268/testhd3%2C60020%2C1392948100268.1393004989411 File does not exist. Holder DFSClient_hb_rs_testhd3,60020,1392948100268 does not have any open files.
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkLease(FSNamesystem.java:1631)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkLease(FSNamesystem.java:1622)
查了很长时间也没找到hbase的问题,后来根据网上资料查看了hadoop的日志如下:
2014-02-22 01:52:00,935 ERROR org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:hadoop cause:org.apache.hadoop.hdfs.server.namenode.LeaseExpiredException: No lease on /hbase/.logs/testhd3,60020,1392948100268/testhd3%2C60020%2C1392948100268.1393004989411 File does not exist. Holder DFSClient_hb_rs_testhd3,60020,1392948100268 does not have any open files.
2014-02-22 01:52:00,936 INFO org.apache.hadoop.ipc.Server: IPC Server handler 3 on 9000, call addBlock(/hbase/.logs/testhd3,60020,1392948100268/testhd3%2C60020%2C1392948100268.1393004989411, DFSClient_hb_rs_testhd3,60020,1392948100268, null) from 172.72.101.213:59979: error: org.apache.hadoop.hdfs.server.namenode.LeaseExpiredException: No lease on /hbase/.logs/testhd3,60020,1392948100268/testhd3%2C60020%2C1392948100268.1393004989411 File does not exist. Holder DFSClient_hb_rs_testhd3,60020,1392948100268 does not have any open files.
org.apache.hadoop.hdfs.server.namenode.LeaseExpiredException: No lease on /hbase/.logs/testhd3,60020,1392948100268/testhd3%2C60020%2C1392948100268.1393004989411 File does not exist. Holder DFSClient_hb_rs_testhd3,60020,1392948100268 does not have any open files.
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkLease(FSNamesystem.java:1631)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkLease(FSNamesystem.java:1622)
结果发现两个日志有几乎相同的记录,可以确认hbase的问题是由hadoop引起,修改如下:
解决办法,调整xcievers参数
默认是4096,改为8192
vi /home/dwhftp/opt/hadoop/conf/hdfs-site.xml
<property>
<name>dfs.datanode.max.xcievers</name>
<value>8192</value>
</property>
dfs.datanode.max.xcievers 参数说明
一个 Hadoop HDFS Datanode 有一个同时处理文件的上限. 这个参数叫 xcievers (Hadoop的作者把这个单词拼错了). 在你加载之前,先确认下你有没有配置这个文件conf/hdfs-site.xml里面的xceivers参数,至少要有4096:
<property>
<name>dfs.datanode.max.xcievers</name>
<value>4096</value>
</property>
- org.apache.hadoop.hdfs.server.namenode.LeaseExpiredException: org.apache.hadoop.hdfs.server.namenode
- HDFS超租约异常总结(org.apache.hadoop.hdfs.server.namenode.LeaseExpiredException)
- HDFS超租约异常总结(org.apache.hadoop.hdfs.server.namenode.LeaseExpiredException)
- HDFS超租约异常总结(org.apache.hadoop.hdfs.server.namenode.LeaseExpiredException)
- org.apache.hadoop.hdfs.server.namenode.NotReplicatedYetException
- org.apache.hadoop.hdfs.server.namenode.SafeModeException
- org.apache.hadoop.hdfs.server.namenode.SafeModeException
- org.apache.hadoop.hdfs.server.namenode.LeaseExpiredException: No leas e on
- org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot delete
- org.apache.hadoop.hdfs.server.namenode.safemode.exception
- org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot delete
- org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot delete
- Could not find the main class: org.apache.hadoop.hdfs.server.namenode.NameNode.解决方法
- 错误: 找不到或无法加载主类 org.apache.hadoop.hdfs.server.namenode.NameNode 问题解决
- 找不到或无法加载主类 org.apache.hadoop.hdfs.server.namenode.NameNode 问题解决
- hadoop分析之三org.apache.hadoop.hdfs.server.namenode各个类的功能与角色
- hadoop安全模式(rm: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot delete /sort. Name )
- Hadoop 故障问题 org.apache.hadoop.hdfs.server.namenode.DecommissionManager: Interrupted Monitor
- C/C++--strlen函数实现
- USACO--3.1Contact
- ios测试-(一)使用XCTest进行单元测试
- 在代码中实现Run Logic逻辑
- 远离glPushMatrix glLoadIdentity glPopMatrix
- org.apache.hadoop.hdfs.server.namenode.LeaseExpiredException: org.apache.hadoop.hdfs.server.namenode
- ADF 11g 界面多语言实现及切换
- L2---net_device---RX: 2层接收流程
- SVN Could not parse response status line解决
- uboot环境变量的实现和读取设置
- css基础
- Android Context 上下文 你必须知道的一切
- Java基础语法
- hdu 5204 Rikka with sequence(BestCoder Round #37)