Chinaunix首页 | 论坛 | 博客
  • 博客访问: 723224
  • 博文数量: 259
  • 博客积分: 10
  • 博客等级: 民兵
  • 技术积分: 2518
  • 用 户 组: 普通用户
  • 注册时间: 2012-10-13 16:12
个人简介

科技改变世界,技术改变人生。

文章分类

全部博文(259)

分类: HADOOP

2016-01-20 10:46:13

hadoop节点服务器的一块硬盘出现物理故障,需要更换,将节点的服务停止,暂时不提供服务,将故障更换了,新盘格式化,

fdisk -l
新的2T盘为/dev/sde

parted -s /dev/sde mklabel gpt mkpart primary 0% 100%

格式化:
mkfs.ext4 /dev/sde1

挂载硬盘:
mount /dev/sde /data2

正常启动datanode服务,但是报错,如下:

"/var/log/hadoop/hdfs/hadoop-hdfs-datanode-dn61.100.cloud.log" 727814L, 246556758C
2016-01-20 09:55:57,892 WARN  datanode.DataNode (BPOfferService.java:getBlockPoolId(143)) - Block pool ID needed, but service not yet registered with NN
java.lang.Exception: trace
        at org.apache.hadoop.hdfs.server.datanode.BPOfferService.getBlockPoolId(BPOfferService.java:143)
        at org.apache.hadoop.hdfs.server.datanode.BlockPoolManager.remove(BlockPoolManager.java:91)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.shutdownBlockPool(DataNode.java:899)
        at org.apache.hadoop.hdfs.server.datanode.BPOfferService.shutdownActor(BPOfferService.java:350)
        at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.cleanUp(BPServiceActor.java:619)
        at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:837)
        at java.lang.Thread.run(Thread.java:745)
2016-01-20 09:55:57,892 INFO  datanode.DataNode (BlockPoolManager.java:remove(99)) - Removed Block pool (Datanode Uuid unassigned)
2016-01-20 09:55:57,892 WARN  datanode.DataNode (BPOfferService.java:getBlockPoolId(143)) - Block pool ID needed, but service not yet registered with NN
java.lang.Exception: trace
        at org.apache.hadoop.hdfs.server.datanode.BPOfferService.getBlockPoolId(BPOfferService.java:143)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.shutdownBlockPool(DataNode.java:901)
        at org.apache.hadoop.hdfs.server.datanode.BPOfferService.shutdownActor(BPOfferService.java:350)
        at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.cleanUp(BPServiceActor.java:619)
        at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:837)
        at java.lang.Thread.run(Thread.java:745)
2016-01-20 09:55:59,892 WARN  datanode.DataNode (DataNode.java:secureMain(2049)) - Exiting Datanode
2016-01-20 09:55:59,894 INFO  util.ExitUtil (ExitUtil.java:terminate(124)) - Exiting with status 0
2016-01-20 09:55:59,896 INFO  datanode.DataNode (StringUtils.java:run(640)) - SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down DataNode at dn61.100.cloud/172.16.8.72


解决方法:

发现权限不一样,正常的是755权限,有问题的是750,修改权限,chmod 755 -R /data2

异常的
[root@dn6 data2]# ll
drwxr-x--- 4 root root  4096 Jan 20 10:16 hadoop
drwx------ 2 root root 16384 Jan 19 15:38 lost+found

正常的
[root@dn6 data2]# ll
drwxr-xr-x 4 root root  4096 Jan 20 10:16 hadoop
drwx------ 2 root root 16384 Jan 19 15:38 lost+found

阅读(2432) | 评论(0) | 转发(0) |
给主人留下些什么吧!~~
评论热议
请登录后评论。

登录 注册