http://blog.csdn.net/circyo/article/details/46724335
CentOS7.0安装配置hadoop2.7.0
资源准备
资源下载：
- hadoop-2.7.0.tar.gz密码：727y
- jdk-8u45-linux-x64.tar.gz密码：d8bm
- CentOS-7.0-1406-x86_64-DVD.iso密码：1a71
- virtual box for mac密码：h9ig
注意事项：
- 如果自己下载资源的话，注意hadoop,jdk,centos都应该是64位或者32位的，以免出现无法预料的错误，上面的资源都是64位的
- 我是在mac下配置的，virtual box是ios x系统的，如果是其它系统的另外寻找资源下载安装
linux 虚拟机配置
系统配置：
- 虚拟机：一个master(Master.Hadoop),两个slave(Slave1.Hadoop,Slave2.Hadoop)
- 网络设置：我使用的是桥接的方式，因为只是实验性安装，我没有设置静态ip
- 内存：每个虚拟机配置1024M内存
- 分区：自动
- 软件选择：最小安装，注意选择开发工具
- 用户设置：密码都设置为:hadoophadoop,不创建任何用户，操作时使用root直接进行
额外软件安装：
- centos7.0初始化时并没有ifconfig指令，需要使用下面两个指令进行安装：
<code class="hljs cmake has-numbering" style="display: block; padding: 0px; color: inherit; box-sizing: border-box; font-family: "Source Code Pro",monospace;font-size:undefined; white-space: pre; border-radius: 0px; word-wrap: normal; background: transparent;">yum search ifconfg yum <span class="hljs-keyword" style="color: rgb(0,136); box-sizing: border-box;">install</span> net-tools.x86_64</code><ul class="pre-numbering" style="box-sizing: border-box; position: absolute; width: 50px; top: 0px; left: 0px; margin: 0px; padding: 6px 0px 40px; border-right-width: 1px; border-right-style: solid; border-right-color: rgb(221,221,221); list-style: none; text-align: right; background-color: rgb(238,238,238);"><li style="box-sizing: border-box; padding: 0px 5px;">1</li><li style="box-sizing: border-box; padding: 0px 5px;">2</li></ul><ul class="pre-numbering" style="box-sizing: border-box; position: absolute; width: 50px; top: 0px; left: 0px; margin: 0px; padding: 6px 0px 40px; border-right-width: 1px; border-right-style: solid; border-right-color: rgb(221,238);"><li style="box-sizing: border-box; padding: 0px 5px;">1</li><li style="box-sizing: border-box; padding: 0px 5px;">2</li></ul>
完成其它两个虚拟机的安装：
- 两个slave的hostname可以改成Slave1.Hadoop,Slave2.Hadoop，方便区分
安装完后各个虚拟机的ip配置(参考用)
| 主机 | ip地址 |
|---|---|
| master.hadoop | 192.168.1.122 |
| slave1.hadoop | 192.168.1.125 |
| slave2.hadoop | 192.168.1.124 |
配置本地hosts
- 输入指令
<code class="hljs avrasm has-numbering" style="display: block; padding: 0px; color: inherit; box-sizing: border-box; font-family: "Source Code Pro",monospace;font-size:undefined; white-space: pre; border-radius: 0px; word-wrap: normal; background: transparent;">vi /etc/hosts // 将以下数据复制进入各个主机中 <span class="hljs-number" style="color: rgb(0,102,102); box-sizing: border-box;">192.168</span><span class="hljs-number" style="color: rgb(0,102); box-sizing: border-box;">.1</span><span class="hljs-number" style="color: rgb(0,102); box-sizing: border-box;">.122</span> Master<span class="hljs-preprocessor" style="color: rgb(68,68,68); box-sizing: border-box;">.Hadoop</span> <span class="hljs-number" style="color: rgb(0,102); box-sizing: border-box;">.125</span> Slave1<span class="hljs-preprocessor" style="color: rgb(68,102); box-sizing: border-box;">.124</span> Slave2<span class="hljs-preprocessor" style="color: rgb(68,68); box-sizing: border-box;">.Hadoop</span></code><ul class="pre-numbering" style="box-sizing: border-box; position: absolute; width: 50px; top: 0px; left: 0px; margin: 0px; padding: 6px 0px 40px; border-right-width: 1px; border-right-style: solid; border-right-color: rgb(221,238);"><li style="box-sizing: border-box; padding: 0px 5px;">1</li><li style="box-sizing: border-box; padding: 0px 5px;">2</li><li style="box-sizing: border-box; padding: 0px 5px;">3</li><li style="box-sizing: border-box; padding: 0px 5px;">4</li><li style="box-sizing: border-box; padding: 0px 5px;">5</li><li style="box-sizing: border-box; padding: 0px 5px;">6</li><li style="box-sizing: border-box; padding: 0px 5px;">7</li></ul><ul class="pre-numbering" style="box-sizing: border-box; position: absolute; width: 50px; top: 0px; left: 0px; margin: 0px; padding: 6px 0px 40px; border-right-width: 1px; border-right-style: solid; border-right-color: rgb(221,238);"><li style="box-sizing: border-box; padding: 0px 5px;">1</li><li style="box-sizing: border-box; padding: 0px 5px;">2</li><li style="box-sizing: border-box; padding: 0px 5px;">3</li><li style="box-sizing: border-box; padding: 0px 5px;">4</li><li style="box-sizing: border-box; padding: 0px 5px;">5</li><li style="box-sizing: border-box; padding: 0px 5px;">6</li><li style="box-sizing: border-box; padding: 0px 5px;">7</li></ul>
- 使用以下指令对master主机中进行测试，可使用类似指令在slave主机测试
配置Master无密码登录所有Salve
以下在Master主机上配置
- 输入以下指令生成ssh
<code class="hljs ruby has-numbering" style="display: block; padding: 0px; color: inherit; box-sizing: border-box; font-family: "Source Code Pro",monospace;font-size:undefined; white-space: pre; border-radius: 0px; word-wrap: normal; background: transparent;">ssh-keygen /<span class="hljs-regexp" style="color: rgb(0,136,0); box-sizing: border-box;">/ 会生成两个文件，放到默认的/root</span><span class="hljs-regexp" style="color: rgb(0,0); box-sizing: border-box;">/.ssh/</span>文件夹中</code><ul class="pre-numbering" style="box-sizing: border-box; position: absolute; width: 50px; top: 0px; left: 0px; margin: 0px; padding: 6px 0px 40px; border-right-width: 1px; border-right-style: solid; border-right-color: rgb(221,238);"><li style="box-sizing: border-box; padding: 0px 5px;">1</li><li style="box-sizing: border-box; padding: 0px 5px;">2</li><li style="box-sizing: border-box; padding: 0px 5px;">3</li></ul>
- 把id_rsa.pub追加到授权的key里面去
- 修改文件”authorized_keys”权限
- 设置SSH配置
<code class="hljs coffeescript has-numbering" style="display: block; padding: 0px; color: inherit; box-sizing: border-box; font-family: "Source Code Pro",monospace;font-size:undefined; white-space: pre; border-radius: 0px; word-wrap: normal; background: transparent;">vi /etc/ssh/sshd_config <span class="hljs-regexp" style="color: rgb(0,0); box-sizing: border-box;">//</span> 以下三项修改成以下配置 RSAAuthentication <span class="hljs-literal" style="color: rgb(0,102); box-sizing: border-box;">yes</span> <span class="hljs-comment" style="color: rgb(136,0); box-sizing: border-box;"># 启用 RSA 认证</span> PubkeyAuthentication <span class="hljs-literal" style="color: rgb(0,0); box-sizing: border-box;"># 启用公钥私钥配对认证方式</span> AuthorizedKeysFile .ssh/authorized_keys <span class="hljs-comment" style="color: rgb(136,0); box-sizing: border-box;"># 公钥文件路径（和上面生成的文件同）</span></code><ul class="pre-numbering" style="box-sizing: border-box; position: absolute; width: 50px; top: 0px; left: 0px; margin: 0px; padding: 6px 0px 40px; border-right-width: 1px; border-right-style: solid; border-right-color: rgb(221,238);"><li style="box-sizing: border-box; padding: 0px 5px;">1</li><li style="box-sizing: border-box; padding: 0px 5px;">2</li><li style="box-sizing: border-box; padding: 0px 5px;">3</li><li style="box-sizing: border-box; padding: 0px 5px;">4</li><li style="box-sizing: border-box; padding: 0px 5px;">5</li><li style="box-sizing: border-box; padding: 0px 5px;">6</li><li style="box-sizing: border-box; padding: 0px 5px;">7</li><li style="box-sizing: border-box; padding: 0px 5px;">8</li><li style="box-sizing: border-box; padding: 0px 5px;">9</li></ul><ul class="pre-numbering" style="box-sizing: border-box; position: absolute; width: 50px; top: 0px; left: 0px; margin: 0px; padding: 6px 0px 40px; border-right-width: 1px; border-right-style: solid; border-right-color: rgb(221,238);"><li style="box-sizing: border-box; padding: 0px 5px;">1</li><li style="box-sizing: border-box; padding: 0px 5px;">2</li><li style="box-sizing: border-box; padding: 0px 5px;">3</li><li style="box-sizing: border-box; padding: 0px 5px;">4</li><li style="box-sizing: border-box; padding: 0px 5px;">5</li><li style="box-sizing: border-box; padding: 0px 5px;">6</li><li style="box-sizing: border-box; padding: 0px 5px;">7</li><li style="box-sizing: border-box; padding: 0px 5px;">8</li><li style="box-sizing: border-box; padding: 0px 5px;">9</li></ul>
- 重启ssh服务
<code class="hljs has-numbering" style="display: block; padding: 0px; color: inherit; box-sizing: border-box; font-family: "Source Code Pro",monospace;font-size:undefined; white-space: pre; border-radius: 0px; word-wrap: normal; background: transparent;">service sshd restart</code><ul class="pre-numbering" style="box-sizing: border-box; position: absolute; width: 50px; top: 0px; left: 0px; margin: 0px; padding: 6px 0px 40px; border-right-width: 1px; border-right-style: solid; border-right-color: rgb(221,238);"><li style="box-sizing: border-box; padding: 0px 5px;">1</li></ul>
- 把公钥复制所有的Slave机器上
以下在Slave主机上配置
- 在slave主机上创建.ssh文件夹
- 追加到授权文件”authorized_keys”
<code class="hljs javascript has-numbering" style="display: block; padding: 0px; color: inherit; box-sizing: border-box; font-family: "Source Code Pro",monospace;font-size:undefined; white-space: pre; border-radius: 0px; word-wrap: normal; background: transparent;">cat ~<span class="hljs-regexp" style="color: rgb(0,0); box-sizing: border-box;">/id_rsa.pub >> ~/</span>.ssh/authorized_keys <span class="hljs-comment" style="color: rgb(136,0); box-sizing: border-box;">// 修改权限</span> chmod <span class="hljs-number" style="color: rgb(0,0); box-sizing: border-box;">/.ssh/</span>authorized_keys</code><ul class="pre-numbering" style="box-sizing: border-box; position: absolute; width: 50px; top: 0px; left: 0px; margin: 0px; padding: 6px 0px 40px; border-right-width: 1px; border-right-style: solid; border-right-color: rgb(221,238);"><li style="box-sizing: border-box; padding: 0px 5px;">1</li><li style="box-sizing: border-box; padding: 0px 5px;">2</li><li style="box-sizing: border-box; padding: 0px 5px;">3</li><li style="box-sizing: border-box; padding: 0px 5px;">4</li></ul>
- 删除无用.pub文件
<code class="hljs rust has-numbering" style="display: block; padding: 0px; color: inherit; box-sizing: border-box; font-family: "Source Code Pro",monospace;font-size:undefined; white-space: pre; border-radius: 0px; word-wrap: normal; background: transparent;">rm –r ~/id_rsa.<span class="hljs-keyword" style="color: rgb(0,136); box-sizing: border-box;">pub</span></code><ul class="pre-numbering" style="box-sizing: border-box; position: absolute; width: 50px; top: 0px; left: 0px; margin: 0px; padding: 6px 0px 40px; border-right-width: 1px; border-right-style: solid; border-right-color: rgb(221,238);"><li style="box-sizing: border-box; padding: 0px 5px;">1</li></ul>
在master主机下进行测试
<code class="hljs nginx has-numbering" style="display: block; padding: 0px; color: inherit; box-sizing: border-box; font-family: "Source Code Pro",monospace;font-size:undefined; white-space: pre; border-radius: 0px; word-wrap: normal; background: transparent;"><span class="hljs-title" style="box-sizing: border-box; color: rgb(0,136);">ssh</span> <span class="hljs-number" style="color: rgb(0,102); box-sizing: border-box;">192.168.1.125</span> ssh <span class="hljs-number" style="color: rgb(0,102); box-sizing: border-box;">192.168.1.124</span> // 如果能够分别无密码登陆slave1,slave2主机，则成功配置</code><ul class="pre-numbering" style="box-sizing: border-box; position: absolute; width: 50px; top: 0px; left: 0px; margin: 0px; padding: 6px 0px 40px; border-right-width: 1px; border-right-style: solid; border-right-color: rgb(221,238);"><li style="box-sizing: border-box; padding: 0px 5px;">1</li><li style="box-sizing: border-box; padding: 0px 5px;">2</li><li style="box-sizing: border-box; padding: 0px 5px;">3</li><li style="box-sizing: border-box; padding: 0px 5px;">4</li></ul>
进行jdk,hadoop软件安装
jdk安装：
- 在/usr下创建java文件夹
- 使用以下指令从真机传入jdk-8u45-linux-x64.tar.gz文件到虚拟主机中
- 使用以下指令进行加压
<code class="hljs lasso has-numbering" style="display: block; padding: 0px; color: inherit; box-sizing: border-box; font-family: "Source Code Pro",monospace;font-size:undefined; white-space: pre; border-radius: 0px; word-wrap: normal; background: transparent;">tar zxvf jdk<span class="hljs-subst" style="color: rgb(0,0); box-sizing: border-box;">-</span><span class="hljs-number" style="color: rgb(0,102); box-sizing: border-box;">8</span>u45<span class="hljs-attribute" style="box-sizing: border-box;">-linux</span><span class="hljs-attribute" style="box-sizing: border-box;">-x64</span><span class="hljs-built_in" style="color: rgb(102,102); box-sizing: border-box;">.</span>tar<span class="hljs-built_in" style="color: rgb(102,102); box-sizing: border-box;">.</span>gz <span class="hljs-comment" style="color: rgb(136,0); box-sizing: border-box;">// 解压后可以删除掉gz文件</span> rm jdk<span class="hljs-subst" style="color: rgb(0,102); box-sizing: border-box;">.</span>gz</code><ul class="pre-numbering" style="box-sizing: border-box; position: absolute; width: 50px; top: 0px; left: 0px; margin: 0px; padding: 6px 0px 40px; border-right-width: 1px; border-right-style: solid; border-right-color: rgb(221,238);"><li style="box-sizing: border-box; padding: 0px 5px;">1</li><li style="box-sizing: border-box; padding: 0px 5px;">2</li><li style="box-sizing: border-box; padding: 0px 5px;">3</li><li style="box-sizing: border-box; padding: 0px 5px;">4</li></ul>
- 配置jdk环境变量
- 添加Java环境变量
<code class="hljs bash has-numbering" style="display: block; padding: 0px; color: inherit; box-sizing: border-box; font-family: "Source Code Pro",monospace;font-size:undefined; white-space: pre; border-radius: 0px; word-wrap: normal; background: transparent;"> // 将以下数据复制到文件底部 <span class="hljs-keyword" style="color: rgb(0,136); box-sizing: border-box;">export</span> JAVA_HOME=/usr/java/jdk1.<span class="hljs-number" style="color: rgb(0,102); box-sizing: border-box;">8.0</span>_45 <span class="hljs-keyword" style="color: rgb(0,136); box-sizing: border-box;">export</span> JRE_HOME=/usr/java/jdk1.<span class="hljs-number" style="color: rgb(0,102); box-sizing: border-box;">8.0</span>_45/jre <span class="hljs-keyword" style="color: rgb(0,136); box-sizing: border-box;">export</span> CLASSPATH=.:<span class="hljs-variable" style="color: rgb(102,102); box-sizing: border-box;">$CLASSPATH</span>:<span class="hljs-variable" style="color: rgb(102,102); box-sizing: border-box;">$JAVA_HOME</span>/lib:<span class="hljs-variable" style="color: rgb(102,102); box-sizing: border-box;">$JRE_HOME</span>/lib <span class="hljs-keyword" style="color: rgb(0,136); box-sizing: border-box;">export</span> PATH=<span class="hljs-variable" style="color: rgb(102,102); box-sizing: border-box;">$PATH</span>:<span class="hljs-variable" style="color: rgb(102,102); box-sizing: border-box;">$JAVA_HOME</span>/bin:<span class="hljs-variable" style="color: rgb(102,102); box-sizing: border-box;">$JRE_HOME</span>/bin</code><ul class="pre-numbering" style="box-sizing: border-box; position: absolute; width: 50px; top: 0px; left: 0px; margin: 0px; padding: 6px 0px 40px; border-right-width: 1px; border-right-style: solid; border-right-color: rgb(221,238);"><li style="box-sizing: border-box; padding: 0px 5px;">1</li><li style="box-sizing: border-box; padding: 0px 5px;">2</li><li style="box-sizing: border-box; padding: 0px 5px;">3</li><li style="box-sizing: border-box; padding: 0px 5px;">4</li><li style="box-sizing: border-box; padding: 0px 5px;">5</li><li style="box-sizing: border-box; padding: 0px 5px;">6</li><li style="box-sizing: border-box; padding: 0px 5px;">7</li><li style="box-sizing: border-box; padding: 0px 5px;">8</li><li style="box-sizing: border-box; padding: 0px 5px;">9</li><li style="box-sizing: border-box; padding: 0px 5px;">10</li></ul><ul class="pre-numbering" style="box-sizing: border-box; position: absolute; width: 50px; top: 0px; left: 0px; margin: 0px; padding: 6px 0px 40px; border-right-width: 1px; border-right-style: solid; border-right-color: rgb(221,238);"><li style="box-sizing: border-box; padding: 0px 5px;">1</li><li style="box-sizing: border-box; padding: 0px 5px;">2</li><li style="box-sizing: border-box; padding: 0px 5px;">3</li><li style="box-sizing: border-box; padding: 0px 5px;">4</li><li style="box-sizing: border-box; padding: 0px 5px;">5</li><li style="box-sizing: border-box; padding: 0px 5px;">6</li><li style="box-sizing: border-box; padding: 0px 5px;">7</li><li style="box-sizing: border-box; padding: 0px 5px;">8</li><li style="box-sizing: border-box; padding: 0px 5px;">9</li><li style="box-sizing: border-box; padding: 0px 5px;">10</li></ul>
- 使配置生效
- 验证安装成功
Hadoop安装
- 使用以下指令将hadoop-2.7.0.tar.gz文件复制到/usr目录下
- 解压hadoop-2.7.0.tar.gz文件，并重命名
- 在”/usr/hadoop”下面创建tmp文件夹
- 把Hadoop的安装路径添加到”/etc/profile”中
- 重启”/etc/profile”
配置hadoop（先只在Master主机配置，配置完后传入两个Slave主机）
- 设置hadoop-env.sh和yarn-env.sh中的java环境变量
- 配置core-site.xml文件
<code class="hljs xml has-numbering" style="display: block; padding: 0px; color: inherit; box-sizing: border-box; font-family: "Source Code Pro",monospace;font-size:undefined; white-space: pre; border-radius: 0px; word-wrap: normal; background: transparent;">vi core-site.xml // 修改文件内容为以下 <span class="hljs-tag" style="color: rgb(0,102); box-sizing: border-box;"><<span class="hljs-title" style="box-sizing: border-box; color: rgb(0,136);">configuration</span>></span> <span class="hljs-tag" style="color: rgb(0,136);">property</span>></span> <span class="hljs-tag" style="color: rgb(0,136);">name</span>></span>hadoop.tmp.dir<span class="hljs-tag" style="color: rgb(0,102); box-sizing: border-box;"></<span class="hljs-title" style="box-sizing: border-box; color: rgb(0,136);">name</span>></span> <span class="hljs-tag" style="color: rgb(0,136);">value</span>></span>/usr/hadoop/tmp<span class="hljs-tag" style="color: rgb(0,136);">value</span>></span> <span class="hljs-tag" style="color: rgb(0,136);">description</span>></span>A base for other temporary directories.<span class="hljs-tag" style="color: rgb(0,136);">description</span>></span> <span class="hljs-tag" style="color: rgb(0,136);">name</span>></span>fs.default.name<span class="hljs-tag" style="color: rgb(0,136);">value</span>></span>hdfs://Master.Hadoop:9000<span class="hljs-tag" style="color: rgb(0,136);">value</span>></span> <span class="hljs-tag" style="color: rgb(0,136);">property</span>></span> <span class="hljs-tag" style="color: rgb(0,136);">configuration</span>></span></code><ul class="pre-numbering" style="box-sizing: border-box; position: absolute; width: 50px; top: 0px; left: 0px; margin: 0px; padding: 6px 0px 40px; border-right-width: 1px; border-right-style: solid; border-right-color: rgb(221,238);"><li style="box-sizing: border-box; padding: 0px 5px;">1</li><li style="box-sizing: border-box; padding: 0px 5px;">2</li><li style="box-sizing: border-box; padding: 0px 5px;">3</li><li style="box-sizing: border-box; padding: 0px 5px;">4</li><li style="box-sizing: border-box; padding: 0px 5px;">5</li><li style="box-sizing: border-box; padding: 0px 5px;">6</li><li style="box-sizing: border-box; padding: 0px 5px;">7</li><li style="box-sizing: border-box; padding: 0px 5px;">8</li><li style="box-sizing: border-box; padding: 0px 5px;">9</li><li style="box-sizing: border-box; padding: 0px 5px;">10</li><li style="box-sizing: border-box; padding: 0px 5px;">11</li><li style="box-sizing: border-box; padding: 0px 5px;">12</li><li style="box-sizing: border-box; padding: 0px 5px;">13</li><li style="box-sizing: border-box; padding: 0px 5px;">14</li><li style="box-sizing: border-box; padding: 0px 5px;">15</li><li style="box-sizing: border-box; padding: 0px 5px;">16</li><li style="box-sizing: border-box; padding: 0px 5px;">17</li><li style="box-sizing: border-box; padding: 0px 5px;">18</li><li style="box-sizing: border-box; padding: 0px 5px;">19</li><li style="box-sizing: border-box; padding: 0px 5px;">20</li><li style="box-sizing: border-box; padding: 0px 5px;">21</li><li style="box-sizing: border-box; padding: 0px 5px;">22</li><li style="box-sizing: border-box; padding: 0px 5px;">23</li></ul><ul class="pre-numbering" style="box-sizing: border-box; position: absolute; width: 50px; top: 0px; left: 0px; margin: 0px; padding: 6px 0px 40px; border-right-width: 1px; border-right-style: solid; border-right-color: rgb(221,238);"><li style="box-sizing: border-box; padding: 0px 5px;">1</li><li style="box-sizing: border-box; padding: 0px 5px;">2</li><li style="box-sizing: border-box; padding: 0px 5px;">3</li><li style="box-sizing: border-box; padding: 0px 5px;">4</li><li style="box-sizing: border-box; padding: 0px 5px;">5</li><li style="box-sizing: border-box; padding: 0px 5px;">6</li><li style="box-sizing: border-box; padding: 0px 5px;">7</li><li style="box-sizing: border-box; padding: 0px 5px;">8</li><li style="box-sizing: border-box; padding: 0px 5px;">9</li><li style="box-sizing: border-box; padding: 0px 5px;">10</li><li style="box-sizing: border-box; padding: 0px 5px;">11</li><li style="box-sizing: border-box; padding: 0px 5px;">12</li><li style="box-sizing: border-box; padding: 0px 5px;">13</li><li style="box-sizing: border-box; padding: 0px 5px;">14</li><li style="box-sizing: border-box; padding: 0px 5px;">15</li><li style="box-sizing: border-box; padding: 0px 5px;">16</li><li style="box-sizing: border-box; padding: 0px 5px;">17</li><li style="box-sizing: border-box; padding: 0px 5px;">18</li><li style="box-sizing: border-box; padding: 0px 5px;">19</li><li style="box-sizing: border-box; padding: 0px 5px;">20</li><li style="box-sizing: border-box; padding: 0px 5px;">21</li><li style="box-sizing: border-box; padding: 0px 5px;">22</li><li style="box-sizing: border-box; padding: 0px 5px;">23</li></ul>
- 配置hdfs-site.xml文件
- 配置mapred-site.xml文件
- 配置yarn-site.xml文件
配置Hadoop的集群
- 将Master中配置好的hadoop传入两个Slave中
- 修改Master主机上的slaves文件
- 格式化HDFS文件系统
<code class="hljs rsl has-numbering" style="display: block; padding: 0px; color: inherit; box-sizing: border-box; font-family: "Source Code Pro",monospace;font-size:undefined; white-space: pre; border-radius: 0px; word-wrap: normal; background: transparent;"><span class="hljs-comment" style="color: rgb(136,0); box-sizing: border-box;">// 在Master主机上输入以下指令</span> hadoop namenode -<span class="hljs-built_in" style="color: rgb(102,102); box-sizing: border-box;">format</span></code><ul class="pre-numbering" style="box-sizing: border-box; position: absolute; width: 50px; top: 0px; left: 0px; margin: 0px; padding: 6px 0px 40px; border-right-width: 1px; border-right-style: solid; border-right-color: rgb(221,238);"><li style="box-sizing: border-box; padding: 0px 5px;">1</li><li style="box-sizing: border-box; padding: 0px 5px;">2</li></ul>
- 启动hadoop
<code class="hljs http has-numbering" style="display: block; padding: 0px; color: inherit; box-sizing: border-box; font-family: "Source Code Pro",monospace;font-size:undefined; white-space: pre; border-radius: 0px; word-wrap: normal; background: transparent;"> <span class="avrasm" style="box-sizing: border-box;">// 关闭机器防火墙 service iptables stop cd /usr/hadoop/sbin ./start-all<span class="hljs-preprocessor" style="color: rgb(68,68); box-sizing: border-box;">.sh</span> // 更推荐的运行方式： cd /usr/hadoop/sbin ./start-dfs<span class="hljs-preprocessor" style="color: rgb(68,68); box-sizing: border-box;">.sh</span> ./start-yarn<span class="hljs-preprocessor" style="color: rgb(68,68); box-sizing: border-box;">.sh</span> 应该输出以下信息： Starting namenodes on [Master<span class="hljs-preprocessor" style="color: rgb(68,68); box-sizing: border-box;">.Hadoop</span>] <span class="hljs-label" style="box-sizing: border-box;">Master.Hadoop:</span> starting namenode,logging to /usr/hadoop/logs/hadoop-root-namenode-localhost<span class="hljs-preprocessor" style="color: rgb(68,68); box-sizing: border-box;">.localdomain</span><span class="hljs-preprocessor" style="color: rgb(68,68); box-sizing: border-box;">.out</span> <span class="hljs-label" style="box-sizing: border-box;">Slave2.Hadoop:</span> starting datanode,logging to /usr/hadoop/logs/hadoop-root-datanode-Slave2<span class="hljs-preprocessor" style="color: rgb(68,68); box-sizing: border-box;">.Hadoop</span><span class="hljs-preprocessor" style="color: rgb(68,68); box-sizing: border-box;">.out</span> <span class="hljs-label" style="box-sizing: border-box;">Slave1.Hadoop:</span> starting datanode,logging to /usr/hadoop/logs/hadoop-root-datanode-Slave1<span class="hljs-preprocessor" style="color: rgb(68,68); box-sizing: border-box;">.out</span> starting yarn daemons starting resourcemanager,logging to /usr/hadoop/logs/yarn-root-resourcemanager-localhost<span class="hljs-preprocessor" style="color: rgb(68,68); box-sizing: border-box;">.out</span> <span class="hljs-label" style="box-sizing: border-box;">Slave1.Hadoop:</span> starting nodemanager,logging to /usr/hadoop/logs/yarn-root-nodemanager-Slave1<span class="hljs-preprocessor" style="color: rgb(68,68); box-sizing: border-box;">.out</span> <span class="hljs-label" style="box-sizing: border-box;">Slave2.Hadoop:</span> starting nodemanager,logging to /usr/hadoop/logs/yarn-root-nodemanager-Slave2<span class="hljs-preprocessor" style="color: rgb(68,68); box-sizing: border-box;">.out</span> </span></code><ul class="pre-numbering" style="box-sizing: border-box; position: absolute; width: 50px; top: 0px; left: 0px; margin: 0px; padding: 6px 0px 40px; border-right-width: 1px; border-right-style: solid; border-right-color: rgb(221,238);"><li style="box-sizing: border-box; padding: 0px 5px;">1</li><li style="box-sizing: border-box; padding: 0px 5px;">2</li><li style="box-sizing: border-box; padding: 0px 5px;">3</li><li style="box-sizing: border-box; padding: 0px 5px;">4</li><li style="box-sizing: border-box; padding: 0px 5px;">5</li><li style="box-sizing: border-box; padding: 0px 5px;">6</li><li style="box-sizing: border-box; padding: 0px 5px;">7</li><li style="box-sizing: border-box; padding: 0px 5px;">8</li><li style="box-sizing: border-box; padding: 0px 5px;">9</li><li style="box-sizing: border-box; padding: 0px 5px;">10</li><li style="box-sizing: border-box; padding: 0px 5px;">11</li><li style="box-sizing: border-box; padding: 0px 5px;">12</li><li style="box-sizing: border-box; padding: 0px 5px;">13</li><li style="box-sizing: border-box; padding: 0px 5px;">14</li><li style="box-sizing: border-box; padding: 0px 5px;">15</li><li style="box-sizing: border-box; padding: 0px 5px;">16</li><li style="box-sizing: border-box; padding: 0px 5px;">17</li><li style="box-sizing: border-box; padding: 0px 5px;">18</li><li style="box-sizing: border-box; padding: 0px 5px;">19</li><li style="box-sizing: border-box; padding: 0px 5px;">20</li><li style="box-sizing: border-box; padding: 0px 5px;">21</li><li style="box-sizing: border-box; padding: 0px 5px;">22</li><li style="box-sizing: border-box; padding: 0px 5px;">23</li><li style="box-sizing: border-box; padding: 0px 5px;">24</li><li style="box-sizing: border-box; padding: 0px 5px;">25</li></ul><ul class="pre-numbering" style="box-sizing: border-box; position: absolute; width: 50px; top: 0px; left: 0px; margin: 0px; padding: 6px 0px 40px; border-right-width: 1px; border-right-style: solid; border-right-color: rgb(221,238);"><li style="box-sizing: border-box; padding: 0px 5px;">1</li><li style="box-sizing: border-box; padding: 0px 5px;">2</li><li style="box-sizing: border-box; padding: 0px 5px;">3</li><li style="box-sizing: border-box; padding: 0px 5px;">4</li><li style="box-sizing: border-box; padding: 0px 5px;">5</li><li style="box-sizing: border-box; padding: 0px 5px;">6</li><li style="box-sizing: border-box; padding: 0px 5px;">7</li><li style="box-sizing: border-box; padding: 0px 5px;">8</li><li style="box-sizing: border-box; padding: 0px 5px;">9</li><li style="box-sizing: border-box; padding: 0px 5px;">10</li><li style="box-sizing: border-box; padding: 0px 5px;">11</li><li style="box-sizing: border-box; padding: 0px 5px;">12</li><li style="box-sizing: border-box; padding: 0px 5px;">13</li><li style="box-sizing: border-box; padding: 0px 5px;">14</li><li style="box-sizing: border-box; padding: 0px 5px;">15</li><li style="box-sizing: border-box; padding: 0px 5px;">16</li><li style="box-sizing: border-box; padding: 0px 5px;">17</li><li style="box-sizing: border-box; padding: 0px 5px;">18</li><li style="box-sizing: border-box; padding: 0px 5px;">19</li><li style="box-sizing: border-box; padding: 0px 5px;">20</li><li style="box-sizing: border-box; padding: 0px 5px;">21</li><li style="box-sizing: border-box; padding: 0px 5px;">22</li><li style="box-sizing: border-box; padding: 0px 5px;">23</li><li style="box-sizing: border-box; padding: 0px 5px;">24</li><li style="box-sizing: border-box; padding: 0px 5px;">25</li></ul>
- 验证hadoop
- 访问网页
<code class="hljs cs has-numbering" style="display: block; padding: 0px; color: inherit; box-sizing: border-box; font-family: "Source Code Pro",0); box-sizing: border-box;">// CentOS7中iptables这个服务的配置文件没有了，采用了新的firewalld</span> <span class="hljs-comment" style="color: rgb(136,0); box-sizing: border-box;">// 输入以下指令后，可以在真机浏览器上访问hadoop网页</span> systemctl stop firewalld <span class="hljs-comment" style="color: rgb(136,0); box-sizing: border-box;">// 输入以下网页，进入hadoop管理首页</span> http:<span class="hljs-comment" style="color: rgb(136,0); box-sizing: border-box;">//192.168.1.122:50070/dfshealth.html#tab-overview</span> </code><ul class="pre-numbering" style="box-sizing: border-box; position: absolute; width: 50px; top: 0px; left: 0px; margin: 0px; padding: 6px 0px 40px; border-right-width: 1px; border-right-style: solid; border-right-color: rgb(221,238);"><li style="box-sizing: border-box; padding: 0px 5px;">1</li><li style="box-sizing: border-box; padding: 0px 5px;">2</li><li style="box-sizing: border-box; padding: 0px 5px;">3</li><li style="box-sizing: border-box; padding: 0px 5px;">4</li><li style="box-sizing: border-box; padding: 0px 5px;">5</li><li style="box-sizing: border-box; padding: 0px 5px;">6</li><li style="box-sizing: border-box; padding: 0px 5px;">7</li></ul>
参考资料
- 在CentOS上安装Hadoop 2.x 集群
- centos安装配置hadoop超详细过程
- Centos下安装hadoop并与Eclipse连接
- Hadoop集群（第5期）_Hadoop安装配置
- 【分享】VirtualBox下安装CentOS 7 【图文教程】
- centos7没有安装ifconfig命令的解决方法
- [CentOS]安装软件：/lib/ld-linux.so.2: bad ELF interpreter解决
- CentOS6.4配置Hadoop-2.6.0集群配置安装指南(经过实战演练)【张振华.Jack】
- Hadoop “Unable to load native-hadoop library for your platform” error on CentOS
- CentOS静态IP修改网卡配置文件
- CentOS 6.5 配置hadoop 2.6.0伪分布式
- How can i use iptables on centos 7?
版权声明：本文内容由互联网用户自发贡献，该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务，不拥有所有权，不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容， 请发送邮件至 dio@foxmail.com 举报，一经查实，本站将立刻删除。