hadoop实践（一）建虚拟机，安装软件

1. 使用vmware新建虚拟机（略）

2. 制作模板机（CentOS7）

1. 配置固定IP、主机名和主机名映射

1）查看vmware网络配置

图1

图2

2）配置固定IP

[root@hadoop000 ~]# ip addr
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: ens33: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP group default qlen 1000
    link/ether 00:0c:29:e0:c6:2e brd ff:ff:ff:ff:ff:ff
    inet 192.168.160.101/24 brd 192.168.160.255 scope global noprefixroute ens33
       valid_lft forever preferred_lft forever
    inet6 fe80::e3ec:642d:9c7d:949f/64 scope link noprefixroute 
       valid_lft forever preferred_lft forever

[root@hadoop000 ~]# vi /etc/sysconfig/network-scripts/ifcfg-ens33
TYPE=Ethernet
PROXY_METHOD=none
BROWSER_ONLY=no
BOOTPROTO=static
DEFROUTE=yes
IPV4_FAILURE_FATAL=no
IPV6INIT=yes
IPV6_AUTOCONF=yes
IPV6_DEFROUTE=yes
IPV6_FAILURE_FATAL=no
IPV6_ADDR_GEN_MODE=stable-privacy
NAME=ens33
UUID=5830c437-39f3-4598-8566-0e6a36f34f23
DEVICE=ens33
ONBOOT=yes
IPADDR=192.168.160.101
NETMASK=255.255.255.0
GATEWAY=192.168.160.2
DNS1=192.168.160.2

3）配置主机名

[root@hadoop000 ~]# vi /etc/hostname

4）配置主机名映射

[root@hadoop000 ~]# vi /etc/hosts

5）关闭防火墙

[root@hadoop000 ~]# systemctl stop firewalld.service
[root@hadoop000 ~]# sudo systemctl disable firewalld.service

6）新建和配置hadoop用户

[root@hadoop000 ~]# # 新建hadoop用户
[root@hadoop000 ~]# useradd hadoop
[root@hadoop000 ~]# passwd hadoop
[root@hadoop000 ~]# #配置sudo权限
[root@hadoop000 ~]# visudo
## Allow root to run any commands anywhere
root    ALL=(ALL)       ALL
## Allows members of the 'sys' group to run networking, software,
## service management apps and more.
# %sys ALL = NETWORKING, SOFTWARE, SERVICES, STORAGE, DELEGATING, PROCESSES, LOCATE, DRIVERS

## Allows people in group wheel to run all commands
%wheel  ALL=(ALL)       ALL
hadoop  ALL=(ALL)       ALL

## Same thing without a password
# %wheel        ALL=(ALL)       NOPASSWD: ALL
hadoop  ALL=(ALL)       NOPASSWD: ALL

2.安装软件

1）安装网络工具

yum install -y net-tools

2）安装vim

yum install -y vim

3）安装jdk
下载地址：http://www.oracle.com/technetwork/java/javase/archive-139210.html

[hadoop@hadoop01 soft]$ tar -zxvf /opt/soft/jdk-8u212-linux-x64.tar.gz -C /opt/module/
[hadoop@hadoop01 profile.d]$ cd /etc/profile.d
[hadoop@hadoop01 profile.d]$ vim my_env.sh
#JAVA
export JAVA_HOME=/opt/module/jdk1.8.0_212
export PATH=$PATH:$JAVA_HOME/bin

4）安装hadoop
下载地址：https://archive.apache.org/dist/hadoop/common/hadoop-3.1.3/

[hadoop@hadoop01 soft]$ tar -zxvf /opt/soft/hadoop-3.1.3.tar.gz -C /opt/module/
[hadoop@hadoop01 hadoop-3.1.3]$ vim /etc/profile.d/my_env.sh
$HADOOP
export HADOOP_HOME=/opt/module/hadoop-3.1.3
export PATH=$PATH:$HADOOP_HOME/bin:$HADOOP_HOME/sbin
[hadoop@hadoop01 hadoop-3.1.3]$ source /etc/profile
[hadoop@hadoop01 hadoop-3.1.3]$ #测试mapreduce
[hadoop@hadoop01 hadoop-3.1.3]$ hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-3.1.3.jar wordcount share/doc/hadoop/index.html wcoutput

5） 安装rsync

yum -y install rsync

3.另外两台虚拟机

1.复制

图片3

2.修改IP配置、主机名等

3.配置免密登陆

[hadoop@hadoop01 ~]$ ssh-keygen
[hadoop@hadoop01 ~]$ ssh-copy-id hadoop01