CDH集群安装详细步骤——CM安装

本文记录的是笔者在CentOS上安装CM的过程,后续通过CM的监控页面安装部署CDH集群非常方便;由于安装的时候管理员只安装了操作系统,很多东西都没有,根据个人情况,可以酌情跳过。笔者使用的用户具有sudo权限,建议大家使用root用户进行安装。另外:安装时使用的机器是可以访问公网的,因此没有下载CDH的parcel包。
1、查看是否安装java

[user@node1 ~]$ java -version
-bash: java: command not found

说明没有安装过jdk,通过yum安装jdk

[user@node1 ~]$ sudo yum install -y java-1.8.0-openjdk.x86_64

2、安装mysql

  • 查看是否有安装过旧的msyql,有的话需要进行卸载,我这里没有装过msyql,如果大家已经安装过mysql,可以直接跳过此步骤,但是后面涉及到一些登录方面的权限,需要设置好。
[user@node1 ~]$ rpm -qa|grep -i mysql
  • 建立所需目录
[user@node1 ~]$ sudo mkdir -p /data1/mysql/data
  • 下载yum源安装包
[user@node1 ~]$ wget http://dev.mysql.com/get/mysql57-community-release-el7-8.noarch.rpm
--2019-03-15 11:23:47--  http://dev.mysql.com/get/mysql57-community-release-el7-8.noarch.rpm
Resolving dev.mysql.com (dev.mysql.com)... 137.254.60.11
Connecting to dev.mysql.com (dev.mysql.com)|137.254.60.11|:80... connected.
HTTP request sent, awaiting response... 301 Moved Permanently
Location: https://dev.mysql.com/get/mysql57-community-release-el7-8.noarch.rpm [following]
--2019-03-15 11:23:47--  https://dev.mysql.com/get/mysql57-community-release-el7-8.noarch.rpm
Connecting to dev.mysql.com (dev.mysql.com)|137.254.60.11|:443... connected.
HTTP request sent, awaiting response... 302 Found
Location: https://repo.mysql.com//mysql57-community-release-el7-8.noarch.rpm [following]
--2019-03-15 11:23:49--  https://repo.mysql.com//mysql57-community-release-el7-8.noarch.rpm
Resolving repo.mysql.com (repo.mysql.com)... 2.19.60.91
Connecting to repo.mysql.com (repo.mysql.com)|2.19.60.91|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 9116 (8.9K) [application/x-redhat-package-manager]
Saving to: ‘mysql57-community-release-el7-8.noarch.rpm’


100%[===================================================================================================================================================>] 9,116       --.-K/s   in 0.03s   


2019-03-15 11:23:49 (287 KB/s) - ‘mysql57-community-release-el7-8.noarch.rpm’ saved [9116/9116]

[user@node1 ~]$
  • 安装yum源
[user@node1 ~]$ sudo yum -y localinstall mysql57-community-release-el7-8.noarch.rpm
Loaded plugins: fastestmirror, langpacks
Examining mysql57-community-release-el7-8.noarch.rpm: mysql57-community-release-el7-8.noarch
Marking mysql57-community-release-el7-8.noarch.rpm to be installed
Resolving Dependencies
--> Running transaction check
---> Package mysql57-community-release.noarch 0:el7-8 will be installed
--> Finished Dependency Resolution


Dependencies Resolved


=============================================================================================================================================================================================
Package                                            Arch                            Version                           Repository                                                        Size
=============================================================================================================================================================================================
Installing:
mysql57-community-release                          noarch                          el7-8                             /mysql57-community-release-el7-8.noarch                          8.2 k


Transaction Summary
=============================================================================================================================================================================================
Install  1 Package


Total size: 8.2 k
Installed size: 8.2 k
Downloading packages:
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Installing : mysql57-community-release-el7-8.noarch                                                                                                                                    1/1
  Verifying  : mysql57-community-release-el7-8.noarch                                                                                                                                    1/1


Installed:
  mysql57-community-release.noarch 0:el7-8                                                                                                                                                   


Complete!
[user@node1 ~]$
  • 检查yum源安装是否成功,如下说明已经安装成功。
[user@node1 ~]$ yum repolist enabled | grep "mysql.*-community.*"
mysql-connectors-community/x86_64       MySQL Connectors Community           95
mysql-tools-community/x86_64            MySQL Tools Community                84
mysql57-community/x86_64                MySQL 5.7 Community Server          327
[user@node1 ~]$
  • 修改/etc/yum.repos.d/mysql-community.repo,选择默认安装的版本,我这里安装的就是5.7的版本,如果想要安装5.6的版本,只需要把对应的enabled 改为1,其余版本下的enabled改为0即可。
    [user@node1 ~]$ sudo vi /etc/yum.repos.d/mysql-community.repo
[mysql-connectors-community]
name=MySQL Connectors Community
baseurl=http://repo.mysql.com/yum/mysql-connectors-community/el/7/$basearch/
enabled=1
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-mysql


[mysql-tools-community]
name=MySQL Tools Community
baseurl=http://repo.mysql.com/yum/mysql-tools-community/el/7/$basearch/
enabled=1
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-mysql


# Enable to use MySQL 5.5
[mysql55-community]
name=MySQL 5.5 Community Server
baseurl=http://repo.mysql.com/yum/mysql-5.5-community/el/7/$basearch/
enabled=0
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-mysql


# Enable to use MySQL 5.6
[mysql56-community]
name=MySQL 5.6 Community Server
baseurl=http://repo.mysql.com/yum/mysql-5.6-community/el/7/$basearch/
enabled=0
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-mysql


[mysql57-community]
name=MySQL 5.7 Community Server
baseurl=http://repo.mysql.com/yum/mysql-5.7-community/el/7/$basearch/
enabled=1    #这里默认安装的就是5.7版本,不需要修改
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-mysql


[mysql-tools-preview]
name=MySQL Tools Preview
baseurl=http://repo.mysql.com/yum/mysql-tools-preview/el/7/$basearch/
enabled=0
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-mysql
  • 通过Yum安装msyql
[user@node1 ~]$ sudo yum -y install mysql-community-server
Loaded plugins: fastestmirror, langpacks
Loading mirror speeds from cached hostfile
Resolving Dependencies
--> Running transaction check
---> Package mysql-community-server.x86_64 0:5.7.25-1.el7 will be installed
--> Processing Dependency: mysql-community-common(x86-64) = 5.7.25-1.el7 for package: mysql-community-server-5.7.25-1.el7.x86_64
--> Processing Dependency: mysql-community-client(x86-64) >= 5.7.9 for package: mysql-community-server-5.7.25-1.el7.x86_64
--> Running transaction check
---> Package mysql-community-client.x86_64 0:5.7.25-1.el7 will be installed
--> Processing Dependency: mysql-community-libs(x86-64) >= 5.7.9 for package: mysql-community-client-5.7.25-1.el7.x86_64
---> Package mysql-community-common.x86_64 0:5.7.25-1.el7 will be installed
--> Running transaction check
---> Package mariadb-libs.x86_64 1:5.5.56-2.el7 will be obsoleted
--> Processing Dependency: libmysqlclient.so.18()(64bit) for package: 1:net-snmp-5.7.2-28.el7.x86_64
--> Processing Dependency: libmysqlclient.so.18()(64bit) for package: 2:postfix-2.10.1-6.el7.x86_64
--> Processing Dependency: libmysqlclient.so.18(libmysqlclient_18)(64bit) for package: 2:postfix-2.10.1-6.el7.x86_64
---> Package mysql-community-libs.x86_64 0:5.7.25-1.el7 will be obsoleting
--> Running transaction check
---> Package mysql-community-libs-compat.x86_64 0:5.7.25-1.el7 will be obsoleting
--> Finished Dependency Resolution


Dependencies Resolved


=============================================================================================================================================================================================
Package                                                  Arch                                Version                                   Repository                                      Size
=============================================================================================================================================================================================
Installing:
mysql-community-libs                                     x86_64                              5.7.25-1.el7                              mysql57-community                              2.2 M
     replacing  mariadb-libs.x86_64 1:5.5.56-2.el7
mysql-community-libs-compat                              x86_64                              5.7.25-1.el7                              mysql57-community                              2.0 M
     replacing  mariadb-libs.x86_64 1:5.5.56-2.el7
mysql-community-server                                   x86_64                              5.7.25-1.el7                              mysql57-community                              165 M
Installing for dependencies:
mysql-community-client                                   x86_64                              5.7.25-1.el7                              mysql57-community                               24 M
mysql-community-common                                   x86_64                              5.7.25-1.el7                              mysql57-community                              274 k


Transaction Summary
=============================================================================================================================================================================================
Install  3 Packages (+2 Dependent packages)


Total download size: 194 M
Downloading packages:
warning: /var/cache/yum/x86_64/7/mysql57-community/packages/mysql-community-common-5.7.25-1.el7.x86_64.rpm: Header V3 DSA/SHA1 Signature, key ID 5072e1f5: NOKEY kB/s | 276 kB  00:10:29 ETA
Public key for mysql-community-common-5.7.25-1.el7.x86_64.rpm is not installed
(1/5): mysql-community-common-5.7.25-1.el7.x86_64.rpm                                                                                                                 | 274 kB  00:00:01     
(2/5): mysql-community-libs-5.7.25-1.el7.x86_64.rpm                                                                                                                   | 2.2 MB  00:00:06     
(3/5): mysql-community-libs-compat-5.7.25-1.el7.x86_64.rpm                                                                                                            | 2.0 MB  00:00:05     
(4/5): mysql-community-client-5.7.25-1.el7.x86_64.rpm                                                                                                                 |  24 MB  00:00:38     
(5/5): mysql-community-server-5.7.25-1.el7.x86_64.rpm                                                                                                                 | 165 MB  00:03:39     
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Total                                                                                                                                                        853 kB/s | 194 MB  00:03:52     
Retrieving key from file:///etc/pki/rpm-gpg/RPM-GPG-KEY-mysql
Importing GPG key 0x5072E1F5:
Userid     : "MySQL Release Engineering <mysql-build@oss.oracle.com>"
Fingerprint: a4a9 4068 76fc bd3c 4567 70c8 8c71 8d3b 5072 e1f5
Package    : mysql57-community-release-el7-8.noarch (installed)
From       : /etc/pki/rpm-gpg/RPM-GPG-KEY-mysql
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Installing : mysql-community-common-5.7.25-1.el7.x86_64                                                                                                                                1/6
  Installing : mysql-community-libs-5.7.25-1.el7.x86_64                                                                                                                                  2/6
  Installing : mysql-community-client-5.7.25-1.el7.x86_64                                                                                                                                3/6
  Installing : mysql-community-server-5.7.25-1.el7.x86_64                                                                                                                                4/6
warning: /etc/my.cnf created as /etc/my.cnf.rpmnew
  Installing : mysql-community-libs-compat-5.7.25-1.el7.x86_64                                                                                                                           5/6
  Erasing    : 1:mariadb-libs-5.5.56-2.el7.x86_64                                                                                                                                        6/6
  Verifying  : mysql-community-libs-5.7.25-1.el7.x86_64                                                                                                                                  1/6
  Verifying  : mysql-community-common-5.7.25-1.el7.x86_64                                                                                                                                2/6
  Verifying  : mysql-community-server-5.7.25-1.el7.x86_64                                                                                                                                3/6
  Verifying  : mysql-community-client-5.7.25-1.el7.x86_64                                                                                                                                4/6
  Verifying  : mysql-community-libs-compat-5.7.25-1.el7.x86_64                                                                                                                           5/6
  Verifying  : 1:mariadb-libs-5.5.56-2.el7.x86_64                                                                                                                                        6/6


Installed:
  mysql-community-libs.x86_64 0:5.7.25-1.el7                 mysql-community-libs-compat.x86_64 0:5.7.25-1.el7                 mysql-community-server.x86_64 0:5.7.25-1.el7                


Dependency Installed:
  mysql-community-client.x86_64 0:5.7.25-1.el7                                                  mysql-community-common.x86_64 0:5.7.25-1.el7                                                 


Replaced:
  mariadb-libs.x86_64 1:5.5.56-2.el7                                                                                                                                                         


Complete!
  • 启动mysql,并查看状态
[user@node1 ~]$ sudo systemctl start mysqld
[user@node1 ~]$ systemctl status mysqld
● mysqld.service - MySQL Server
   Loaded: loaded (/usr/lib/systemd/system/mysqld.service; enabled; vendor preset: disabled)
   Active: active (running) since Fri 2019-03-15 11:39:54 CST; 40s ago
     Docs: man:mysqld(8)
           http://dev.mysql.com/doc/refman/en/using-systemd.html
  Process: 25317 ExecStart=/usr/sbin/mysqld --daemonize --pid-file=/var/run/mysqld/mysqld.pid $MYSQLD_OPTS (code=exited, status=0/SUCCESS)
  Process: 25241 ExecStartPre=/usr/bin/mysqld_pre_systemd (code=exited, status=0/SUCCESS)
Main PID: 25321 (mysqld)
   CGroup: /system.slice/mysqld.service
           └─25321 /usr/sbin/mysqld --daemonize --pid-file=/var/run/mysqld/mysqld.pid
  • 设置开机启动
[user@node1 ~]$ sudo systemctl enable mysqld
[user@node1 ~]$ sudo systemctl daemon-reload
  • 查看/var/log/mysqld.log是否有默认随机密码,我的centos7.5 安装5.7的mysql,这个命令不管用
    [user@node1 ~]$ sudo grep 'temporary password' /var/log/mysqld.log
    上面的这步不管用,通过另一种方式修改密码,首先设置免密登录:添加skip-grant-tables
[user@node1 ~]$ sudo vi /etc/my.cnf


[mysqld]
datadir=/data1/mysql/data
socket=/var/lib/mysql/mysql.sock
# Disabling symbolic-links is recommended to prevent assorted security risks
symbolic-links=0
# Settings user and group are ignored when systemd is used.
# If you need to run mysqld under a different user or group,
# customize your systemd unit file for mariadb according to the
# instructions in http://fedoraproject.org/wiki/Systemd
skip-grant-tables   #加上这句
[mysqld_safe]
log-error=/var/log/mariadb/mariadb.log
pid-file=/var/run/mariadb/mariadb.pid


#
# include all files from the config directory
#
!includedir /etc/my.cnf.d

重启使配置生效。
[user@node1 ~]$ sudo systemctl restart mysqld

  • 修改root用户默认密码,在skip-grant-tables模式下无法进行用户的相关配置,只能用update语句。
[user@node1 log]$ mysql -uroot
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 3
Server version: 5.7.25 MySQL Community Server (GPL)


Copyright (c) 2000, 2019, Oracle and/or its affiliates. All rights reserved.


Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.


Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.


mysql> use mysql
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A


Database changed
mysql> update user set authentication_string=password('Abc_2019') where user='root';          
Query OK, 1 row affected, 1 warning (0.00 sec)
Rows matched: 1  Changed: 1  Warnings: 1
  • 删除skip-grant-tables配置,重启数据库,验证root用户密码:
[user@node1 log]$ sudo vi /etc/my.cnf


[mysqld]
datadir=/data1/mysql/data
socket=/var/lib/mysql/mysql.sock
# Disabling symbolic-links is recommended to prevent assorted security risks
symbolic-links=0
# Settings user and group are ignored when systemd is used.
# If you need to run mysqld under a different user or group,
# customize your systemd unit file for mariadb according to the
# instructions in http://fedoraproject.org/wiki/Systemd
#skip-grant-tables
[mysqld_safe]
log-error=/var/log/mariadb/mariadb.log
pid-file=/var/run/mariadb/mariadb.pid


#
# include all files from the config directory
#
!includedir /etc/my.cnf.d
[user@node1 log]$ sudo systemctl restart mysqld
[user@node1 log]$ mysql -uroot -pAbc_2019
mysql: [Warning] Using a password on the command line interface can be insecure.
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 2
Server version: 5.7.25


Copyright (c) 2000, 2019, Oracle and/or its affiliates. All rights reserved.


Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.


Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

mysql> ALTER USER 'root'@'localhost' IDENTIFIED BY 'Abc_2019';
  • 至此,root用户密码已经修改成功,接下来添加mysql用户(根据需要,如果后续用到其他用户,可以按照此方式进行添加及赋权),并设置远程访问权限(%的主机IP中并不包含localhost,所以需要单独赋权):
mysql> use mysql;
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A


Database changed
mysql> GRANT ALL ON *.* TO mysql@'%' IDENTIFIED BY 'Abc_2019' WITH GRANT OPTION;           
Query OK, 0 rows affected, 1 warning (0.00 sec)


mysql> GRANT ALL ON *.* TO mysql@'localhost' IDENTIFIED BY 'Abc_2019' WITH GRANT OPTION;
Query OK, 0 rows affected, 1 warning (0.00 sec)


mysql>
  • 在其他主机上尝试用msyql用户远程访问,发现访问不了,查看主机的防火墙,发现防火墙开启了,关闭后可以正常访问
[user@node1 my.cnf.d]$ service iptables status
Redirecting to /bin/systemctl status iptables.service
● iptables.service - IPv4 firewall with iptables
   Loaded: loaded (/usr/lib/systemd/system/iptables.service; enabled; vendor preset: disabled)
   Active: active (exited) since Thu 2019-02-28 13:29:29 CST; 2 weeks 0 days ago
Main PID: 818 (code=exited, status=0/SUCCESS)
   CGroup: /system.slice/iptables.service
[user@node1 my.cnf.d]$ sudo service iptables stop
Redirecting to /bin/systemctl stop iptables.service

3、下载CM

[user@node1 ~]$ mkdir /home/user/cm
[user@node1 ~]$ cd /home/user/cm
[user@node1 cm]$ wget --recursive --no-parent --no-host-directories  https://archive.cloudera.com/cm5/redhat/7/x86_64/cm/5.16.1/RPMS
[user@node1 cm]$ wget --recursive --no-parent --no-host-directories  https://archive.cloudera.com/cm5/redhat/7/x86_64/cm/5.16.1/repodata
[user@node1 cm]$ wget https://archive.cloudera.com/cm5/redhat/7/x86_64/cm/cloudera-manager.repo

这里建议可以把需要下载的列表放到一个文件里,统一下载,下载完成的目录结构是下面这样子:

[user@node1 cm]$ pwd
/home/user/cm
[user@node1 cm]$ sudo tree -a
.
├── cloudera-manager.repo
├── repodata
│   ├── filelists.xml.gz
│   ├── filelists.xml.gz.asc
│   ├── other.xml.gz
│   ├── other.xml.gz.asc
│   ├── primary.xml.gz
│   ├── primary.xml.gz.asc
│   ├── repomd.xml
│   └── repomd.xml.asc
└── RPMS
    ├── noarch
    └── x86_64
        ├── cloudera-manager-agent-5.16.1-1.cm5161.p0.1.el7.x86_64.rpm
        ├── cloudera-manager-daemons-5.16.1-1.cm5161.p0.1.el7.x86_64.rpm
        ├── cloudera-manager-server-5.16.1-1.cm5161.p0.1.el7.x86_64.rpm
        ├── cloudera-manager-server-db-2-5.16.1-1.cm5161.p0.1.el7.x86_64.rpm
        ├── enterprise-debuginfo-5.16.1-1.cm5161.p0.1.el7.x86_64.rpm
        ├── jdk-6u31-linux-amd64.rpm
        └── oracle-j2sdk1.7-1.7.0+update67-1.x86_64.rpm

4 directories, 16 files
[user@node1 cm]$ 

4、配置repo文件,并将其拷贝到/etc/yum.repos.d/下

[user@node1 cm]$ vi cloudera-manager.repo

[cloudera-manager]
# Packages for Cloudera Manager, Version 5, on RedHat or CentOS 7 x86_64                  
name=Cloudera Manager
#baseurl=https://archive.cloudera.com/cm5/redhat/7/x86_64/cm/5/
baseurl=file:///home/user/cm/
gpgkey =https://archive.cloudera.com/cm5/redhat/7/x86_64/cm/RPM-GPG-KEY-cloudera
gpgcheck = 0

[user@node1 cm]$ sudo cp cloudera-manager.repo /etc/yum.repos.d/

5、安装CM

[user@node1 ~]$ sudo yum -y install cloudera-manager-daemons cloudera-manager-server
Loaded plugins: fastestmirror, langpacks
Loading mirror speeds from cached hostfile
Resolving Dependencies
--> Running transaction check
---> Package cloudera-manager-daemons.x86_64 0:5.16.1-1.cm5161.p0.1.el7 will be installed
---> Package cloudera-manager-server.x86_64 0:5.16.1-1.cm5161.p0.1.el7 will be installed
--> Finished Dependency Resolution


Dependencies Resolved


=============================================================================================================================================================================================
Package                                             Arch                              Version                                             Repository                                   Size
=============================================================================================================================================================================================
Installing:
cloudera-manager-daemons                            x86_64                            5.16.1-1.cm5161.p0.1.el7                            cloudera-manager                            753 M
cloudera-manager-server                             x86_64                            5.16.1-1.cm5161.p0.1.el7                            cloudera-manager                            8.5 k


Transaction Summary
=============================================================================================================================================================================================
Install  2 Packages


Total download size: 753 M
Installed size: 935 M
Downloading packages:
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Total                                                                                                                                                        511 MB/s | 753 MB  00:00:01     
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Installing : cloudera-manager-daemons-5.16.1-1.cm5161.p0.1.el7.x86_64                                                                                                                  1/2
  Installing : cloudera-manager-server-5.16.1-1.cm5161.p0.1.el7.x86_64                                                                                                                   2/2
  Verifying  : cloudera-manager-server-5.16.1-1.cm5161.p0.1.el7.x86_64                                                                                                                   1/2
  Verifying  : cloudera-manager-daemons-5.16.1-1.cm5161.p0.1.el7.x86_64                                                                                                                  2/2


Installed:
  cloudera-manager-daemons.x86_64 0:5.16.1-1.cm5161.p0.1.el7                                    cloudera-manager-server.x86_64 0:5.16.1-1.cm5161.p0.1.el7                                   


Complete!

6、下载mysqsl jdbc 并解压

[user@node1 ~]$ wget https://dev.mysql.com/get/Downloads/Connector-J/mysql-connector-java-8.0.15.tar.gz
--2019-03-15 15:52:15--  https://dev.mysql.com/get/Downloads/Connector-J/mysql-connector-java-8.0.15.tar.gz
Resolving dev.mysql.com (dev.mysql.com)... 137.254.60.11
Connecting to dev.mysql.com (dev.mysql.com)|137.254.60.11|:443... connected.
HTTP request sent, awaiting response... 302 Found
Location: https://cdn.mysql.com//Downloads/Connector-J/mysql-connector-java-8.0.15.tar.gz [following]
--2019-03-15 15:52:16--  https://cdn.mysql.com//Downloads/Connector-J/mysql-connector-java-8.0.15.tar.gz
Resolving cdn.mysql.com (cdn.mysql.com)... 104.127.195.16
Connecting to cdn.mysql.com (cdn.mysql.com)|104.127.195.16|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 5989463 (5.7M) [application/x-tar-gz]
Saving to: ‘mysql-connector-java-8.0.15.tar.gz’


100%[===================================================================================================================================================>] 5,989,463    978KB/s   in 5.9s   


2019-03-15 15:52:23 (991 KB/s) - ‘mysql-connector-java-8.0.15.tar.gz’ saved [5989463/5989463]

[user@node1 ~]$ tar -zxvf mysql-connector-java-8.0.15.tar.gz

7、将jar包拷贝并重命名

[user@node1 ~]$ cd mysql-connector-java-8.0.15/
[user@node1 mysql-connector-java-8.0.15]$ cp mysql-connector-java-8.0.15.jar /usr/share/java/mysql-connector-java.jar

8、初始化mysql,这里报了个错,应该是在mysql中创建数据库、用户和密码的时候没有满足密码的安全策略,这里记录下报错信息,正常安装可以跳过这步,先做下面步骤9的配置。

[user@node1 ~]$ sudo /usr/share/cmf/schema/scm_prepare_database.sh mysql -hnode1 -uroot -pAbc_2019 --scm-host dmbnn3 scm scm scm
JAVA_HOME=/usr/lib/jvm/jre-openjdk
Verifying that we can write to /etc/cloudera-scm-server
Loading class `com.mysql.jdbc.Driver'. This is deprecated. The new driver class is `com.mysql.cj.jdbc.Driver'. The driver is automatically registered via the SPI and manual loading of the driver class is generally unnecessary.
[                          main] DbProvisioner                  ERROR Exception when creating/dropping database with user 'root' and jdbc url 'jdbc:mysql://node1/?useUnicode=true&characterEncoding=UTF-8'
java.sql.SQLException: Your password does not satisfy the current policy requirements
        at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:129)[mysql-connector-java.jar:8.0.15]
        at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:97)[mysql-connector-java.jar:8.0.15]
        at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122)[mysql-connector-java.jar:8.0.15]
        at com.mysql.cj.jdbc.StatementImpl.executeInternal(StatementImpl.java:782)[mysql-connector-java.jar:8.0.15]
        at com.mysql.cj.jdbc.StatementImpl.execute(StatementImpl.java:666)[mysql-connector-java.jar:8.0.15]
        at com.cloudera.enterprise.dbutil.DbProvisioner.executeSql(DbProvisioner.java:299)[db-common-5.16.1.jar:]
        at com.cloudera.enterprise.dbutil.DbProvisioner.doMain(DbProvisioner.java:104)[db-common-5.16.1.jar:]
        at com.cloudera.enterprise.dbutil.DbProvisioner.main(DbProvisioner.java:123)[db-common-5.16.1.jar:]
[                          main] DbProvisioner                  ERROR Stack Trace:
java.sql.SQLException: Your password does not satisfy the current policy requirements
        at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:129)[mysql-connector-java.jar:8.0.15]
        at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:97)[mysql-connector-java.jar:8.0.15]
        at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122)[mysql-connector-java.jar:8.0.15]
        at com.mysql.cj.jdbc.StatementImpl.executeInternal(StatementImpl.java:782)[mysql-connector-java.jar:8.0.15]
        at com.mysql.cj.jdbc.StatementImpl.execute(StatementImpl.java:666)[mysql-connector-java.jar:8.0.15]
        at com.cloudera.enterprise.dbutil.DbProvisioner.executeSql(DbProvisioner.java:299)[db-common-5.16.1.jar:]
        at com.cloudera.enterprise.dbutil.DbProvisioner.doMain(DbProvisioner.java:104)[db-common-5.16.1.jar:]
        at com.cloudera.enterprise.dbutil.DbProvisioner.main(DbProvisioner.java:123)[db-common-5.16.1.jar:]
--> Error 1, giving up (use --force if you wish to ignore the error)

9、关闭密码复杂度限制,并重启mysql

[user@node1 ~]$ sudo vi /etc/my.cnf


[mysqld]
datadir=/data1/mysql/data
socket=/var/lib/mysql/mysql.sock
# Disabling symbolic-links is recommended to prevent assorted security risks
symbolic-links=0
bind-address=0.0.0.0
# Settings user and group are ignored when systemd is used.
# If you need to run mysqld under a different user or group,
# customize your systemd unit file for mariadb according to the
# instructions in http://fedoraproject.org/wiki/Systemd
#skip-grant-tables
validate_password = off  #加上这一句
[mysqld_safe]
log-error=/var/log/mariadb/mariadb.log
pid-file=/var/run/mariadb/mariadb.pid


#
# include all files from the config directory
#
!includedir /etc/my.cnf.d
[user@node1 ~]$ sudo systemctl restart mysqld

10、重新进行初始化,如果之前执行了,发生步骤8中的错误,那么可能会提示scm数据库已经存在,用root用户登录之后删掉即可。

[user@node1 ~]$ sudo /usr/share/cmf/schema/scm_prepare_database.sh mysql -hnode1 -uroot -pAbc_2019 --scm-host node1 scm scm scm
JAVA_HOME=/usr/lib/jvm/jre-openjdk
Verifying that we can write to /etc/cloudera-scm-server
Loading class `com.mysql.jdbc.Driver'. This is deprecated. The new driver class is `com.mysql.cj.jdbc.Driver'. The driver is automatically registered via the SPI and manual loading of the driver class is generally unnecessary.
Creating SCM configuration file in /etc/cloudera-scm-server
Executing:  /usr/lib/jvm/jre-openjdk/bin/java -cp /usr/share/java/mysql-connector-java.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/java/postgresql-connector-java.jar:/usr/share/cmf/schema/../lib/* com.cloudera.enterprise.dbutil.DbCommandExecutor /etc/cloudera-scm-server/db.properties com.cloudera.cmf.db.
Loading class `com.mysql.jdbc.Driver'. This is deprecated. The new driver class is `com.mysql.cj.jdbc.Driver'. The driver is automatically registered via the SPI and manual loading of the driver class is generally unnecessary.
[                          main] DbCommandExecutor              INFO  Successfully connected to database.
All done, your SCM database is configured correctly!

11、数据库初始化成功。启动 cloudera-scm-server,并设置开机启动:

[user@node1 ~]$ service cloudera-scm-server start
[user@node1 ~]$ sudo systemctl enable cloudera-scm-server

稍等一会儿通过页面访问http://你的服务器IP:7180/cmf/即可访问到CM监控页面,通过页面的安装引导就可以实现CDH的安装。

最后编辑于
©著作权归作者所有,转载或内容合作请联系作者
  • 序言:七十年代末,一起剥皮案震惊了整个滨河市,随后出现的几起案子,更是在滨河造成了极大的恐慌,老刑警刘岩,带你破解...
    沈念sama阅读 218,386评论 6 506
  • 序言:滨河连续发生了三起死亡事件,死亡现场离奇诡异,居然都是意外死亡,警方通过查阅死者的电脑和手机,发现死者居然都...
    沈念sama阅读 93,142评论 3 394
  • 文/潘晓璐 我一进店门,熙熙楼的掌柜王于贵愁眉苦脸地迎上来,“玉大人,你说我怎么就摊上这事。” “怎么了?”我有些...
    开封第一讲书人阅读 164,704评论 0 353
  • 文/不坏的土叔 我叫张陵,是天一观的道长。 经常有香客问我,道长,这世上最难降的妖魔是什么? 我笑而不...
    开封第一讲书人阅读 58,702评论 1 294
  • 正文 为了忘掉前任,我火速办了婚礼,结果婚礼上,老公的妹妹穿的比我还像新娘。我一直安慰自己,他们只是感情好,可当我...
    茶点故事阅读 67,716评论 6 392
  • 文/花漫 我一把揭开白布。 她就那样静静地躺着,像睡着了一般。 火红的嫁衣衬着肌肤如雪。 梳的纹丝不乱的头发上,一...
    开封第一讲书人阅读 51,573评论 1 305
  • 那天,我揣着相机与录音,去河边找鬼。 笑死,一个胖子当着我的面吹牛,可吹牛的内容都是我干的。 我是一名探鬼主播,决...
    沈念sama阅读 40,314评论 3 418
  • 文/苍兰香墨 我猛地睁开眼,长吁一口气:“原来是场噩梦啊……” “哼!你这毒妇竟也来了?” 一声冷哼从身侧响起,我...
    开封第一讲书人阅读 39,230评论 0 276
  • 序言:老挝万荣一对情侣失踪,失踪者是张志新(化名)和其女友刘颖,没想到半个月后,有当地人在树林里发现了一具尸体,经...
    沈念sama阅读 45,680评论 1 314
  • 正文 独居荒郊野岭守林人离奇死亡,尸身上长有42处带血的脓包…… 初始之章·张勋 以下内容为张勋视角 年9月15日...
    茶点故事阅读 37,873评论 3 336
  • 正文 我和宋清朗相恋三年,在试婚纱的时候发现自己被绿了。 大学时的朋友给我发了我未婚夫和他白月光在一起吃饭的照片。...
    茶点故事阅读 39,991评论 1 348
  • 序言:一个原本活蹦乱跳的男人离奇死亡,死状恐怖,灵堂内的尸体忽然破棺而出,到底是诈尸还是另有隐情,我是刑警宁泽,带...
    沈念sama阅读 35,706评论 5 346
  • 正文 年R本政府宣布,位于F岛的核电站,受9级特大地震影响,放射性物质发生泄漏。R本人自食恶果不足惜,却给世界环境...
    茶点故事阅读 41,329评论 3 330
  • 文/蒙蒙 一、第九天 我趴在偏房一处隐蔽的房顶上张望。 院中可真热闹,春花似锦、人声如沸。这庄子的主人今日做“春日...
    开封第一讲书人阅读 31,910评论 0 22
  • 文/苍兰香墨 我抬头看了看天上的太阳。三九已至,却和暖如春,着一层夹袄步出监牢的瞬间,已是汗流浃背。 一阵脚步声响...
    开封第一讲书人阅读 33,038评论 1 270
  • 我被黑心中介骗来泰国打工, 没想到刚下飞机就差点儿被人妖公主榨干…… 1. 我叫王不留,地道东北人。 一个月前我还...
    沈念sama阅读 48,158评论 3 370
  • 正文 我出身青楼,却偏偏与公主长得像,于是被迫代替她去往敌国和亲。 传闻我的和亲对象是个残疾皇子,可洞房花烛夜当晚...
    茶点故事阅读 44,941评论 2 355