2020-10-12(初学Hive配置)

1.安装mysql

2. 开放远程连接权限

mysql -uroot -proot

grant all privileges on . to 'root'@'%' identified by 'root' with grant option;(前一个是用户 后一个是密码)

flush privileges;

Your password does not satisfy the current policy requirements(设置密码权限)

https://blog.csdn.net/Hello_World_QWP/article/details/79551789?ops_request_misc=%257B%2522request%255Fid%2522%253A%2522160247899819724839235616%2522%252C%2522scm%2522%253A%252220140713.130102334..%2522%257D&request_id=160247899819724839235616&biz_id=0&utm_medium=distribute.pc_search_result.none-task-blog-2~

3. 测试是否连接成功

授权完成后，测试一下是否成功：在windows上用Navicat连接一下看是否能成功！

4.启动Hadoop和yarn

start-dfs.sh , start-yarn.sh或者是start-all.sh 启动HDFS和Yarn

5.上传解压

6.配置

vi hive-env.sh

export HADOOP_HOME=/opt/hadoop/hadoop-3.1.1
# Hive Configuration Directory can be controlled by:
export HIVE_CONF_DIR=/opt/hive/hive-3.1.2/conf/

vi hive-site.xml

<configuration>
<!-- 记录HIve中的元数据信息  记录在mysql中 -->
<property>
<name>javax.jdo.option.ConnectionURL</name>
<value>jdbc:mysql://linux03:3306/hive?createDatabaseIfNotExist=true&amp;useSSL=false</value>
</property>
<property>
<name>javax.jdo.option.ConnectionDriverName</name>
<value>com.mysql.jdbc.Driver</value>
</property>
<!-- mysql的用户名和密码 -->
<property>
<name>javax.jdo.option.ConnectionUserName</name>
<value>root</value>
</property>
<property>
<name>javax.jdo.option.ConnectionPassword</name>
<value>123456</value>
</property>

<property>
<name>hive.metastore.warehouse.dir</name>
<value>/user/hive/warehouse</value>
</property>

<property>
<name>hive.exec.scratchdir</name>
<value>/user/hive/tmp</value>
</property>
<property>
<name>hive.querylog.location</name>
<value>/user/hive/log</value>
</property>
<!-- 客户端远程连接的端口 -->
<property> 
<name>hive.server2.thrift.port</name> 
<value>10000</value>
</property>
<property> 
<name>hive.server2.thrift.bind.host</name> 
<value>0.0.0.0</value>
</property>
<property>
<name>hive.server2.webui.host</name>
<value>0.0.0.0</value>
</property>
<!-- hive服务的页面的端口 -->
<property>
<name>hive.server2.webui.port</name>
<value>10002</value>
</property>
<property> 
<name>hive.server2.long.polling.timeout</name> 
<value>5000</value>                               
</property>
<property>
<name>hive.server2.enable.doAs</name>
<value>true</value>
</property>
<property>
<name>datanucleus.autoCreateSchema</name>
<value>false</value>
</property>
<property>
<name>datanucleus.fixedDatastore</name>
<value>true</value>
</property>
<property>
<name>hive.execution.engine</name>
<value>mr</value>
</property>
</configuration>

vi ect/hadoop/core-site.xml(配置Hadoop)

<property>
<name>dfs.permissions.enabled</name>
<value>false</value>
</property>
<property>
<name>hadoop.proxyuser.root.hosts</name>
<value>*</value>
</property>
<property>
<name>hadoop.proxyuser.root.groups</name>
<value>*</value>
</property>

7.准备mysql的驱动包

image.png

8.初始化

bin/schematool -initSchema -dbType mysql

9.启动

直接执行bin下的hive就可以在shell窗口中启动hive的客户端

远程连接启动

1.在bin目录下启动 hiveserver2 &
2.重新开一个窗口
3.启动命令 beeline