spark sql
通过Spark SQL 查询hive中的数据 要求提供操作截图
- 切换数据库，选择指定的表；
- 操作
sunyonggang@gg01:~/spark-1.4.0-bin-hadoop2.6$ ./bin/spark-sql --driver-class-path /home/sunyonggang/apache-hive-0.13.1-bin/lib/mysql-connector-java-5.1.36-bin.jar
log4j:WARN No appenders could be found for logger (org.apache.hadoop.util.Shell).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
spark-sql> show databases;
16/05/07 10:55:13 INFO ParseDriver: Parsing command: show databases
16/05/07 10:55:13 INFO ParseDriver: Parse Completed
16/05/07 10:55:15 INFO DAGScheduler: Job 0 finished: processCmd at CliDriver.java:423, took 0.342186 s
16/05/07 10:55:15 INFO TaskSchedulerImpl: Removed TaskSet 0.0, whose tasks have all completed, from pool
default
sogou
Time taken: 1.951 seconds, Fetched 2 row(s)
16/05/07 10:55:15 INFO CliDriver: Time taken: 1.951 seconds, Fetched 2 row(s)
16/05/07 10:55:15 INFO StatsReportListener: 96 % 96 % 96 % 96 % 96 % 96 % 96 % 96 % 96 %
use sogou;
16/05/07 10:55:23 INFO ParseDriver: Parsing command: use sogou
16/05/07 10:55:23 INFO ParseDriver: Parse Completed
show tables;
16/05/07 10:55:28 INFO HiveMetaStore: 0: get_tables: db=sogou pat=.*
16/05/07 10:55:28 INFO audit: ugi=sunyonggang ip=unknown-ip-addr cmd=get_tables: db=sogou pat=.*
16/05/07 10:55:28 INFO SparkContext: Starting job: processCmd at CliDriver.java:423
16/05/07 10:55:28 INFO DAGScheduler: Got job 2 (processCmd at CliDriver.java:423) with 1 output partitions (allowLocal=false)
16/05/07 10:55:28 INFO DAGScheduler: Final stage: ResultStage 2(processCmd at CliDriver.java:423)
16/05/07 10:55:28 INFO DAGScheduler: Parents of final stage: List()
16/05/07 10:55:28 INFO DAGScheduler: Missing parents: List()
16/05/07 10:55:28 INFO DAGScheduler: Submitting ResultStage 2 (MapPartitionsRDD[5] at processCmd at CliDriver.java:423), which has no missing parents
16/05/07 10:55:28 INFO MemoryStore: ensureFreeSpace(2816) called with curMem=4314, maxMem=280248975
16/05/07 10:55:28 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 2.8 KB, free 267.3 MB)
16/05/07 10:55:28 INFO MemoryStore: ensureFreeSpace(1685) called with curMem=7130, maxMem=280248975
16/05/07 10:55:28 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 1685.0 B, free 267.3 MB)
16/05/07 10:55:28 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on localhost:48651 (size: 1685.0 B, free: 267.3 MB)
16/05/07 10:55:28 INFO SparkContext: Created broadcast 2 from broadcast at DAGScheduler.scala:874
16/05/07 10:55:28 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 2 (MapPartitionsRDD[5] at processCmd at CliDriver.java:423)
16/05/07 10:55:28 INFO TaskSchedulerImpl: Adding task set 2.0 with 1 tasks
16/05/07 10:55:28 INFO TaskSetManager: Starting task 0.0 in stage 2.0 (TID 2, localhost, PROCESS_LOCAL, 1902 bytes)
16/05/07 10:55:28 INFO Executor: Running task 0.0 in stage 2.0 (TID 2)
16/05/07 10:55:28 INFO Executor: Finished task 0.0 in stage 2.0 (TID 2). 1149 bytes result sent to driver
16/05/07 10:55:28 INFO DAGScheduler: ResultStage 2 (processCmd at CliDriver.java:423) finished in 0.038 s
16/05/07 10:55:28 INFO DAGScheduler: Job 2 finished: processCmd at CliDriver.java:423, took 0.062450 s
sg false16/05/07 10:55:28 INFO StatsReportListener: Finished stage: org.apache.spark.scheduler.StageInfo@6f05894a
16/05/07 10:55:28 INFO StatsReportListener: task runtime:(count: 1, mean: 42.000000, stdev: 0.000000, max: 42.000000, min: 42.000000)
sunyonggang false
userlog false
16/05/07 10:55:28 INFO StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
16/05/07 10:55:28 INFO StatsReportListener: 42.0 ms 42.0 ms 42.0 ms 42.0 ms 42.0 ms 42.0 ms 42.0 ms 42.0 ms 42.0 ms
Time taken: 0.096 seconds, Fetched 3 row(s)
3.编写sql
select address, count(*) as number from userlog group by address order by number desc;
吉首市 2243516/05/07 11:00:40 INFO StatsReportListener: Finished stage: org.apache.spark.scheduler.StageInfo@8a8fbe2
16/05/07 11:00:40 INFO StatsReportListener: task runtime:(count: 9, mean: 25.666667, stdev: 9.153020, max: 42.000000, min: 13.000000)
16/05/07 11:00:40 INFO StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
16/05/07 11:00:40 INFO StatsReportListener: 13.0 ms 13.0 ms 13.0 ms 20.0 ms 26.0 ms 30.0 ms 42.0 ms 42.0 ms 42.0 ms
龙山县 12445
永顺县 12146
凤凰县 10548
花垣县 10453
16/05/07 11:00:40 INFO StatsReportListener: fetch wait time:(count: 9, mean: 0.000000, stdev: 0.000000, max: 0.000000, min: 0.000000)
保靖县 7258
泸溪县 7102
古丈县 3721
写一个简单的程序通过JDBC访问Spark SQL Thrift server能实现查询，要求过程和截图
- 启动thrift server
sunyonggang@gg01:~/spark-1.4.0-bin-hadoop2.6$ ./sbin/start-thriftserver.sh --hiveconf hive.server2.thrift.port=10000 --hiveconf hive.server2.thrift.bind.host=gg01 --master spark://gg01:7077 --driver-class-path /home/sunyonggang/apache-hive-0.13.1-bin/lib/mysql-connector-java-5.1.36-bin.jar --executor-memory 1g
starting org.apache.spark.sql.hive.thriftserver.HiveThriftServer2, logging to /home/sunyonggang/spark-1.4.0-bin-hadoop2.6/sbin/../logs/spark-sunyonggang-org.apache.spark.sql.hive.thriftserver.HiveThriftServer2-1-gg01.out
sunyonggang@gg01:~/spark-1.4.0-bin-hadoop2.6$ cd ~/apache-hive-0.13.1-bin/
sunyonggang@gg01:~/apache-hive-0.13.1-bin$ ./bin/beeline
Beeline version 0.13.1 by Apache Hive
beeline> !connect jdbc:hive2://gg01:10000
scan complete in 3ms
Connecting to jdbc:hive2://gg01:10000
Enter username for jdbc:hive2://gg01:10000: sunyonggang
Enter password for jdbc:hive2://gg01:10000: ***********
Connected to: Spark SQL (version 1.4.0)
Driver: Hive JDBC (version 0.13.1)
Transaction isolation: TRANSACTION_REPEATABLE_READ
0: jdbc:hive2://gg01:10000> show databases;
+----------+
| result |
+----------+
| default |
| sogou |
+----------+
2 rows selected (1.852 seconds)
0: jdbc:hive2://gg01:10000>
2.访问数据: 导入hive lib下的的所有包，包括了mysql－jdbc的那个包
package com.github.sunyonggang
import java.sql.DriverManager
/**
* Created by sunyonggang on 16-5-7.
*/
class UseJdbcGetUserlog {
}
object UseJdbcGetUserlog {
def main(args: Array[String]) {
Class.forName("org.apache.hive.jdbc.HiveDriver")
val conn = DriverManager.getConnection("jdbc:hive2://gg01:10000/sogou", "sunyonggang", "**************")
val preStat = conn.prepareStatement("select * from userlog limit 5")
val rs = preStat.executeQuery()
//desc userlog
/**
* hive> desc userlog;
* OK
* id int
* username varchar(100)
* phone bigint
* address varchar(25)
* age int
* gender varchar(5)
* level varchar(25)
* logindate varchar(10)
* Time taken: 0.376 seconds, Fetched: 8 row(s)
*/
while(rs.next()) {
println("id: " + rs.getInt("id") + " username: " + rs.getString("username") + " phone: " + rs.getString("phone") +
" address: " + rs.getString("address") + " age: " + rs.getInt("age")
)
}
rs.close()
preStat.close()
conn.close()
}
}
3.查看结果
/home/sunyonggang/jdk1.7.0_79/bin/java -Didea.launcher.port=7533 -Didea.launcher.bin.path=/home/sunyonggang/idea-IC-145.597.3/bin -Dfile.encoding=UTF-8 -classpath /home/sunyonggang/jdk1.7.0_79/jre/lib/charsets.jar:/home/sunyonggang/jdk1.7.0_79/jre/lib/deploy.jar:/home/sunyonggang/jdk1.7.0_79/jre/lib/ext/dnsns.jar:/home/sunyonggang/jdk1.7.0_79/jre/lib/ext/localedata.jar:/home/sunyonggang/jdk1.7.0_79/jre/lib/ext/sunec.jar:/home/sunyonggang/jdk1.7.0_79/jre/lib/ext/sunjce_provider.jar:/home/sunyonggang/jdk1.7.0_79/jre/lib/ext/sunpkcs11.jar:/home/sunyonggang/jdk1.7.0_79/jre/lib/ext/zipfs.jar:/home/sunyonggang/jdk1.7.0_79/jre/lib/javaws.jar:/home/sunyonggang/jdk1.7.0_79/jre/lib/jce.jar:/home/sunyonggang/jdk1.7.0_79/jre/lib/jfr.jar:/home/sunyonggang/jdk1.7.0_79/jre/lib/jfxrt.jar:/home/sunyonggang/jdk1.7.0_79/jre/lib/jsse.jar:/home/sunyonggang/jdk1.7.0_79/jre/lib/management-agent.jar:/home/sunyonggang/jdk1.7.0_79/jre/lib/plugin.jar:/home/sunyonggang/jdk1.7.0_79/jre/lib/resources.jar:/home/sunyonggang/jdk1.7.0_79/jre/lib/rt.jar:/home/sunyonggang/IdeaProjects/Week5/target/scala-2.10/classes:/home/sunyonggang/.ivy2/cache/org.scala-lang/scala-library/jars/scala-library-2.10.5.jar:/home/sunyonggang/.ivy2/cache/xmlenc/xmlenc/jars/xmlenc-0.52.jar:/home/sunyonggang/.ivy2/cache/stax/stax-api/jars/stax-api-1.0.1.jar:/home/sunyonggang/.ivy2/cache/oro/oro/jars/oro-2.0.8.jar:/home/sunyonggang/.ivy2/cache/org.xerial.snappy/snappy-java/bundles/snappy-java-1.1.1.7.jar:/home/sunyonggang/.ivy2/cache/org.uncommons.maths/uncommons-maths/jars/uncommons-maths-1.2.2a.jar:/home/sunyonggang/.ivy2/cache/org.tukaani/xz/jars/xz-1.0.jar:/home/sunyonggang/.ivy2/cache/org.tachyonproject/tachyon-client/jars/tachyon-client-0.6.4.jar:/home/sunyonggang/.ivy2/cache/org.tachyonproject/tachyon/jars/tachyon-0.6.4.jar:/home/sunyonggang/.ivy2/cache/org.spark-project.spark/unused/jars/unused-1.0.0.jar:/home/sunyonggang/.ivy2/cache/org.spark-project.protobuf/protobuf-java/bundles/protobuf-java-2.5.0-spark.jar:/home/sunyonggang/.ivy2/cache/org.spark-project.akka/akka-slf4j_2.10/jars/akka-slf4j_2.10-2.3.4-spark.jar:/home/sunyonggang/.ivy2/cache/org.spark-project.akka/akka-remote_2.10/jars/akka-remote_2.10-2.3.4-spark.jar:/home/sunyonggang/.ivy2/cache/org.spark-project.akka/akka-actor_2.10/jars/akka-actor_2.10-2.3.4-spark.jar:/home/sunyonggang/.ivy2/cache/org.sonatype.sisu.inject/cglib/jars/cglib-2.2.1-v20090111.jar:/home/sunyonggang/.ivy2/cache/org.slf4j/slf4j-log4j12/jars/slf4j-log4j12-1.7.10.jar:/home/sunyonggang/.ivy2/cache/org.slf4j/slf4j-api/jars/slf4j-api-1.7.7.jar:/home/sunyonggang/.ivy2/cache/org.slf4j/jul-to-slf4j/jars/jul-to-slf4j-1.7.10.jar:/home/sunyonggang/.ivy2/cache/org.slf4j/jcl-over-slf4j/jars/jcl-over-slf4j-1.7.10.jar:/home/sunyonggang/.ivy2/cache/org.scala-lang/scalap/jars/scalap-2.10.0.jar:/home/sunyonggang/.sbt/boot/scala-2.10.4/lib/scala-reflect.jar:/home/sunyonggang/.ivy2/cache/org.scala-lang/scala-compiler/jars/scala-compiler-2.10.0.jar:/home/sunyonggang/.ivy2/cache/org.roaringbitmap/RoaringBitmap/bundles/RoaringBitmap-0.4.5.jar:/home/sunyonggang/.ivy2/cache/org.objenesis/objenesis/jars/objenesis-1.2.jar:/home/sunyonggang/.ivy2/cache/org.mortbay.jetty/jetty-util/jars/jetty-util-6.1.26.jar:/home/sunyonggang/.ivy2/cache/org.json4s/json4s-jackson_2.10/jars/json4s-jackson_2.10-3.2.10.jar:/home/sunyonggang/.ivy2/cache/org.json4s/json4s-core_2.10/jars/json4s-core_2.10-3.2.10.jar:/home/sunyonggang/.ivy2/cache/org.json4s/json4s-ast_2.10/jars/json4s-ast_2.10-3.2.10.jar:/home/sunyonggang/.ivy2/cache/org.eclipse.jetty.orbit/javax.servlet/orbits/javax.servlet-3.0.0.v201112011016.jar:/home/sunyonggang/.ivy2/cache/org.codehaus.jettison/jettison/bundles/jettison-1.1.jar:/home/sunyonggang/.ivy2/cache/org.codehaus.jackson/jackson-xc/jars/jackson-xc-1.8.8.jar:/home/sunyonggang/.ivy2/cache/org.codehaus.jackson/jackson-jaxrs/jars/jackson-jaxrs-1.8.8.jar:/home/sunyonggang/.ivy2/cache/org.codehaus.jackson/jackson-core-asl/jars/jackson-core-asl-1.8.8.jar:/home/sunyonggang/.ivy2/cache/org.apache.zookeeper/zookeeper/jars/zookeeper-3.4.5.jar:/home/sunyonggang/.ivy2/cache/org.apache.spark/spark-unsafe_2.10/jars/spark-unsafe_2.10-1.4.0.jar:/home/sunyonggang/.ivy2/cache/org.apache.spark/spark-network-shuffle_2.10/jars/spark-network-shuffle_2.10-1.4.0.jar:/home/sunyonggang/.ivy2/cache/org.apache.spark/spark-network-common_2.10/jars/spark-network-common_2.10-1.4.0.jar:/home/sunyonggang/.ivy2/cache/org.apache.spark/spark-launcher_2.10/jars/spark-launcher_2.10-1.4.0.jar:/home/sunyonggang/.ivy2/cache/org.apache.spark/spark-core_2.10/jars/spark-core_2.10-1.4.0.jar:/home/sunyonggang/.ivy2/cache/org.apache.mesos/mesos/jars/mesos-0.21.1-shaded-protobuf.jar:/home/sunyonggang/.ivy2/cache/org.apache.ivy/ivy/jars/ivy-2.4.0.jar:/home/sunyonggang/.ivy2/cache/org.apache.hadoop/hadoop-yarn-server-common/jars/hadoop-yarn-server-common-2.2.0.jar:/home/sunyonggang/.ivy2/cache/org.apache.hadoop/hadoop-yarn-common/jars/hadoop-yarn-common-2.2.0.jar:/home/sunyonggang/.ivy2/cache/org.apache.hadoop/hadoop-yarn-client/jars/hadoop-yarn-client-2.2.0.jar:/home/sunyonggang/.ivy2/cache/org.apache.hadoop/hadoop-yarn-api/jars/hadoop-yarn-api-2.2.0.jar:/home/sunyonggang/.ivy2/cache/org.apache.hadoop/hadoop-mapreduce-client-shuffle/jars/hadoop-mapreduce-client-shuffle-2.2.0.jar:/home/sunyonggang/.ivy2/cache/org.apache.hadoop/hadoop-mapreduce-client-jobclient/jars/hadoop-mapreduce-client-jobclient-2.2.0.jar:/home/sunyonggang/.ivy2/cache/org.apache.hadoop/hadoop-mapreduce-client-core/jars/hadoop-mapreduce-client-core-2.2.0.jar:/home/sunyonggang/.ivy2/cache/org.apache.hadoop/hadoop-mapreduce-client-common/jars/hadoop-mapreduce-client-common-2.2.0.jar:/home/sunyonggang/.ivy2/cache/org.apache.hadoop/hadoop-mapreduce-client-app/jars/hadoop-mapreduce-client-app-2.2.0.jar:/home/sunyonggang/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/jars/hadoop-hdfs-2.2.0.jar:/home/sunyonggang/.ivy2/cache/org.apache.hadoop/hadoop-common/jars/hadoop-common-2.2.0.jar:/home/sunyonggang/.ivy2/cache/org.apache.hadoop/hadoop-client/jars/hadoop-client-2.2.0.jar:/home/sunyonggang/.ivy2/cache/org.apache.hadoop/hadoop-auth/jars/hadoop-auth-2.2.0.jar:/home/sunyonggang/.ivy2/cache/org.apache.hadoop/hadoop-annotations/jars/hadoop-annotations-2.2.0.jar:/home/sunyonggang/.ivy2/cache/org.apache.curator/curator-recipes/bundles/curator-recipes-2.4.0.jar:/home/sunyonggang/.ivy2/cache/org.apache.curator/curator-framework/bundles/curator-framework-2.4.0.jar:/home/sunyonggang/.ivy2/cache/org.apache.curator/curator-client/bundles/curator-client-2.4.0.jar:/home/sunyonggang/.ivy2/cache/org.apache.commons/commons-math3/jars/commons-math3-3.4.1.jar:/home/sunyonggang/.ivy2/cache/org.apache.commons/commons-math/jars/commons-math-2.1.jar:/home/sunyonggang/.ivy2/cache/org.apache.commons/commons-lang3/jars/commons-lang3-3.3.2.jar:/home/sunyonggang/.ivy2/cache/org.apache.commons/commons-compress/jars/commons-compress-1.4.1.jar:/home/sunyonggang/.ivy2/cache/org.apache.avro/avro/jars/avro-1.7.4.jar:/home/sunyonggang/.ivy2/cache/net.sf.py4j/py4j/jars/py4j-0.8.2.1.jar:/home/sunyonggang/.ivy2/cache/net.razorvine/pyrolite/jars/pyrolite-4.4.jar:/home/sunyonggang/.ivy2/cache/net.jpountz.lz4/lz4/jars/lz4-1.2.0.jar:/home/sunyonggang/.ivy2/cache/net.java.dev.jets3t/jets3t/jars/jets3t-0.7.1.jar:/home/sunyonggang/.ivy2/cache/log4j/log4j/bundles/log4j-1.2.17.jar:/home/sunyonggang/.ivy2/cache/jline/jline/jars/jline-0.9.94.jar:/home/sunyonggang/.ivy2/cache/javax.xml.bind/jaxb-api/jars/jaxb-api-2.2.2.jar:/home/sunyonggang/.ivy2/cache/javax.inject/javax.inject/jars/javax.inject-1.jar:/home/sunyonggang/.ivy2/cache/javax.activation/activation/jars/activation-1.1.jar:/home/sunyonggang/.ivy2/cache/io.netty/netty-all/jars/netty-all-4.0.23.Final.jar:/home/sunyonggang/.ivy2/cache/io.netty/netty/bundles/netty-3.8.0.Final.jar:/home/sunyonggang/.ivy2/cache/io.dropwizard.metrics/metrics-jvm/bundles/metrics-jvm-3.1.0.jar:/home/sunyonggang/.ivy2/cache/io.dropwizard.metrics/metrics-json/bundles/metrics-json-3.1.0.jar:/home/sunyonggang/.ivy2/cache/io.dropwizard.metrics/metrics-graphite/bundles/metrics-graphite-3.1.0.jar:/home/sunyonggang/.ivy2/cache/io.dropwizard.metrics/metrics-core/bundles/metrics-core-3.1.0.jar:/home/sunyonggang/.ivy2/cache/commons-net/commons-net/jars/commons-net-2.2.jar:/home/sunyonggang/.ivy2/cache/commons-logging/commons-logging/jars/commons-logging-1.1.1.jar:/home/sunyonggang/.ivy2/cache/commons-lang/commons-lang/jars/commons-lang-2.5.jar:/home/sunyonggang/.ivy2/cache/commons-io/commons-io/jars/commons-io-2.4.jar:/home/sunyonggang/.ivy2/cache/commons-httpclient/commons-httpclient/jars/commons-httpclient-3.1.jar:/home/sunyonggang/.ivy2/cache/commons-digester/commons-digester/jars/commons-digester-1.8.jar:/home/sunyonggang/.ivy2/cache/commons-configuration/commons-configuration/jars/commons-configuration-1.6.jar:/home/sunyonggang/.ivy2/cache/commons-collections/commons-collections/jars/commons-collections-3.2.1.jar:/home/sunyonggang/.ivy2/cache/commons-codec/commons-codec/jars/commons-codec-1.5.jar:/home/sunyonggang/.ivy2/cache/commons-cli/commons-cli/jars/commons-cli-1.2.jar:/home/sunyonggang/.ivy2/cache/commons-beanutils/commons-beanutils-core/jars/commons-beanutils-core-1.8.0.jar:/home/sunyonggang/.ivy2/cache/commons-beanutils/commons-beanutils/jars/commons-beanutils-1.7.0.jar:/home/sunyonggang/.ivy2/cache/com.typesafe/config/bundles/config-1.2.1.jar:/home/sunyonggang/.ivy2/cache/com.twitter/chill_2.10/jars/chill_2.10-0.5.0.jar:/home/sunyonggang/.ivy2/cache/com.twitter/chill-java/jars/chill-java-0.5.0.jar:/home/sunyonggang/.ivy2/cache/com.thoughtworks.paranamer/paranamer/jars/paranamer-2.6.jar:/home/sunyonggang/.ivy2/cache/com.sun.xml.bind/jaxb-impl/jars/jaxb-impl-2.2.3-1.jar:/home/sunyonggang/.ivy2/cache/com.sun.jersey.jersey-test-framework/jersey-test-framework-grizzly2/jars/jersey-test-framework-grizzly2-1.9.jar:/home/sunyonggang/.ivy2/cache/com.sun.jersey.contribs/jersey-guice/jars/jersey-guice-1.9.jar:/home/sunyonggang/.ivy2/cache/com.sun.jersey/jersey-server/bundles/jersey-server-1.9.jar:/home/sunyonggang/.ivy2/cache/com.sun.jersey/jersey-json/bundles/jersey-json-1.9.jar:/home/sunyonggang/.ivy2/cache/com.sun.jersey/jersey-core/bundles/jersey-core-1.9.jar:/home/sunyonggang/.ivy2/cache/com.ning/compress-lzf/bundles/compress-lzf-1.0.3.jar:/home/sunyonggang/.ivy2/cache/com.google.protobuf/protobuf-java/bundles/protobuf-java-2.5.0.jar:/home/sunyonggang/.ivy2/cache/com.google.inject/guice/jars/guice-3.0.jar:/home/sunyonggang/.ivy2/cache/com.google.guava/guava/bundles/guava-14.0.1.jar:/home/sunyonggang/.ivy2/cache/com.google.code.findbugs/jsr305/jars/jsr305-1.3.9.jar:/home/sunyonggang/.ivy2/cache/com.fasterxml.jackson.module/jackson-module-scala_2.10/bundles/jackson-module-scala_2.10-2.4.4.jar:/home/sunyonggang/.ivy2/cache/com.fasterxml.jackson.core/jackson-databind/bundles/jackson-databind-2.4.4.jar:/home/sunyonggang/.ivy2/cache/com.fasterxml.jackson.core/jackson-core/bundles/jackson-core-2.4.4.jar:/home/sunyonggang/.ivy2/cache/com.fasterxml.jackson.core/jackson-annotations/bundles/jackson-annotations-2.4.4.jar:/home/sunyonggang/.ivy2/cache/com.esotericsoftware.reflectasm/reflectasm/jars/reflectasm-1.07-shaded.jar:/home/sunyonggang/.ivy2/cache/com.esotericsoftware.minlog/minlog/jars/minlog-1.2.jar:/home/sunyonggang/.ivy2/cache/com.esotericsoftware.kryo/kryo/bundles/kryo-2.21.jar:/home/sunyonggang/.ivy2/cache/com.clearspring.analytics/stream/jars/stream-2.7.0.jar:/home/sunyonggang/.ivy2/cache/asm/asm/jars/asm-3.2.jar:/home/sunyonggang/.ivy2/cache/aopalliance/aopalliance/jars/aopalliance-1.0.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/xz-1.0.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/jta-1.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/jpam-1.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/ST4-4.0.4.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/ant-1.9.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/oro-2.0.8.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/avro-1.7.5.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/junit-4.10.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/mail-1.4.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/antlr-2.7.7.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/asm-tree-3.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/guava-11.0.2.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/jetty-6.1.26.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/jline-0.9.94.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/jsr305-1.3.9.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/log4j-1.2.16.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/velocity-1.5.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/jdo-api-3.0.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/paranamer-2.3.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/activation-1.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/commons-io-2.4.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/httpcore-4.2.5.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/libfb303-0.9.0.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/stax-api-1.0.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/asm-commons-3.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/commons-cli-1.2.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/derby-10.10.1.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/hive-ant-0.13.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/hive-cli-0.13.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/hive-hwi-0.13.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/libthrift-0.9.0.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/servlet-api-2.5.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/zookeeper-3.4.5.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/commons-lang-2.4.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/groovy-all-2.1.6.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/hive-exec-0.13.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/hive-jdbc-0.13.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/httpclient-4.2.5.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/tempus-fugit-1.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/antlr-runtime-3.4.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/commons-codec-1.4.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/commons-lang3-3.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/hamcrest-core-1.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/hive-serde-0.13.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/hive-shims-0.13.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/jetty-util-6.1.26.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/snappy-java-1.0.5.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/ant-launcher-1.9.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/hive-common-0.13.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/hive-beeline-0.13.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/hive-contrib-0.13.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/hive-service-0.13.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/bonecp-0.8.0.RELEASE.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/stringtemplate-3.2.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/commons-logging-1.1.3.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/hive-metastore-0.13.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/hive-testutils-0.13.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/commons-compress-1.4.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/hive-shims-0.20-0.13.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/hive-shims-0.23-0.13.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/commons-collections-3.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/datanucleus-core-3.2.10.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/datanucleus-rdbms-3.2.9.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/hive-shims-0.20S-0.13.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/commons-httpclient-3.0.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/hive-shims-common-0.13.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/servlet-api-2.5-20081211.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/datanucleus-api-jdo-3.2.6.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/hive-hbase-handler-0.13.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/jetty-all-7.6.0.v20120127.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/geronimo-jta_1.1_spec-1.1.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/geronimo-jaspic_1.0_spec-1.0.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/hive-shims-common-secure-0.13.1.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/mysql-connector-java-5.1.36-bin.jar:/home/sunyonggang/apache-hive-0.13.1-bin/lib/geronimo-annotation_1.0_spec-1.1.1.jar:/home/sunyonggang/idea-IC-145.597.3/lib/idea_rt.jar com.intellij.rt.execution.application.AppMain com.github.sunyonggang.UseJdbcGetUserlog
log4j:WARN No appenders could be found for logger (org.apache.thrift.transport.TSaslTransport).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
id: 1 username: user1 phone: 15200776350 address: 凤凰县 age: 25
id: 2 username: user2 phone: 15200771700 address: 凤凰县 age: 41
id: 3 username: user3 phone: 13487837597 address: 吉首市 age: 23
id: 4 username: user4 phone: 15074344263 address: 吉首市 age: 21
id: 5 username: user5 phone: 15007439761 address: 吉首市 age: 20
