几乎所有的 RPC 框架都宣称自己是“高性能”的, 那么实际结果到底如何呢, 让我们来做一个性能测试吧.
项目地址: https://github.com/hank-whu/rpc-benchmark
测试说明
- 仅限于Java.
- 客户端使用JMH进行压测, 32 线程, 10 次预热, 3 次运行.
- 每次运行前都会执行 killall java, 但没有在每轮测试时重启操作系统.
- 所有类库版本在发布时都是最新的, 除非存在bug.
- 所有框架都尽量参考该项目自带的Benchmark实现.
- 将会一直持续, 不定期发布测试结果.
测试用例
- boolean existUser(String email), 判断某个 email 是否存在.
- boolean createUser(User user), 添加一个 User.
- User getUser(long id), 根据 id 获取一个用户.
- Page<User> listUser(int pageNo), 获取用户列表.
运行结果
生成时间: 2018-01-28 14:36:24.
硬件环境: 阿里云 ecs.c4.xlarge, Intel Xeon E5-2667v4, 4CPU 8GB RAM 两台.
软件环境: Ubuntu x64 16.04.5, Java HotSpot(TM) 64-Bit Server VM 9.0.4+11.
启动参数: java -server -Xmx1g -Xms1g -XX:MaxDirectMemorySize=1g -XX:+UseG1GC.
existUser 判断某个 email 是否存在
| framework |
thrpt (ops/ms) |
avgt (ms) |
p90 (ms) |
p99 (ms) |
p999 (ms) |
| turbo-rpc |
107.05 |
0.28 |
0.40 |
0.87 |
4.06 |
| netty |
99.81 |
0.32 |
0.40 |
0.52 |
1.16 |
| jupiter |
73.07 |
0.44 |
0.66 |
1.49 |
2.92 |
| undertow |
70.38 |
0.45 |
1.16 |
2.17 |
32.48 |
| turbo-rest |
68.49 |
0.44 |
1.17 |
2.15 |
25.66 |
| undertow-async |
62.65 |
0.49 |
1.14 |
2.41 |
24.84 |
| dubbo-kryo |
57.35 |
0.53 |
0.67 |
1.02 |
11.65 |
| rapidoid |
52.96 |
0.61 |
1.32 |
2.51 |
25.07 |
| dubbo |
52.12 |
0.54 |
0.67 |
0.92 |
3.93 |
| motan |
44.96 |
0.71 |
1.15 |
2.47 |
33.39 |
| aeron |
43.46 |
0.90 |
1.32 |
5.10 |
14.29 |
| grpc |
38.97 |
0.84 |
1.07 |
1.31 |
6.06 |
| thrift |
27.25 |
1.59 |
0.16 |
64.87 |
122.83 |
| hprose |
26.24 |
1.26 |
1.53 |
2.01 |
8.34 |
| springwebflux |
22.39 |
1.42 |
2.27 |
3.19 |
17.20 |
| springboot |
12.54 |
1.68 |
2.38 |
13.63 |
33.20 |
createUser 添加一个 User
| framework |
thrpt (ops/ms) |
avgt (ms) |
p90 (ms) |
p99 (ms) |
p999 (ms) |
| turbo-rpc |
84.95 |
0.39 |
0.50 |
1.45 |
4.01 |
| netty |
76.45 |
0.48 |
0.49 |
0.79 |
1.87 |
| jupiter |
64.57 |
0.50 |
0.68 |
1.37 |
2.79 |
| undertow |
62.47 |
0.51 |
1.17 |
2.76 |
20.10 |
| turbo-rest |
58.21 |
0.57 |
1.23 |
2.84 |
22.35 |
| undertow-async |
56.19 |
0.59 |
1.36 |
3.73 |
24.50 |
| dubbo-kryo |
42.37 |
0.72 |
0.94 |
1.33 |
16.75 |
| motan |
42.16 |
0.79 |
1.23 |
2.39 |
30.97 |
| grpc |
41.56 |
0.77 |
0.93 |
1.24 |
4.41 |
| aeron |
37.74 |
0.89 |
1.35 |
3.85 |
22.98 |
| dubbo |
28.75 |
1.13 |
1.42 |
1.82 |
16.06 |
| thrift |
25.66 |
1.47 |
0.17 |
68.71 |
130.93 |
| hprose |
23.30 |
1.31 |
1.44 |
2.28 |
13.36 |
| rapidoid |
18.54 |
1.73 |
1.27 |
25.10 |
40.47 |
| springwebflux |
10.51 |
1.50 |
2.33 |
3.37 |
21.30 |
| springboot |
9.43 |
1.75 |
2.57 |
12.81 |
24.90 |
getUser 根据 id 获取一个用户
| framework |
thrpt (ops/ms) |
avgt (ms) |
p90 (ms) |
p99 (ms) |
p999 (ms) |
| turbo-rpc |
95.92 |
0.38 |
0.49 |
1.52 |
2.96 |
| jupiter |
63.61 |
0.52 |
0.74 |
1.37 |
2.50 |
| netty |
63.44 |
0.44 |
0.50 |
0.55 |
0.97 |
| undertow-async |
57.50 |
0.58 |
1.23 |
2.32 |
5.02 |
| undertow |
55.70 |
0.55 |
1.32 |
2.54 |
11.60 |
| turbo-rest |
53.34 |
0.59 |
1.49 |
2.72 |
23.69 |
| dubbo-kryo |
46.44 |
0.69 |
0.85 |
1.16 |
18.09 |
| rapidoid |
43.84 |
0.74 |
1.99 |
4.78 |
18.35 |
| grpc |
41.58 |
0.75 |
0.90 |
1.19 |
4.57 |
| motan |
40.62 |
0.78 |
1.25 |
2.68 |
34.18 |
| dubbo |
29.11 |
1.11 |
1.44 |
1.98 |
16.73 |
| thrift |
27.14 |
1.74 |
0.19 |
0.29 |
362.63 |
| hprose |
23.91 |
1.40 |
1.56 |
2.31 |
47.06 |
| springwebflux |
19.24 |
1.67 |
2.70 |
3.62 |
14.94 |
| springboot |
18.71 |
1.70 |
2.17 |
14.76 |
31.09 |
| aeron |
18.25 |
1.71 |
3.94 |
13.15 |
63.77 |
listUser 获取用户列表
| framework |
thrpt (ops/ms) |
avgt (ms) |
p90 (ms) |
p99 (ms) |
p999 (ms) |
| turbo-rpc |
44.53 |
0.82 |
1.37 |
2.85 |
10.39 |
| grpc |
30.67 |
1.05 |
1.31 |
1.68 |
15.12 |
| undertow |
28.38 |
1.21 |
1.72 |
4.49 |
23.25 |
| motan |
28.08 |
1.13 |
1.80 |
3.22 |
21.56 |
| undertow-async |
28.05 |
1.16 |
1.76 |
6.75 |
20.91 |
| jupiter |
26.59 |
1.20 |
2.00 |
4.04 |
25.00 |
| netty |
24.28 |
1.29 |
1.35 |
1.83 |
5.97 |
| rapidoid |
20.73 |
1.56 |
3.29 |
16.50 |
29.89 |
| dubbo-kryo |
19.55 |
1.69 |
2.36 |
3.37 |
16.85 |
| turbo-rest |
17.56 |
2.17 |
2.67 |
17.02 |
37.50 |
| springwebflux |
16.21 |
2.00 |
3.13 |
4.90 |
17.66 |
| springboot |
15.84 |
2.16 |
2.72 |
16.81 |
36.64 |
| thrift |
14.87 |
2.61 |
0.26 |
0.42 |
518.96 |
| hprose |
13.19 |
2.70 |
2.85 |
4.01 |
54.52 |
| aeron |
4.53 |
7.13 |
10.42 |
16.47 |
30.30 |
| dubbo |
4.52 |
7.04 |
9.06 |
12.52 |
16.02 |
免责声明
- 能力所限错误在所难免, 本测试用例及测试结果仅供参考.
- 如果你认为xx框架的代码或配置存在问题，那么欢迎发起Pull Request.
- 利益相关: 本测试用例作者同时为 turbo, undertow-async 的作者.
