各种深度学习工具对比

参考文献《Benchmarking State-of-the-Art Deep Learning Software Tools》

软件:Caffe, CNTK, TensorFlow and Torch。

软件对比:

测试代码:http://www.comp.hkbu.edu.hk/~chxw/dlbench/index.html 

Caffe: Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell, “Caffe: Convolutional architecture for fast feature embedding” inProceedings of the 22nd ACM international conference on Multimedia, 2014, pp. 675–678.

CNTK: D. Yu, A. Eversole, M. Seltzer, K. Yao, Z. Huang, B. Guenter, O. Kuchaiev, Y. Zhang, F. Seide, H. Wanget al., “An introduction to computational networks and the computational network toolkit” Technical report, Tech. Rep. MSR, Microsoft Research, 2014, 2014. research. microsoft. com/apps/pubs, Tech. Rep., 2014.

Tensorflow: M. Abadi, A. Agarwal, P. Barham, E. Brevdo, Z. Chen, C. Citro, G. S. Corrado, A. Davis, J. Dean, M. Devinet al., “Tensorflow: Large scale machine learning on heterogeneous systems, 2015” Software available from tensorflow. org, vol. 1, 2015.

Torch: R. Collobert, K. Kavukcuoglu, and C. Farabet, “Torch7: A matlab like environment for machine learning” inBigLearn, NIPS Workshop, no. EPFL-CONF-192376, 2011.

矩阵计算:

Tensorflow -> Eigen

Caffe, CNTK, Torch -> OpenBlas

结论:

(1) In general, all tools do not scale well on many-core CPUs. The performance using 16 CPU cores is only slightly better than using 4 CPU cores.

(2) For FCNs and CNNs, all tools can achieve significant speedup by using contemporary GPUs. With GPUs, Caffe performs the best on FCNs while TensorFlow performs the best on CNNs.

(3) For RNNs, Torch and TensorFlow can achieve much better performance than CNTK on GPU. But on the other hand CNTK performs much better than Torch and TensorFlow on CPU.

(4) Among the three GPU platforms, GTX1080 always performs the best.

最后编辑于 :
©著作权归作者所有,转载或内容合作请联系作者
【社区内容提示】社区部分内容疑似由AI辅助生成,浏览时请结合常识与多方信息审慎甄别。
平台声明:文章内容(如有图片或视频亦包括在内)由作者上传并发布,文章内容仅代表作者本人观点,简书系信息发布平台,仅提供信息存储服务。

相关阅读更多精彩内容

  • 我们了解自己的性格么?有没有容易发怒,冲动,口气不善的?不是想发怒,而是不易控制,先发了脾气再后悔的,这就是对...
    清茶半杯阅读 923评论 0赞 0
  • 话说,自唐僧师徒西天取经之后,各回各的家…… 唐僧做起了讲师,四处奔波授学。孙悟空回到花果山,继续当大王,还娶了他...
    箜小梵阅读 600评论 3赞 4
  • 一天,火热的一天 激情的六月 花的海洋, 童歌的校园, 我们难分难舍, 难忘的今天, 快乐的日子, 我们挥挥手, ...
    宏昌居士123阅读 276评论 2赞 11
  • 对于一些自称「食客」、「吃货」的人来说,总是有些东西需要去讲究的,我们讲究「镬气」,讲究「新鲜」,讲究「陈酿」,讲...
    Nesier无恙阅读 630评论 1赞 51

友情链接更多精彩内容