有点沮丧,高峰期SQOOP/Hive/Hadoop源码级维护,都忘得一干二净。
开这遍主要是记住相关技术:
YARN:
http://geekdirt.com/blog/introduction-and-working-of-yarn/
hbase:
http://hbasefly.com/2016/07/13/hbase-compaction-1/
https://community.hortonworks.com/content/supportkb/229958/how-to-tune-hbase-compaction-processes.html
http://www.cnblogs.com/yanzibuaa/p/7526500.html
https://blog.csdn.net/javastart/article/details/69666455
Spark:
https://0x0fff.com/spark-architecture-shuffle/
https://www.cnblogs.com/itboys/p/9201750.html
http://www.leonlu.cc/profession/19-spark-shuffle/
https://docs.cloudera.com/runtime/7.2.10/yarn-reference/topics/yarn-fs-cs-features.html
数据湖产品对比:
https://www.infoq.cn/article/fjebconxd2sz9wloykfo