项目 PokemonGo Map


该项目改进于BitTiger.io的一个课程项目,实现后端分布式爬虫和前端数据显示。

System Architecture


A distributed crawler system that achieves heuristic data crawling based on geographical location information, said system comprising:

  1. A web app sends network requests with said geographical locations information to an API gateway,
  2. An API gateway subsystem constructed by said API gateways, routes said requests to a query cluster,
  3. A query subsystem constructed by said query cluster, queries for Pokemons data based on said geographical locations information from a database on AWS, and returns said Pokemon data to said web app, and sends said geographical locations information to message queues,
  4. A message queue subsystem constructed from said message queues, stores said messages from said query subsystem, and provides said messages to a crawler cluster
  5. A crawler subsystem constructed by said crawler cluster, retrieves said geographical locations information from said message queue subsystem, and gets fake Pokemons data from a mock Pokemon go API, and saves said fake Pokemons data to a database,
  6. A database subsystem constructed by said database, stores said Pokemons data.
最后编辑于
©著作权归作者所有,转载或内容合作请联系作者
平台声明:文章内容(如有图片或视频亦包括在内)由作者上传并发布,文章内容仅代表作者本人观点,简书系信息发布平台,仅提供信息存储服务。

推荐阅读更多精彩内容

  • 为人子女,在父母需要的时候, 我在这,在这遥远的角落。 作为朋友,在他人需要的时候, 我在这,在这遥远的沉默。 ...
    如夢2030阅读 182评论 1 0
  • 图解“秀色可餐” 秀色 文解“秀色可餐”: 一:有了美景美色,精神就可以像吃了美食一样愉悦了,也就忘掉饥饿,不会想...
    冰红茶麻麻阅读 1,111评论 7 18
  • 思念的感觉会因为触碰到什么而萌芽,随之爆发!慰寂的方式无非就是打打电话,通个视频什么的,尽扯些无关重要的事情,最重...
    小南爱妈妈阅读 299评论 0 0
  • 一方天地写春秋, 谁言壮志难酬? 风风雨雨几回休? 名利堪愁。 蜡炬成灰不悔, 春蚕丝尽无忧。 但求桃李笑盈眸, ...
    繁花落尽深眸阅读 354评论 8 11