Medium上的這篇文章介紹了作者學(xué)習(xí)系統(tǒng)架構(gòu)的一些在線資源蕾殴,可以幫助架構(gòu)設(shè)計的初學(xué)者盡快了解架構(gòu)的基本設(shè)計原則员舵,了解常見場景的設(shè)計方案棒仍。原文:System Architecture — System Design Materials[1]
子曰:“工欲善其事必先利其器”讯柔。
今天通過這篇文章跟大家分享一些系統(tǒng)架構(gòu)設(shè)計方面的學(xué)習(xí)資料抡蛙,讓我們一起成長。
System Design Tips and Introduction (中文, Youtube)[2]
The System Design Primer (中文/英文, Github)[3]
Intro to Architecture and Systems Design Interviews (英文, Youtube)[4]
Designing Data-Intensive Applications: The Big Ideas Behind Reliable, Scalable, and Maintainable Systems (中文版《數(shù)據(jù)密集型應(yīng)用系統(tǒng)設(shè)計》, Book)[5][6]
system design interview questions (英文, Github)[7]
System Design Interview – Step By Step Guide (英文, Youtube)[8]
Distributed Systems (英文, Book)[9]
Distributed systems for fun and profit (英文, Book)[10]
6.824: Distributed Systems (英文, Course)[11]
Concurrent and Distributed Systems (英文, Course)[12]
15-440: Distributed Systems Syllabus (英文, Course)[13]
CS244b: Distributed Systems (英文, Course)[14]
CSE 490H: Distributed Systems (英文, Course)[15]
Apache Hadoop (Open source, Github)[16]
SeaweedFS (Open source, Github)[17]
MinIO (Open source, Github)[18]
TiDB (Open source, Github)[19]
etcd (Open source, Github)[20]
Apache ZooKeeper (Open source, Github)[21]
Apache Spark (Open source, Github)[22]
Apache Flink (Open source, Github)[23]
Ray (Open source, Github)[24]
Notes on Distributed Systems for Young Bloods (英文, Blog)[25]
Distributed systems theory for the distributed systems engineer (英文, Blog)[26]
分布式系統(tǒng) (中文, Blog)[27]
Distributed Systems Reading Group (英文, Paper)[28]
awesome-distributed-systems (英文, Github)[29]
Grokking the System Design Interview (英文, Course)[30]
Tech Dummies Narendra L (英文, Youtube)[31]
Design video sharing platform (英文, Blog)[32]
System Design Basics (英文, Youtube)[33]
code karle (英文, Youtube)[34]
System Design Introduction For Interview (英文, Youtube)[35]
Distributed Systems (英文, Youtube)[36]
System Design (中文, Gitbook)[37]
CS6213 Special Topics in Distributed Computing (英文, Course)[38]
分布式系統(tǒng)
- 基本問題: 時間問題磷杏,一致性問題溜畅,容錯技術(shù),共識算法极祸,并發(fā)控制
- 基本定理: CAP, PACELC, FLP
CAP theorem (英文, Wikipedia)[39]
PACELC theorem (英文, Wikipedia)[40]
Consensus (英文, Wikipedia)[41]
- 生產(chǎn)系統(tǒng): MapReduce, Spark, GFS, Dynamo和Cosmos
MapReduce (英文, Wikipedia)[42]
Apache Spark (英文, Wikipedia)[43]
Google File System (英文, Wikipedia)[44]
Dynamo (英文, Wikipedia)[45]
Cosmos (英文, Wikipedia)[46]
系統(tǒng)架構(gòu)設(shè)計需要考慮的問題
- 可靠性(Reliable)
- 可擴展性(Scalable)
- 可維護性(Maintainable)
- 存儲與檢索(Storage and Retrieval)
- 冗余備份(Redundancy/Replication)
- 分片分區(qū)(Fragmentation/Partition)
- 事務(wù)(Transactions)
- 一致性(Consistency)
- 共識(Consensus)
- 批處理/流處理(Batch processing/stream processing)
如何準備系統(tǒng)設(shè)計面試
- 找相關(guān)的博客學(xué)習(xí)
- 坦率的說,面試不會問得非常深入怠晴,不過如果有機會解釋清楚遥金,就能給面試官留下更好的印象
- 試著設(shè)計一些東西,寫下功能性/非功能性的需求蒜田,畫出設(shè)計圖稿械、數(shù)據(jù)流、流程流冲粤,并考慮商業(yè)模型從而幫助系統(tǒng)盈利美莫,并考慮如何各個組件如果崩潰需要如何處理。
- 明確設(shè)計的取舍
- 保持自信
- 不要試圖炫耀梯捕,你可能只是了解了某一方面厢呵,但其他方面你并不了解。
- 注意觀察面試官傀顾,如果發(fā)現(xiàn)面試官對這部分不感興趣襟铭,就不要花太多時間。
- 不要輕易放棄自己的意見短曾,面試官質(zhì)疑候選人是常規(guī)操作寒砖。不要因為面試官的挑戰(zhàn)、質(zhì)疑就覺得自己錯了嫉拐。
References:
[1] System Architecture — System Design Materials: https://jinlow.medium.com/system-architecture-system-design-materials-52705af6c155
[2] System Design Tips and Introduction: https://youtu.be/th_73AVA4dY?list=PLAd5bt5mn3V3TrrJFBpnu4PH9e8KZMvNA
[3] The System Design Primer: https://github.com/donnemartin/system-design-primer
[4] Intro to Architecture and Systems Design Interviews: https://youtu.be/ZgdS0EUmn70
[5] Designing Data-Intensive Applications: The Big Ideas Behind Reliable, Scalable, and Maintainable Systems: https://www.amazon.com/Designing-Data-Intensive-Applications-Reliable-Maintainable/dp/1449373321
[6] 數(shù)據(jù)密集型應(yīng)用系統(tǒng)設(shè)計: https://book.douban.com/subject/30329536/
[7] system design interview questions: https://github.com/jaychsu/FreemanZhang-system-design
[8] System Design Interview – Step By Step Guide: https://youtu.be/bUHFg8CZFws
[9] Distributed Systems: https://www.distributed-systems.net/index.php/books/ds3/
[10] Distributed systems for fun and profit: http://book.mixu.net/distsys/index.html
[11] 6.824: Distributed Systems: https://pdos.csail.mit.edu/6.824/schedule.html
[12] Concurrent and Distributed Systems: https://www.cl.cam.ac.uk/teaching/2021/ConcDisSys/materials.html
[13] 15-440: Distributed Systems Syllabus: https://www.cs.cmu.edu/~dga/15-440/S14/syllabus.html
[14] CS244b: Distributed Systems: http://www.scs.stanford.edu/20sp-cs244b/
[15] CSE 490H: Distributed Systems: https://courses.cs.washington.edu/courses/cse490h/11wi/
[16] Apache Hadoop: https://github.com/apache/hadoop
[17] SeaweedFS: https://github.com/chrislusf/seaweedfs
[18] MinIO: https://github.com/minio/minio
[19] TiDB: https://github.com/pingcap/tidb
[20] etcd: https://github.com/etcd-io/etcd
[21] Apache ZooKeeper: https://github.com/apache/zookeeper
[22] Apache Spark: https://github.com/apache/spark
[23] Apache Flink: https://github.com/apache/flink
[24] Ray: https://github.com/ray-project/ray
[25] Notes on Distributed Systems for Young Bloods: https://www.somethingsimilar.com/2013/01/14/notes-on-distributed-systems-for-young-bloods/
[26] Distributed systems theory for the distributed systems engineer: https://www.the-paper-trail.org/post/2014-08-09-distributed-systems-theory-for-the-distributed-systems-engineer/
[27] 分布式系統(tǒng): https://www.qtmuniao.com/categories/%E5%88%86%E5%B8%83%E5%BC%8F%E7%B3%BB%E7%BB%9F/
[28] Distributed Systems Reading Group: http://dsrg.pdos.csail.mit.edu/papers/
[29] awesome-distributed-systems: https://github.com/theanalyst/awesome-distributed-systems
[30] Grokking the System Design Interview: https://www.educative.io/courses/grokking-the-system-design-interview?affiliate_id=5749180081373184
[31] Tech Dummies Narendra L: https://www.youtube.com/channel/UCn1XnDWhsLS5URXTi5wtFTA
[32] Design video sharing platform: https://leetcode.com/discuss/interview-question/system-design/496042/Design-video-sharing-platform-like-Youtube
[33] System Design Basics: https://youtu.be/xpDnVSmNFX0?list=PLMCXHnjXnTnvo6alSjVkgxV-VH6EPyvoX
[34] code karle: https://www.youtube.com/channel/UCZEfiXy7PmtVTezYUvc4zZw
[35] System Design Introduction For Interview: https://youtu.be/UzLMhqg3_Wc?list=PLrmLmBdmIlps7GJJWW9I7N0P0rB0C3eY2
[36] Distributed Systems: https://youtu.be/UEAMfLPZZhE?list=PLeKd45zvjcDFUEv_ohr_HdUFe97RItdiB
[37] System Design: https://xunhuanfengliuxiang.gitbooks.io/system-desing/content/
[38] CS6213 Special Topics in Distributed Computing: https://ilyasergey.net/CS6213/index.html
[39] CAP theorem: https://en.wikipedia.org/wiki/CAP_theorem
[40] PACELC theorem: https://en.wikipedia.org/wiki/PACELC_theorem
[41] Consensus: https://en.wikipedia.org/wiki/Consensus_%28computer_science%29
[42] MapReduce: https://en.wikipedia.org/wiki/MapReduce
[43] Apache Spark: https://en.wikipedia.org/wiki/Apache_Spark
[44] Google File System: https://en.wikipedia.org/wiki/Google_File_System
[45] Dynamo: https://en.wikipedia.org/wiki/Dynamo_%28storage_system%29
[46] Cosmos: https://en.wikipedia.org/wiki/Cosmos_%28operating_system%29
你好哩都,我是俞凡,在Motorola做過研發(fā)婉徘,現(xiàn)在在Mavenir做技術(shù)工作漠嵌,對通信咐汞、網(wǎng)絡(luò)、后端架構(gòu)献雅、云原生碉考、DevOps、CICD挺身、區(qū)塊鏈侯谁、AI等技術(shù)始終保持著濃厚的興趣,平時喜歡閱讀章钾、思考墙贱,相信持續(xù)學(xué)習(xí)、終身成長贱傀,歡迎一起交流學(xué)習(xí)惨撇。
微信公眾號:DeepNoMind