trait Speaker { val name:String val aliases:Set[String] } trait Organization{ val bu = "tmall" val group = "alibaba" } object WangFuqiang extends Speaker with Organization{ val name = "王福强" val aliases = Set("千任", "@囚千任") val blog = “http://afoo.me” } 架构模式与实践漫谈 Sunday, July 14, 13 Architecture Sunday, July 14, 13 Architecture Principles • Abstraction • Modularity • Scalability • Robustness • Security • Availability • Reusability • name it more... Sunday, July 14, 13 Exciting? Sunday, July 14, 13 Don’t Be Silly! Sunday, July 14, 13 Overload Sunday, July 14, 13 How About Practices + Patterns Sunday, July 14, 13 Roadmap First Sunday, July 14, 13 Consistency Layering Isolation Immutability Clustering Buffering Async Throttling单结点 多结点 Sunday, July 14, 13 Sunday, July 14, 13 So Far, So Good Sunday, July 14, 13 Consistency Layering Caching Isolation Immutability Clustering Async Throttling Sunday, July 14, 13 What we do? Sunday, July 14, 13 Sure, 1. Scale Up!纵 向扩 展 Sunday, July 14, 13 “I try so hard, I got so far...” ‘cause hardware can’t work well without proper software Sunday, July 14, 13 Sunday, July 14, 13 Sunday, July 14, 13 Buffering缓 冲 Sunday, July 14, 13 Queues fucking simple idea, right? Sunday, July 14, 13 Queue Everywhere • cpu task run queue • thread pool task queue • actors’ mailbox • TCP stack send buffer /receive buffer • MOM • etc. Sunday, July 14, 13 Batching 分批处 理 when they slowly move Sunday, July 14, 13 Sunday, July 14, 13 When to batch When to flush Sunday, July 14, 13 Problem With Nagle Algorithm Sunday, July 14, 13 Latency VS. Throughput It’s your choice! Sunday, July 14, 13 Smart Batching focus on the whole pipeline Sunday, July 14, 13 http://mechanical-sympathy.blogspot.com/2011/10/smart- batching.html • Lock-free • 100K+ TPS Sunday, July 14, 13 Disruptor Start 2 use it today Sunday, July 14, 13 --------割-------- Sunday, July 14, 13 Sunday, July 14, 13 Throttling 限流|flow control Sunday, July 14, 13 Rate Control Backpressure Sunday, July 14, 13 Rate Control Sunday, July 14, 13 Semaphore Sunday, July 14, 13 僵硬 灵活 Sunday, July 14, 13 Let’s apply BackPressure Butterfly Effect Sunday, July 14, 13 Sunday, July 14, 13 Sunday, July 14, 13 Sunday, July 14, 13 表征 位置 (反馈 )方式 what where how Back Pressure load, rt, etc. ack, nack, etc.hardware, os, app, etc. Sunday, July 14, 13 --------割-------- Sunday, July 14, 13 2 + 2 = ? Sunday, July 14, 13 Sunday, July 14, 13 Sunday, July 14, 13 Caching缓 存 Sunday, July 14, 13 Why Caching? Sunday, July 14, 13 Sunday, July 14, 13 Cache Everywhere • CPU Level1-3 cache • Browser-side cache • Server-side cache • Business-layer cache • DAL-layer cache • Database-level cache • Reverse Proxy • DNS • Name it more... Sunday, July 14, 13 Cache Types • Local Cache • Map • Ehcache * (BigHeap) • Redis • Remote Cache • Tair * • Memcached • In-Memory Data Grid - IMDG • Coherence • GemFire * means Hybrid Sunday, July 14, 13 Cache Strategy Dimension Synchronous Asynchronous READ Read-Through Refresh-Ahead WRITE Write-Through Write-Behind Sunday, July 14, 13 Caching Tricks • Dummy Value • non-exist entities in storage • Versioning • long-period-cached files K1 K2 K3 K1 K2 K3 K4 K4 K5 K5 Cache Storage file1.v1 file1.v2 index.html <=> file1 Sunday, July 14, 13 Case Study - 支付宝双11预 充值 我爬... 我也爬... 我跟着爬... 我等？！ Sunday, July 14, 13 --------割-------- Sunday, July 14, 13 Async异步 Sunday, July 14, 13 give me the quote of EUR/USD here u are buy 2 lots transaction result Story Background... Sunday, July 14, 13 Future rateQuoteFuture = executor.submit(new Callable() { @Override public Double call() throws Exception { connection.getCurrentValue(USD); } }); try { Double rateQuote = rateQuoteFuture.get(5, TimeUnit.SECONDS); // Blocking wait Future future = executor.submit(new Callable
