LinkedIn - A highly scalable Architecture on Java!

•

86 likes•13,498 views

The document summarizes the evolution of LinkedIn's communication platform and network updates system from handling 0 to 23 million members. It describes how the initial communication platform was built on Java and used technologies like Tomcat, ActiveMQ, and Spring. It then discusses how the network updates system transitioned from a pull-based to push-based architecture to more efficiently distribute updates across the growing user base. Key challenges addressed in scaling the systems included partitioning data and services, optimizing database usage, and building for asynchronous flows and failure handling.

Technology

LINKEDIN COMMUNICATION ARCHITECTURE ,[object Object]

Learn how LinkedIn built and evolved scalable communication platform for the world’s largest professional network

Agenda ,[object Object],[object Object],[object Object],[object Object],[object Object]

Communication Platform – The Numbers ,[object Object],[object Object],[object Object],[object Object]

Communication Platform – The Setup ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Communication Platform – Overview ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Communication Service ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Network Updates Service – Motivation ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Network Updates Service – Motivation ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Network Updates Service – Iteration 1 API

Network Updates Service – Iteration 1 API ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Network Updates Service – Iteration 1 ,[object Object],[object Object],[object Object],[object Object],[object Object]

Network Updates Service – Iteration 2 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Network Updates Service – Iteration 2 (Push)

Network Updates Service – Iteration 2 (Read)

Network Updates Service – Iteration 2 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Network Updates Service – Iteration 2 ,[object Object],[object Object],[object Object],[object Object]

Network Updates Service – JMX Monitoring ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

JMX Interface – Network Updates Configuration

Network Updates Service – Iteration 3 ,[object Object],[object Object],[object Object],[object Object]

Network Updates Service – Iteration 3 ,[object Object],[object Object],[object Object]

Scaling the system ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

LinkedIn Spring Extensions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

What's hot

Kafka Streams: What it is, and how to use it?confluent

Apache Kafka Architecture & Fundamentals Explainedconfluent

Deploy 22 microservices from scratch in 30 mins with GitOpsOpsta

Building Event Driven Architectures with Kafka and Cloud Events (Dan Rosanova...confluent

SingleStore & Kafka: Better Together to Power Modern Real-Time Data Architect...HostedbyConfluent

Best Practices for Streaming IoT Data with MQTT and Apache KafkaKai Wähner

Kafka 101Clement Demonchy

Frame - Feature Management for Productive Machine LearningDavid Stein

Integrating with salesforce using platform eventsAmit Chaudhary

Microservicios dirigidos por eventos con AxonChristian Vermorken

Streaming Data and Stream Processing with Apache Kafkaconfluent

Introduction to MicroservicesAmazon Web Services

Kafka streams windowing behind the curtain confluent

Nagiosguest7e7e305

Soluciones DynatraceInnovation Strategies

FIWARE Connecting to IoTfisuda

Event driven architectureShadrach Jabonir

Grafana introductionRico Chen

Data Streaming with Apache Kafka in the Defence and Cybersecurity IndustryKai Wähner

Disaster Recovery with MirrorMaker 2.0 (Ryanne Dolan, Cloudera) Kafka Summit ...confluent

What's hot (20)

Kafka Streams: What it is, and how to use it?

Apache Kafka Architecture & Fundamentals Explained

Deploy 22 microservices from scratch in 30 mins with GitOps

Building Event Driven Architectures with Kafka and Cloud Events (Dan Rosanova...

SingleStore & Kafka: Better Together to Power Modern Real-Time Data Architect...

Best Practices for Streaming IoT Data with MQTT and Apache Kafka

Kafka 101

Frame - Feature Management for Productive Machine Learning

Integrating with salesforce using platform events

Microservicios dirigidos por eventos con Axon

Streaming Data and Stream Processing with Apache Kafka

Introduction to Microservices

Kafka streams windowing behind the curtain

Nagios

Soluciones Dynatrace

FIWARE Connecting to IoT

Event driven architecture

Grafana introduction

Data Streaming with Apache Kafka in the Defence and Cybersecurity Industry

Disaster Recovery with MirrorMaker 2.0 (Ryanne Dolan, Cloudera) Kafka Summit ...

Recently uploaded (20)

Understanding the Laravel MVC Architecture

From Event to Action: Accelerate Your Decision Making with Real-Time Automation

Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...

Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...

#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024

SQL Database Design For Developers at php[tek] 2024

The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf

Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024

A Call to Action for Generative AI in 2024

08448380779 Call Girls In Greater Kailash - I Women Seeking Men

Salesforce Community Group Quito, Salesforce 101

IAC 2024 - IA Fast Track to Search Focused AI Solutions

How to Troubleshoot Apps for the Modern Connected Worker

Google AI Hackathon: LLM based Evaluator for RAG

Maximizing Board Effectiveness 2024 Webinar.pptx

Finology Group – Insurtech Innovation Award 2024

Breaking the Kubernetes Kill Chain: Host Path Mount

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...

Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...