Introduction

Week 1 Slides: Introduction to Distributed Systems (6 MB)
Dist Systems startups in 2024
CTOs guidebook: 6 companies leading the Dist Systems
The World’s Biggest Cloud Computing Service Providers
Video: Inside Amazon's Massive Data Center
Tutorial 1

Week 2 Slides: Dist Sys Design & Architecture (4.5 MB)
S. M. Thampi ,"Introduction to Distributed Systems", arXiv:0911.4395, 2009.
Introduction to Distributed System Design - Google Code University
Video: Inside the World's Largest AI Supercluster xAI Colossus
Tutorial 2

Parallel Computing

Week 3 Slides: Parallel Processing (5.6 MB)
Parallel Processing | Overview, Limits & Examples
Video: Moores law; a visual explanation
JavaPoint ForkJoin Tutorial
Tutorial 3

Week 4 Slides: Parallel Processing contd. (2.9 MB)
MapReduce: Simplified Data Processing on Large Clusters
Video: An Introduction to MapReduce framework
What is Mapreduce?
Mastering MapReduce: A Step-by-Step guide

Assignment 1 statement

Communications in Dist Systems

Week 5 Slides: Communication (3.5 MB)
IBM what is networking?
An intro to Java Socket programming
Socket programming in python: How to?
Video: How Sockets Actually Work – From Your Browser to the Backend; ByteMonk Intro.
Tutorial 4

Week 6 Slides: Communication -> RPC (2.6 MB)
Demystifying Remote Procedure Calls (RPC)
What’s the Difference Between RPC and REST?
The Java Remote Method Invocation API (Java RMI)
Video: What is googleRPC? ByteByteGo tutorial.
Tutorial 5

Assignment 2: Posted on LMS

Week 7 Slides: Communication Models (3.5 MB)
A Summary of Week 7 Communication Models
Amazon: What is publish/subscribe messaging?
PyNetLabs: What is Multicast Routing in Computer Networks?
Cleo: What are webservices? a quick overview
Webservices tutorials
Video: RESTful APIs in 100 Seconds with Node.js Express.

Evaluating Dist Systems

Week 8 Slides: Apache Hadoop (3.5 MB)
Video: IBM Technologies; What is Apache Hadoop?
Video: Hadoop Ecosystem Architecture And Components | Simplilearn

Worksheet 1: Setting up Hadoop VM on a single machine
Worksheet 2: Setting up a Hadoop VM cluster for 3 nodes

Video playlist: Setting up a Hadoop VM cluster for 3 nodes

Downloadable binaries/ISOs (Large files - local access only)

Course Project statement

Core concepts

Week 9 Slides: Replication and Fault Tolerance (3.4 MB)
The two generals problem
Blockchain, a solution to byzantine generals problem?
A complete history of Amazon outages
Video: Byzantine Fault Tolerance in Blockchain: A Binance Tutorial

Midterm Exam this week!

Week 10 Slides: Clocks & Synchronization (5.8 MB)
How NTP works?
G Manepali, Clocks and Causality - Ordering Events in Distributed Systems
Video: NASA' Clock Synchronization Techniques for Distributed Systems
Tutorial 6

Week 11 Slides: Dist Mutual Exclusion & Consensus Algorithms (4.6 MB)
A visual guide to understanding Raft.
Raft Github Repo
Paxos vs Raft: Have we reached consensus on distributed consensus?
Tutorial 7


Assignment 3: Posted on LMS


Week 12 Slides: Consistency and Distributed Transactions
2PC vs 3PC, a comparison
Eric Brewer, Spanner, TrueTime & The CAP Theorem
Adrian Booth: Designing Data Intensive Applications: Consistency with Linearizability
Video: CAP Theorem Explained in 5 minutes

Week 13 Slides: Distributed File Systems
Video: The enduring legacy of Google File System (GFS)
Dean Hildebrand, Denis Serenyi, "GFS++: Colossus under the hood"
P Macko and J Hennessey, "Survey of Distributed File System Design Choices", ACM Transactions on Storage, Vol 18, No 1, 2022.
Pan et. al., Navigating the Landscape of Distributed File Systems: Architectures, Implementations, and Considerations

Week 14 Slides: Security in Dist Systems
Securing distributed systems: A survey on access control techniques for cloud, blockchain, IoT and SDN
IBM Blockchain security

AI and Distributed Systems

DATA CENTERS IN THE AGE OF AI: A TUTORIAL SURVEY ON INFRASTRUCTURE, SUSTAINABILITY, AND EMERGING CHALLENGES

Federated Computing - Survey on Building Blocks, Extensions and Systems

Platforms, Tools and applications

Apache Spark and its applications: Amazon AWS, IBM, Google, Microsoft.
Docker platform: docker.docs, IBM docker.
Kubernetes: Overview, Google K8s.
Spanner: Google’s Globally Distributed Database
Distributed Databases: HBase Amazon Hbase, IBM Hbase.
Apache Cassandra