Notes

• Getting a million users is infinitely harder than scaling a system to handle a million users. Most systems could run comfortably on a Raspberry Pi

Links

• ​Setting up containers, load balancing, and service discovery on light hardware​

• ​Ask HN: Any recommended resources to develop system thinking? (2018)​

• ​Distributed Systems in One Lesson by Tim Berglund (2017)​

• ​Træfik - Modern HTTP reverse proxy and load balancer that makes deploying microservices easy.

• ​Kit - Standard library for microservices written in Go.

• ​Fear and Loathing in Lock-Free Programming (2017)​

• ​Reliable Systems Series: Model-Based Testing (2018)​

• ​Awesome Distributed Systems​

• ​Kong - Cloud-Native API Gateway & Service Mesh.

• ​Disque - Distributed message broker.

• ​Mesh - Tool for building distributed applications.

• ​Raft - Raft distributed consensus algorithm implemented in Rust.

• ​libp2p specification - Technical specifications for the libp2p networking stack.

• ​Class materials for a distributed systems lecture series​

• ​Raft Consensus Algorithm​

• ​Qri - Global dataset version control system (GDVCS) built on the distributed web.

• ​Project Oak - Meaningful control of data in distributed systems.

• ​mudb - Collection of modules for building realtime client-server networked applications.

• ​Verdi - Framework for formally verifying distributed systems implementations in Coq.

• ​PingCAP Talent Plan - Series of training courses about writing distributed systems in Go and Rust.

• ​Protocol Labs - Build protocols, systems, and tools to improve internet.

• ​Dark Crystal - Open source R&D affinity. Exploring the potential of new and existing technologies in crypto-space to encourage horizontal group collaboration.

• ​Protozoa - Web developers, facilitators, crypto-engineers. Experts in Node.js & distributed systems.

• ​Akka - Build highly concurrent, distributed, and resilient message-driven applications on the JVM.

• ​Distributed Components - Provides reusable infrastructure for formally verifying distributed systems using the Coq proof assistant.

• ​Practical Networked Applications in Rust, Part 1: Non-Networked Key-Value Store (HN)

• ​LF - Fully Decentralized Fully Replicated Key/Value Store.

• ​Awesome Consensus - Curated selection of artisanal consensus algorithms and hand-crafted distributed lock services.

• ​Rezolus - Tool for collecting detailed systems performance telemetry and exposing burst patterns through high-resolution telemetry.

• ​Cadence - Distributed, scalable, durable, and highly available orchestration engine to execute asynchronous long-running business logic in a scalable and resilient way.

• ​Pilosa - Open source, distributed bitmap index that dramatically accelerates queries across multiple, massive data sets.

• ​Finagle - Fault tolerant, protocol-agnostic RPC system.

• ​Distributed - Distributed task scheduler for Dask.

• ​How To Build A Modern Distributed Compute Platform (2018)​

• ​Chaos Monkey - Resiliency tool that helps applications tolerate random instance failures.

• ​Faust - Python Stream Processing.

• ​"Consistency without consensus in production systems" by Peter Bourgon (2014)​

• ​Distributed consensus reading list​