No Compromises: Distributed Transactions with Consistency, Availability, and Performance
Transactions with strong consistency and high availability simplify building and reasoning about distributed systems. However, previous implementations performed poorly. This forced system designers to avoid transactions completely, to weaken consistency guarantees, or to provide single machine transactions that require programmers to partition their data. In this paper, we show that there is no need to compromise in modern data centers. We show that a main memory distributed computing platform called FaRM can provide distributed transactions with strict serializability, high performance, durability, and high availability. FaRM achieves a peak throughput of 140 million TATP transactions per second on 90 machines with a 4.9 TB database, and it recovers from a failure in less than 50 ms. Key to achieving these results was the design of new transaction, replication, and recovery protocols from first principles to leverage commodity networks with RDMA and a new, inexpensive approach to providing non-volatile DRAM.
- Séries:
- Cambridge Lab PhD Summer School
- Date:
- Haut-parleurs:
- Aleksandar Dragojevic
-
-
Scarlet Schwiderski-Grosche
Director
-
-
Taille: Cambridge Lab PhD Summer School
-
The Malmo Collaborative AI Challenge
Speakers:- Scarlet Schwiderski-Grosche
-
Counterfactual Multi-Agent Policy Gradients
Speakers:- Scarlet Schwiderski-Grosche
-
Design - On the Human Side
Speakers:- Alex Taylor,
- Scarlet Schwiderski-Grosche
-
Probabilistic Machine Learning and AI
Speakers:- Scarlet Schwiderski-Grosche
-
Policy Gradient Methods: Tutorial and New Frontiers
Speakers:- Scarlet Schwiderski-Grosche
-
Strategic Thinking for Researchers
Speakers:- Andy Gordon,
- Jeff Running
-
How to Write a Great Research Paper
Speakers:- Scarlet Schwiderski-Grosche,
- Simon Peyton Jones
-
Project Malmo – a platform for fundamental AI research
Speakers:- Scarlet Schwiderski-Grosche
-
No Compromises: Distributed Transactions with Consistency, Availability, and Performance
Speakers:- Scarlet Schwiderski-Grosche
-
The Evolution of Innovation
Speakers:- Scarlet Schwiderski-Grosche
-
How to Give a Great Research Talk
Speakers:- Scarlet Schwiderski-Grosche,
- Simon Peyton Jones