planetary scale

  • Reading Group. Shard Manager: A Generic Shard Management Framework for Geo-distributed Applications

    ·

    Placeholder Icon

    The 97th paper in the reading group was “Shard Manager: A Generic Shard Management Framework for Geo-distributed Applications.” This paper from Facebook talks about a sharding framework used in many of Facebook’s internal systems and applications. Sharding is a standard way to provide horizontal scalability — systems can break down their data into (semi-) independent…

    Read More

  • Planetary-Scale Systems Seminar Spring 2021

    ·

    Placeholder Icon

    This spring semester I am teaching an exciting seminar class: “Planetary-Scale Systems.” I will start the seminar with a 4 lectures long crash course to get my students on the same page, but the bulk of the class will be paper presentations and discussions. The format is similar to the zoom reading group I am…

    Read More

  • Reading Group. Near-Optimal Latency Versus Cost Tradeoffs in Geo-Distributed Storage

    ·

    Placeholder Icon

    Short Summary Yesterday we discussed Pando, a geo-replication system achieving near-optimal latency-cost tradeoff in storage systems. Pando uses large Flexible Paxos deployments and erasure coding to do its magic. Pando relies on having many storage sites to locate sites closer to users. It then uses Flexible Paxos to optimize read and write quorums to have…

    Read More

  • Ocean Vista: Gossip-Based Visibility Control for Speedy Geo-Distributed Transactions

    ·

    Placeholder Icon

    Ocean Vista On Wednesday we had a presentation and discussion of the Ocean Vista (OV) replication and distributed transaction protocol. OV works in the WANs, where each region has all data-partitions, and transactions can originate in any region. OV separates replication from transaction execution, by making replication conflict-free with a FastPaxos-inspired protocol. For the transaction…

    Read More