Reading Group

  • Reading Group. Heterogeneity-Aware Cluster Scheduling Policies for Deep Learning Workloads

    ·

    Placeholder Icon

    On Wednesday we were discussing scheduling in large distributed ML/AI systems. Our main paper was the “Heterogeneity-Aware Cluster Scheduling Policies for Deep Learning Workloads.” one from OSDI’20. However, it was a bit outside of our group’s comfort zone (outside of my comfort zone for sure). Luckily we had an extensive presentation with a complete background…

    Read More

  • Reading Group. FlightTracker: Consistency across Read-Optimized Online Stores at Facebook

    ·

    Placeholder Icon

    Last DistSys Reading Group we have discussed “FlightTracker: Consistency across Read-Optimized Online Stores at Facebook.” This paper is about consistency in Facebook’s TAO caching stack. TAO is a large social graph storage system composed of many caches, indexes, and persistent storage backends. The sheer size of Facebook and TAO makes it difficult to enforce meaningful…

    Read More

  • Reading Group Paper List. Papers ##51-60.

    ·

    Placeholder Icon

    With just four more papers to go in the DistSys Reading Group’s current batch, it is time to get the next set going. This round, we will have 10 papers that should last till the end of the spring semester. Our last batch was all about OSDI’20 papers, and this time around we will mix…

    Read More

  • Reading Group. Pegasus: Tolerating Skewed Workloads in Distributed Storage with In-Network Coherence Directories

    ·

    Placeholder Icon

    Hard to imagine, but the reading group just completed the 45th session. We discussed “Pegasus: Tolerating Skewed Workloads in Distributed Storage with In-Network Coherence Directories,” again from OSDI’20. Pegasus is one of these systems that are very obvious in the hindsight. However, this “obviousness” is deceptive — Dan Ports, one of the authors behind the…

    Read More

  • Reading Group. Performance-Optimal Read-Only Transactions

    ·

    Placeholder Icon

    Last meeting we looked at “Performance-Optimal Read-Only Transactions” from OSDI’20. This paper covers important topics of transactional reads in database/data-management systems. In particular, the paper discusses “one-shot” read-only transactions that complete in 1 network round-trip-time (RTT) without blocking and bloated and expensive messages. If this sounds too good to be true, it is. Before presenting…

    Read More

  • Reading Group. Microsecond Consensus for Microsecond Applications

    ·

    Placeholder Icon

    Our 43rd reading group paper was about an extremely low-latency consensus using RDMA: “Microsecond Consensus for Microsecond Applications.” The motivation is pretty compelling — if you have a fast application, then you need fast replication to make your app reliable without holding it back. How fast are we talking here? Authors go for ~1 microsecond…

    Read More

  • Reading Group. Cobra: Making Transactional Key-Value Stores Verifiably Serializable.

    ·

    Placeholder Icon

    This Wednesday, we were talking about serializability checking of production databases. In particular, we looked at the recent OSDI’20 paper: “Cobra: Making Transactional Key-Value Stores Verifiably Serializable.” The paper explores the problem of verifying serializability in a black-box production system from a client point of view. This makes sense as serializability is an operational, client-observable…

    Read More

  • Reading Group. A large scale analysis of hundreds of in-memory cache clusters at Twitter.

    ·

    Placeholder Icon

    In the 41st distributed systems reading group meeting, we have looked at in-memory caches through the lens of yet another OSDI20 paper: “A large scale analysis of hundreds of in-memory cache clusters at Twitter.” This paper explores various cache usages at Twitter and distills the findings into a digestible set of figures. I found the…

    Read More

  • Reading Group. Virtual Consensus in Delos

    ·

    Placeholder Icon

    We are continuing through the OSDI 2020 paper list in our reading group. This time we have discussed “Virtual Consensus in Delos,” a consensus paper (Delos is yet another greek island to continue the consensus naming tradition). Delos relies on the log abstraction to keep track of all commands/operations and their order. Traditionally, some consensus…

    Read More

  • Reading Group. hXDP: Efficient Software Packet Processing on FPGA NICs

    ·

    Placeholder Icon

    Last reading group meeting we have discussed “hXDP: Efficient Software Packet Processing on FPGA NICs.” This paper talks about using FPGA NICs to offload some CPU cycles doing certain routine packet processing tasks. In particular, the paper implements XDP purely in FPGA and achieves a performance similar to that of a single x86 CPU core.…

    Read More