Publications

« back to main page

See below for a full list of my publications; Google Scholar, however, has all that matters in much more appealing form.

Conference and workshop papers

2019

• GDPR Compliance by Construction
  Malte Schwarzkopf, Eddie Kohler, M. Frans Kaashoek, Robert Morris
  Poly 2019
  
• Learning Scheduling Algorithms for Data Processing Clusters [ACM] [website]
  Hongzi Mao, Malte Schwarzkopf, Shaileshh Bojja Venkatakrishnan, Zili Meng, Mohammad Alizadeh
  SIGCOMM 2019
  
• Towards Multiverse Databases [ACM]
  Alana Marzoev, Lara Timbó Araújo, Malte Schwarzkopf, Samyukta Yagati, Eddie Kohler, Robert Morris, M. Frans Kaashoek, Sam Madden
  HotOS 2019
  
• Variance Reduction for Reinforcement Learning in Input-Driven Environments [arXiv:1807.02264] [videos]
  Hongzi Mao, Shaileshh Bojja Venkatakrishnan, Malte Schwarzkopf, Mohammad Alizadeh
  ICLR 2019
  
• Conclave: secure multi-party computation on big data [ACM] [extended TR (with proofs)] [code]
  Nikolaj Volgushev, Malte Schwarzkopf, Ben Getchell, Andrei Lapets, Mayank Varia, Azer Bestavros
  EuroSys 2019
  

2018

• Noria: dynamic, partially-stateful data-flow for high-performance Web applications [usenix]
  Jon Gjengset*, Malte Schwarzkopf*, Jonathan Behrens, Lara Timbó Araújo, Martin Ek, Eddie Kohler, M. Frans Kaashoek, Robert Morris
  OSDI 2018
  
• Evaluating End-to-End Optimization for Data Analytics Applications in Weld [VLDB]
  Shoumik Palkar, James J. Thomas, Deepak Narayanan, Pratiksha Thaker, Rahul Palamuttam, Parimarjan Negi, Anil Shanbhag, Malte Schwarzkopf, Holger Pirk, Saman Amarasinghe, Samuel Madden, Matei Zaharia
  VLDB 2018
  

2017

• Weld: A Common Runtime for High Performance Data Analytics [CIDR]
  Shoumik Palkar, James J. Thomas, Anil Shanbhag, Deepak Narayanan, Holger Pirk, Malte Schwarzkopf, Saman Amarasinghe, Matei Zaharia
  CIDR 2017
  

2016

• Firmament: fast, centralized cluster scheduling at scale [usenix] [website]
  Ionel Gog, Malte Schwarzkopf, Adam Gleave, Robert N.M. Watson and Steven Hand
  OSDI 2016
  

2015

• Broom: sweeping out Garbage Collection from Big Data systems [usenix]
  Ionel Gog, Jana Giceva, Malte Schwarzkopf, Kapil Viswani, Dimitrios Vytiniotis, Ganesan Ramalingan, Manuel Costa, Derek Murray, Steven Hand and Michael Isard
  HotOS 2015
  
• Queues don't matter when you can JUMP them! [usenix] [website]
  Matthew P. Grosvenor, Malte Schwarzkopf, Ionel Gog, Andrew W. Moore, Robert N.M. Watson, Steven Hand and Jon Crowcroft
  NSDI 2015 – Best paper award!
  
• Musketeer: all for one, one for all in data processing systems [ACM DL]
  Ionel Gog, Malte Schwarzkopf, Natacha Crooks, Matthew P. Grosvenor, Allen Clement and Steven Hand
  EuroSys 2015
  

2013

• New wine in old skins: the case for distributed operating systems in the data center [ACM DL] [slides]
  Malte Schwarzkopf, Matthew P. Grosvenor and Steven Hand
  APSYS 2013
  
• Omega: flexible, scalable schedulers for large compute clusters [ACM DL] [slides, slides (PDF)]
  Malte Schwarzkopf, Andy Konwinski, Michael Abd-El-Malek and John Wilkes
  EuroSys 2013 – Best student paper award!
  

2012

• The seven deadly sins of cloud computing research [usenix] [slides]
  Malte Schwarzkopf, Derek G. Murray and Steven Hand
  HotCloud 2012
  
• A down-to-earth look at the cloud host OS [ACM DL] [slides]
  Malte Schwarzkopf and Steven Hand
  HotCDP 2012
  
• The Case for Reconfigurable I/O Channels
  Steven Smith, Anil Madhavapeddy, Christopher Smowton, Malte Schwarzkopf, Richard Mortier, Robert Watson and Steven Hand
  RESoLVE 2012
  

2011

• Condensing the cloud: running Ciel on many-core [slides]
  Malte Schwarzkopf, Derek G. Murray and Steven Hand
  SFMA 2011
  
• Ciel: a universal execution engine for distributed data-flow computing [usenix]
  Derek G. Murray, Malte Schwarzkopf, Christopher Smowton, Steven Smith, Anil Madhavapeddy and Steven Hand
  NSDI 2011
  
• Unclouded Vision (invited paper) [springer]
  Jon Crowcroft, Anil Madhavapeddy, Malte Schwarzkopf, Theodore Hong and Richard Mortier
  ICDCN 2011
  

2010

• Unclouded Vision
  Jon Crowcroft, Anil Madhavapeddy, Malte Schwarzkopf, Theodore Hong and Richard Mortier
  Digital Futures 2010
  
• Using Dust Clouds to Enhance Anonymous Communication [slides]
  Richard Mortier, Anil Madhavapeddy, Theodore Hong, Derek G. Murray and Malte Schwarzkopf
  IWSP 2010
  

Theses/Dissertations

• Operating system support for warehouse-scale computing
  Malte Schwarzkopf
  PhD dissertation, University of Cambridge Computer Laboratory.
  Submitted: October 23, 2015.
  Defended: February 12, 2016.
  Approved: August 12, 2016.
  » Dissertation (8 MB, PDF)
• Proteus – Interactive Annotation-Based 3D Structure-from-Motion
  Malte Schwarzkopf
  BA (Part II) Dissertation, Cambridge Computer Science Tripos, May 2009.
  » Project website
  » Dissertation (13 MB, PDF)

Journal and Magazine articles

• Noria: A New Take on Fast Web Application Backends (invited submission) [usenix]
  Jon Gjengset, Malte Schwarzkopf, Jonathan Behrens, Lara Timbó Araújo, Martin Ek, Eddie Kohler, M. Frans Kaashoek, Robert Morris
  USENIX ;login: magazine, vol. 44, no. 1, Spring 2019.
  
• Research for Practice: Cluster Scheduling for Datacenters (invited submission)
  Malte Schwarzkopf, Peter Bailis (ed.)
  ACM Queue, vol. 15, no. 5, September-October 2017. [online] [ACM DL]
  Communications of the ACM, vol. 61, no. 5, May 2018. [online] [ACM DL]
• Non-volatile storage (invited submission)
  Mihir Nanavati, Malte Schwarzkopf, Jake Wires and Andrew Warfield
  ACM Queue, vol. 13, no. 9, November-December 2015. [ACM DL]
  Communications of the ACM, vol. 59, no. 1, January 2016. [ACM DL]
• Jump the queue to lower latency (invited submission) [usenix]
  Matthew P. Grosvenor, Malte Schwarzkopf, Ionel Gog and Andrew W. Moore
  USENIX ;login: magazine, vol. 40, no. 2, April 2015.
  
• Raft Refloated: Do We Have Consensus? [ACM DL]
  Heidi Howard, Malte Schwarzkopf, Anil Madhavapeddy and Jon Crowcroft
  ACM SIGOPS Operating Systems Review – Special Issue on Repeatability and Sharing of Experimental Artifacts 49.1 (January 2015).
  
• Please mind the gap between intra- and inter-chassis parallelism! [on the TinyToCS site]
  Malte Schwarzkopf, Derek G. Murray and Steven Hand
  In volume 1 of Tiny Transactions on Computer Science (TinyToCS)
  

Other material

As a side-effect of my research, I have produced various assets that people seem to find interesting:

• Overview diagrams and a bibliographies of the published components of Google and Facebook data center stacks (from the background chapter of my PhD dissertation).
• A talk and slide deck on the anatomy of a modern scalable infrastructure stack, drawing on examples of systems used at Google and Facebook.

Media coverage

My research occasionally gets covered outside academic circles and in the press. Here is a list of some things people have written. You can follow me on Twitter to find out about these occasions in real time!

• June 17, 2019: the morning paper – covers multiverse databases.
• October 29, 2018: the morning paper – covers Noria.
• November 30, 2016: the morning paper – covers Firmament.
• December 7, 2015: "TNS Analysts: Talking OpenShift and Schedulers at KubeCon 2015" – mentions Firmament.
• September 2015: "Google's Data Architecture and What it Takes to Work at Scale" – covers my talk on scalable distributed systems stacks.
• May 12, 2015: the morning paper – covers QJump.
• April 27, 2015: the morning paper – covers Musketeer (part I, part II)