Daniel (Lin-Kit) Wong

Hello! I am a fourth-year PhD student in the Computer Science Department at Carnegie Mellon.
I am advised by Professor Greg Ganger and am a member of the Parallel Data Laboratory.

I am a systems builder and hacker with a focus on systems design and distributed systems.

My main project is on ML for caching. I spent my initial years at CMU building machine learning systems. In Summer ‘19, I interned at Google, working on scheduling for model parallelism in TensorFlow. Before my PhD, I worked on everything from graph clustering for bioinformatics to systems security .

Spring ‘20: Besides my active work in ML for Systems, I'm always interested in problems within distributed systems and Systems for ML. I remain interested in possible intersections with neuroscience and security. Reach out if you have problems, insights, or data to share!

Résumé (Feb ‘20) | Publications
Research during my PhD at CMU
  • Ongoing (Summer ‘20):
    • ML-based cache admission policies Spring ‘20 - Present

      Daniel Wong, Carson Molder, Daniel Berger, Nathan Beckmann, Greg Ganger
      (and Facebook collaborators including Qing Zhao, Jimmy Lu, Jim Cipar, and Sathya Gunasekar)

  • Keen to explore (Spring ‘20):
    • Applications of clustering & dimensionality reduction for time series and graphs.

      I'm keen to explore interpretable machine learning methods that find correlations in time series and graphs, with an especial interest in visualizations, interpretability and causality. This applies for both systems and neuroscience datasets.

    • Areas I have a soft spot for / past background: neuroscience, systems security, HCI, psychology.
  • Past projects:
    • CANDStore: High availability in cheap distributed key value storage. Spring ‘19 - Summer ‘20

      Thomas Kim, Daniel Wong, Anuj Kalia, Rajat Kateja, Greg Ganger, Michael Kaminsky, David G. Andersen

      Accepted to ACM SOCC 2020.

    • 10-708 (PGM) project: Dimensionality reduction on neuroscience datasets. Spring ‘20
      Stitching neural population recordings (electrophysiological) from different days.
      Adam Smoulder, Sami Horn, Daniel Wong
    • Co-optimizing scheduling and device placement in TensorFlow with deep RL for automatic model parallelism.
      Google Summer ‘19 intern, Fall ‘19 Student Researcher

      Daniel Wong, Peter Ma^, Sudip Roy*, Yanqi Zhou*
      ^Google Platforms Performance, *Google Brain (ML for Systems)

      Related papers accepted to NeurIPS and IEEE Micro.

    • Selective-Backpropagation: Accelerating Deep Learning by Focusing on the Biggest Losers. Fall ‘18 - Fall ‘19

      Angela H. Jiang, Daniel L.-K. Wong, Giulio Zhou, David G. Andersen, Jeffrey Dean, Gregory R. Ganger, Gauri Joshi, Michael Kaminksy, Michael Kozuch, Zachary C. Lipton, Padmanabhan Pillai [preprint]

    • Mainstream: Dynamic Stem-Sharing for Multi-Tenant Video Processing. Fall ‘17 - Spring ‘18

      Angela Jiang, Daniel Lin-Kit Wong, Christopher Canel, Ishan Misra, Michael Kaminsky, Michael A. Kozuch, Padmanabhan Pillai, David G. Andersen, Gregory R. Ganger. USENIX ATC 2018. [PDF]
      Part of the Intel Science and Technology Center for Visual Cloud Systems (ISTC-VCS).

  • Past explorations (keen to revisit if things change)
    • Transient failures (grey failures). Fall ‘19

      How can we balance initiating recovery quickly and overreacting to transient failures?

    • Affordable robustness to failures in distributed storage. Spring ‘19 - Fall ‘19

      3-way cross-region replication is expensive and slow. It helps mitigate rare risks like a hurricane taking out a data center, but why pay that price for common events like equipment failures? Can we detect and predict correlated failures?

      Outcome: I performed simulations based on theoretical modelling and presented a poster on transient failures at PDL Retreat 2019. Although there was strong interest from industry who were also grappling with this problem, this project was put on hold because of a lack of real world data to model the failures. I would be keen to revisit this project. Hit me up if you are able to offer any datasets!
    • Speeding up evolutionary neural architecture search with adaptive weight sharing. Summer ‘18 - Fall ‘18
Teaching & Coursework at CMU
Highlights from life before starting my PhD

I'm a tinkerer at heart, and am always on the lookout for novel challenges to work on. In seeking opportunities, I aim to optimise for learning and to do meaningful, impactful work. I bask in the energy of synergistic collaborations, and the opportunity they give me to wade into new domains and learn from cool people.

I'm a software engineer and have a relentless urge to automate and optimize all parts of my work process.

I enjoy cooking, musicals, singing, Singaporean food, skiing & snowboarding, gliding, long scenic drives (and walks), waterfalls, baking, rock climbing, ice skating, scuba diving, and last but not least, good nigiri. I did my undergraduate studies at the University of Cambridge and am a member of Churchill College. I grew up in Singapore, am a 华中子弟, and am a proud alumnus of my high school computer club EC3 (where I learnt to code and hack stuff together.)

Office: GHC 9015

Get in touch: | [same username]@cmu.edu | LinkedIn | Facebook | Keybase | PGP key

My stuff: Quora | GitHub

More about me: Publications | Biography