Mobile App Streaming

Masking latency by speculating on future events for highly interactive cloud-based remote rendering.  Using statistical inference over likely user actions, state space approximation, and fast state checkpoint and restore, we show it is possible to provide the experience of low latency for mobile clients even if their latency to the datacenter is over 100ms.  The technology is demonstrated on two of the most demanding interactive applications today: twitch-based gaming and head-mounted virtual reality.

Relevant Papers

• [PG2016] Proxy-guided Image-based Rendering for Mobile Devices
  Bernhard Reinert, Johannes Kopf, Tobias Ritschel, Eduardo Cuervo, David Chu, Hans-Peter Seidel.
• [MobiSys2016] FlashBack: Bringing Immersive Virtual Reality to Mobile Devices through Aggressive Rendering Memoization
  Kevin Boos, David Chu, Eduardo Cuervo.
• [GetMobile] Outatime: Using Speculation to Enable Low-Latency Continuous Interaction for Mobile Cloud Gaming
  Kyungmin Lee, David Chu, Eduardo Cuervo, Johannes Kopf, Yury Degtyarev, Sergey Grizan, Alec Wolman, Jason Flinn.
• [SoCC2015] dJay: Enabling High-density Multi-tenancy for Cloud Gaming Servers with Dynamic Cost-Benefit GPU Load Balancing
  Sergey Grizan, David Chu, Alec Wolman, Roger Wattenhofer.
• [UbiComp2015] Prime: A Framework for Scaling Co-located Multi-Device Apps
  David Chu, Zengbin Zhang, Alec Wolman, Nic Lane.
• [MobiSys2015] Demo: Irides: Attaining Quality, Responsiveness and Mobility for Virtual Reality Head-mounted Displays
  Yury Degtyarev, Eduardo Cuervo, David Chu.
• [MobiSys2015] Outatime: Using Speculation to Enable Low-Latency Continuous Interaction for Mobile Cloud Gaming
  Kyungmin Lee, David Chu, Eduardo Cuervo, Johannes Kopf, Yury Degtyarev, Sergey Grizan, Alec Wolman, Jason Flinn. Best Paper
• [MobiSys2014] Demo: DeLorean: Using Speculation to Enable Low-Latency Continuous Interaction for Mobile Cloud Gaming
  Kyungmin Lee, David Chu, Eduardo Cuervo, Johannes Kopf, Alec Wolman, Jason Flinn. Best Demo

Videos

See Proxy-guided IBR in action!

See FlashBack in action!

See Outatime in action!

See Irides in action!

News

FlashBack in the news: Yahoo, Neowin, Network World, Phone Arena and more...

June 13, 2016

The FlashBack project was picked up in the news.

Microsoft Research project could bring quality VR to phones

Microsoft Research comes up with a workable low-end VR system

Microsoft’s FlashBack is capable of bringing high-quality VR to low-end phones

Microsoft Research’s Flashback brings high quality VR to low end phones and PCs

Microsoft Research FlashBack can bring VR even to low-end devices

Microsoft’s FlashBack can bring high-quality VR to every low-end phone and laptop

Microsoft FlashBack system looks to bring high-quality VR to lower-end phones

Best Paper at MobiSys 2015

May 27, 2015

Outatime received the best paper award at MobiSys 2015!

Irides in the news: Neowin, C'T Magazin and more...

May 16, 2015

The Irides project was picked up in the news:

Irides: Microsoft’s project to create a better Virtual Reality headset

Project Irides: Microsoft researches a cloud-based VR headset

Laboratory Work: Research for the Future