Masking latency by speculating on future events for highly interactive cloud-based remote rendering. Using statistical inference over likely user actions, state space approximation, and fast state checkpoint and restore, we show it is possible to provide the experience of low latency for mobile clients even if their latency to the datacenter is over 100ms. The technology is demonstrated on two of the most demanding interactive applications today: twitch-based gaming and head-mounted virtual reality. 
Seeking to offer Kinect-like experiences using only mobile devices, leading to new mobile gaming experiences. Key technical achievements include development of fast, accurate and robust phone-to-phone distance measurement system, and a 3D phone-to-phone measurement techniques. Several innovative games, including SwordFight, have been prototyped. 
Investigating the impact of context data on the mobile operating system. Core contributions include identifying the benefits of OS managed context, and uses of context by the OS. As a concrete example, faster app launching based on context signals such as location and temporal access patterns is investigated in detail.See more projects…
