Kyungmin Lee
David Chu
Eduardo Cuervo
ABSTRACT
Gaming on phones, tablets and laptops is very popular. Cloud gaming - where remote servers perform game execution and rendering on behalf of thin clients that simply send input and display output frames - promises any device the ability to play any game any time. Unfortunately, the reality is that wide-area network latencies are often prohibitive; cellular, Wi-Fi and even wired residential end host round trip times (RTTs) can exceed 100ms, a threshold above which many gamers tend to deem responsiveness unacceptable.
In this paper, we present Outatime, a speculative execution system for mobile cloud gaming that is able to mask up to 120ms of network latency. Outatime renders speculative frames of future possible outcomes, delivering them to the client one entire RTT ahead of time, and recovers quickly from mis-speculations when they occur. Clients perceive little latency. To achieve this, Outatime combines: 1) future state prediction; 2) state approximation with image-based rendering and event time-shifting; 3) fast state checkpoint and rollback; and 4) state compression for bandwidth savings.
To evaluate the Outatime speculation system, we use two high quality, commercially-released games: a twitch-based first person shooter, Doom 3, and an action role playing game, Fable 3. Through user studies and performance bench- marks, we find that players strongly prefer Outatime to traditional thin-client gaming where the network RTT is fully visible, and that Outatime successfully mimics playing across a low-latency network.
- Amazon appstream. http://aws.amazon.com/appstream.Google Scholar
- Nvidia grid cloud gaming. http://shield.nvidia.com/grid.Google Scholar
- Sony playstation now streaming. http://us.playstation.com/playstationnow.Google Scholar
- Sponging is no longer a myth. http://youtu.be/Bt433RepDwM.Google Scholar
- M. Allman. Comments on bufferbloat. SIGCOMM Comput. Commun. Rev., 43(1):30--37, Jan. 2012. Google ScholarDigital Library
- T. Beigbeder, R. Coughlan, C. Lusher, J. Plunkett, E. Agu, and M. Claypool. The effects of loss and latency on user performance in unreal tournament 2003. In NetGames'04, pages 144--151, New York, NY, USA, 2004. ACM. Google ScholarDigital Library
- A. Bharambe, J. R. Douceur, J. R. Lorch, T. Moscibroda, J. Pang, S. Seshan, and X. Zhuang. Donnybrook: Enabling large-scale, high-speed, peer-to-peer games. In SIGCOMM'08, pages 389--400, New York, NY, USA, 2008. ACM. Google ScholarDigital Library
- A. Bharambe, J. Pang, and S. Seshan. Colyseus: A distributed architecture for online multiplayer games. In NSDI'06, pages 12--12, Berkeley, CA, USA, 2006. USENIX Association. Google ScholarDigital Library
- K.-T. Chen, P. Huang, and C.-L. Lei. How sensitive are online gamers to network quality? Commun. ACM, 49(11):34--38, Nov. 2006. Google ScholarDigital Library
- M. Claypool, D. Finkel, A. Grant, and M. Solano. Thin to win? network performance analysis of the onlive thin client game system. In Proceedings of the 11th Annual Workshop on Network and Systems Support for Games, NetGames '12, pages 1:1--1:6, Piscataway, NJ, USA, 2012. IEEE Press. Google ScholarDigital Library
- E. Cuervo. Enhancing Mobile Devices through Code Offload. PhD thesis, Duke University, 2012. Google ScholarDigital Library
- M. Dick, O. Wellnitz, and L. Wolf. Analysis of factors affecting players' performance and perception in multiplayer games. In NetGames'05, pages 1--7, New York, NY, USA, 2005. ACM. Google ScholarDigital Library
- J. R. Douceur, J. Elson, J. Howell, and J. R. Lorch. Leveraging legacy code to deploy desktop applications on the web. In Proceedings of the 8th USENIX Conference on Operating Systems Design and Implementation, OSDI'08, pages 339--354, Berkeley, CA, USA, 2008. USENIX Association. Google ScholarDigital Library
- Engadget. Microsoft's delorean is a cloud gaming system that knows what you'll do next. http://www.engadget.com/2014/08/23/microsoft-delorean/.Google Scholar
- Epic Games. Unreal graphics programming. https://docs.unrealengine.com/latest/INT/Programming/Rendering/index.ht%ml.Google Scholar
- Epic Games. Unreal networking architecture. http://udn.epicgames.com/Three/NetworkingOverview.html.Google Scholar
- R. Fernando. GPU Gems: Programming Techniques, Tips and Tricks for Real-Time Graphics. Addison-Wesley Professional, 2007. Google ScholarDigital Library
- Flurry. Apps solidify leadership six years into the mobile revolution. http://www.flurry.com/bid/109749/Apps-Solidify-Leadership-Six-Years-into-the-Mobile-Revolution, 2014.Google Scholar
- Gamespot. Microsoft researching cloud gaming solution that hides latency by predicting your actions. http://www.gamespot.com/articles/microsoft-researching-cloud-gaming-solution-that-h/1100-6421896/, 8 2014.Google Scholar
- Google. Native client. http://youtu.be/Bt433RepDwM.Google Scholar
- J. Huang, F. Qian, A. Gerber, Z. M. Mao, S. Sen, and O. Spatscheck. A close examination of performance and power characteristics of 4g lte networks. In MobiSys'12, pages 225--238, New York, NY, USA, 2012. ACM. Google ScholarDigital Library
- J. Huang, F. Qian, Y. Guo, Y. Zhou, Q. Xu, Z. M. Mao, S. Sen, and O. Spatscheck. An in-depth study of lte: effect of network protocol and application behavior on performance. In SIGCOMM'13, pages 363--374, New York, NY, USA, 2013. ACM. Google ScholarDigital Library
- Intel. QuickSync Programmable Video Processor. http://www.intel.com/content/www/us/en/architecture-and-technology/quick-sync-video/quick-sync-video-general.html.Google Scholar
- D. Jefferson, B. Beckman, F. Wieland, L. Blume, M. DiLoreto, P.Hontalas, P. Laroche, K. Sturdevant, J. Tupman, V. Warren, J. Weidel, H. Younger, and S. Bellenot. Time Warp operating system. In SOSP'87, pages 77--93, Austin, TX, November 1987. Google ScholarDigital Library
- R. E. Kalman. A new approach to linear filtering and prediction problems. Transactions of the ASME-Journal of Basic Engineering, 82(Series D):35--45, 1960.Google Scholar
- J. R. Lange, P. A. Dinda, and S. Rossoff. Experiences with client-based speculative remote display. In ATC'08, pages 419--432, Berkeley, CA, USA, 2008. USENIX Association. Google ScholarDigital Library
- K. Lee, D. Chu, E. Cuervo, J. Kopf, A. Wolman, and J. Flinn. Demo: Delorean: Using speculation to enable low-latency continuous interaction for mobile cloud gaming. MobiSys '14, 2014. Google ScholarDigital Library
- W. R. Mark, L. McMillan, and G. Bishop. Post-rendering 3d warping. In Proceedings of the 1997 Symposium on Interactive 3D Graphics, I3D '97, pages 7--ff., New York, NY, USA, 1997. ACM. Google ScholarDigital Library
- J. Mickens, J. Elson, J. Howell, and J. Lorch. Crom: Faster web browsing using speculative execution. In NSDI'10, pages 9--9, Berkeley, CA, USA, 2010. USENIX Association. Google ScholarDigital Library
- E. B. Nightingale, P. M. Chen, and J. Flinn. Speculative execution in a distributed file system. ACM Trans. Comput. Syst., 24(4):361--392, Nov. 2006. Google ScholarDigital Library
- Nvidia. Video codec sdk. https://developer.nvidia.com/nvidia-video-codec-sdk.Google Scholar
- PCWorld. Popcap games ceo: Android still too fragmented. http://bit.ly/1hQv8Mn, Mar 2012.Google Scholar
- P. Quax, P. Monsieurs, W. Lamotte, D. D. Vleeschauwer, and N. Degrande. Objective and subjective evaluation of the influence of small amounts of delay and jitter on a recent first person shooter game. In W. chang Feng, editor, NETGAMES, pages 152--156. ACM, 2004. Google ScholarDigital Library
- R. H. So and M. J. Griffin. Compensating lags in head-coupled displays using head position prediction and image deflection. Journal of Aircraft, 29(6):1064--1068, 1992.Google ScholarCross Ref
- J. Sommers and P. Barford. Cell vs. wifi: on the performance of metro area mobile connections. In IMC'12, pages 301--314, New York, NY, USA, 2012. ACM. Google ScholarDigital Library
- M. Stanton, B. Humberston, B. Kase, J. F. O'Brien, K. Fatahalian, and A. Treuille. Self-refining games using player analytics. ACM Trans. Graph., 33(4):73:1--73:9, July 2014. Google ScholarDigital Library
- S. Sundaresan, W. de Donato, N. Feamster, R. Teixeira, S. Crawford, and A. Pescapè. Broadband internet performance: A view from the gateway. In Proceedings of the ACM SIGCOMM 2011 Conference, SIGCOMM '11, pages 134--145, New York, NY, USA, 2011. ACM. Google ScholarDigital Library
- R. Szeliski. Computer Vision: Algorithms and Applications. Springer, 2011. Google ScholarCross Ref
- TechCrunch. Microsoft research shows off delorean, its tech for building a lag-free cloud gaming service. http://techcrunch.com/2014/08/22/microsoft-research-shows-off-delorean-its-tech-for-building-a-lag-free-cloud-gaming-service/.Google Scholar
- TechHive. Game developers still not sold on android. http://www.techhive.com/article/2032740/game-developers-still-not-sold-on-android.html, Apr 2013.Google Scholar
- J. Torborg and J. T. Kajiya. Talisman: Commodity realtime 3d graphics for the pc. In Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH '96, pages 353--363, New York, NY, USA, 1996. ACM. Google ScholarDigital Library
- B. Wester, P. M. Chen, and J. Flinn. Operating system support for application-specific speculation. In EuroSys'11, pages 229--242. ACM, April 2011. Google ScholarDigital Library
- K. Winstein and H. Balakrishnan. Mosh: An Interactive Remote Shell for Mobile Clients. In USENIX Annual Technical Conference, Boston, MA, June 2012. Google ScholarDigital Library
- Wired. As android rises, app makers tumble into google's matrix of pain. http://www.wired.com/business/2013/08/android-matrix-of-pain/, Aug 2013.Google Scholar
Index Terms
- Outatime: Using Speculation to Enable Low-Latency Continuous Interaction for Mobile Cloud Gaming
Recommendations
An evaluation of speculative instruction execution on simultaneous multithreaded processors
Modern superscalar processors rely heavily on speculative execution for performance. For example, our measurements show that on a 6-issue superscalar, 93% of committed instructions for SPECINT95 are speculative. Without speculation, processor resources ...
Dissecting the protocol and network traffic of the OnLive cloud gaming platform
Cloud gaming is a new paradigm that is envisaged to play a pivotal role in the video game industry in forthcoming years. Cloud gaming, or gaming on demand, is a type of online gaming that allows on-demand streaming of game content onto non-specialised ...
Server Allocation for Multiplayer Cloud Gaming
MM '16: Proceedings of the 24th ACM international conference on MultimediaAdvances in cloud computing and GPU virtualization are allowing the game industry to move into a cloud gaming era. While shifting standalone video games to the cloud gaming mode is straightforward, adapting multiplayer online games to the cloud gaming ...
Comments