David A. Patterson
Abstract
As I review performance trends, I am struck by a consistent theme across many technologies: bandwidth improves much more quickly than latency. Here, I list a half-dozen performance milestones to document this observation, many reasons why it happens, a few ways to cope with it, a rule of thumb to quantify it, plus an example of how to design systems differently based on this observation.
- Gries, M. A survey of synchronous RAM architectures. Computer Engineering and Networks Laboratory (TIK). Zurich, Germany, (Apr. 1999).Google Scholar
- Grochowski, E. and Halem, R. Technological impact of magnetic hard disk drives on storage systems. IBM Systems J. 42, 2 (July 2003), 338-346. Google ScholarDigital Library
- Hennessy, J. and Patterson, D. Computer Architecture: A Quantitative Approach. Morgan Kauffman, San Francisco, CA, 1990, 1996, 2003. (Most of the historical data in <zref=T1>Table 1<zrefx> comes from the three editions of this book.) Google ScholarDigital Library
- IC Knowledge. History of the Integrated Circuit; www.icknowledge.com/history/history.html (2003)Google Scholar
- Patterson, D. and Hennessy, J. Computer Organization and Design: The Hardware/Software Interface. Morgan Kauffman San Francisco, CA, 1994, 1998, 2004. (Some historical data in <zref=T1>Table 1<zrefx> comes from the three editions of this book.) Google ScholarDigital Library
- Ross, P. 5 commandments of engineering. IEEE Spectrum (Dec. 2003).Google Scholar
Index Terms
- Latency lags bandwith
Recommendations
Latency Lags Bandwidth
ICCD '05: Proceedings of the 2005 International Conference on Computer DesignAs I review performance trends, I am struck by a consistent theme across many technologies over many years: bandwidth improves much more quickly than latency for four different technologies: disks, networks, memories and processors. A rule of thumb to ...
Reducing web latency: the virtue of gentle aggression
To serve users quickly, Web service providers build infrastructure closer to clients and use multi-stage transport connections. Although these changes reduce client-perceived round-trip times, TCP's current mechanisms fundamentally limit latency ...
Reducing web latency: the virtue of gentle aggression
SIGCOMM '13: Proceedings of the ACM SIGCOMM 2013 conference on SIGCOMMTo serve users quickly, Web service providers build infrastructure closer to clients and use multi-stage transport connections. Although these changes reduce client-perceived round-trip times, TCP's current mechanisms fundamentally limit latency ...
Comments