Adrian Colyer
Abstract
Performance in its various guises features prominently in research evaluations, and rightly so. Without adequate performance a system is not fit for purpose. That doesn't necessarily mean we should pursue performance at all costs though. In this talk we'll explore a variety of additional evaluation criteria, with a focus on those that are most important to practitioners, and ask whether or not considering them can open up interesting avenues of research.
- VLDB 2019: Overview, 2019. http://vldb.org/2019Google Scholar
- Cooper, B., Silberstein, A., Tam, E., Ramakrishnan, R. and Sears, R. Benchmarking Cloud Serving Systems with YCSB. In ACM Symposium on Cloud Computing (SoCC '10) (Indianapolis, IN, USA, 2010). Google ScholarDigital Library
- TPC-C On-Line Transaction Processing Benchmark. http://www.tpc.org/tpcc/default.aspGoogle Scholar
- TPC-H Decision Support Benchmark. http://www.tpc.org/tpch/default.aspGoogle Scholar
- Goodhart's Law. https://en.wikipedia.org/wiki/Goodhart%27s_law. Accessed May 2019Google Scholar
- Streetlight Effect. https://en.wikipedia.org/wiki/Streetlight_effect. Accessed May 2019Google Scholar
- Bacon, D., Bales, N., Bruno, N., Cooper, B., Dickinson, A., Fikes, A., Fraser, C., Gubarev, A., Joshi, M., Kogan, E., Lloyd, A., Melnik, S., Rao, R., Shue, D., Taylor, C., van der Holst, M. and Woodford, D. Spanner: Becoming a SQL System. In Proceedings of the 2017 ACM International Conference on Management of Data, pages 331--343, 2017. Google ScholarDigital Library
- Tu, T., Liu, X., Song, L. and Zhang, Y. Understanding Real-World Concurrency Bugs in Go. In Proceedings of 2019 Architectural Support for Programming Languages and Operating Systems (ASPLOS '19), 2019 Google ScholarDigital Library
- Van Roy, P. Programming Paradigms for Dummies: What Every Programmer Should Know. In New Computational Paradigms for Computer Music, 2009.Google Scholar
- Alvaro, P., Conway, N., Hellerstein, J., and Marczak, W. Consistency analysis in Bloom: a CALM and Collected Approach. In CIDR, 2011Google Scholar
- Fekete, A., Goldrei, S., and Asenjo, J. Quantifying Isolation Anomalies. PVLDB, 2(1):467--478, 2009. Google ScholarDigital Library
- Bailis, P., Davidson, A., Fekete, A., Ghodsi, A. Hellerstein, J. and Stoica, I. Highly available transactions: Virtues and limitations. PVLDB, 7(3):181--192, 2013. Google ScholarDigital Library
- Helland, P. and Campbell, D. Building on quicksand In CIDR, 2009.Google Scholar
- Balegas, V., Duarte, S., Ferreira, C., Rodrigues, R., Preguiça, N., Najafzadeh, M. and Shapiro, M. Putting consistency back into eventual consistency. In Proceedings of the Tenth European Conference on Computer Systems, ACM, 2015. Google ScholarDigital Library
- Bailis, P., Fekete, A. Franklin, M., Ghodsi, A., Hellerstein, J., and Stoica, I. Coordination avoidance in database systems. PVLDB, 8(3):185--196, 2014. Google ScholarDigital Library
- Gan, Y., Zhang, Y., Cheng D., Shetty, A., Rathi, P., Katarki, N., Bruno, A., Hu, J., Ritchken, B., Jackson, B., Hu, K., Pancholi, M., He, Y., Clancy, B., Colen, C., Wen, F., Leung, C., Wang, S., Zaruvinsky, L., Espinosa, M., Lin, R., Liu, Z., Padilla, J. and Delimitrou, C. An Open-Source Benchmark Suite for Microservices and Their Hardware-Software Implications for Cloud & Edge Systems. In Proceedings of the 2019 Architectural Support for Programming Languages and Operating Systems (ASPLOS '19), ACM, 2019. Google ScholarDigital Library
Recommendations
SIGCSE spotlight
Hello, and welcome to SIGCSE Spotlight, an ongoing column that highlights and reflects on the current trends within computing education and the SIGCSE community. In this quarter's issue we are going to go behind the scenes at the premier SIGCSE ...
Member spotlight
In this feature of the Bulletin, we highlight members of the SIGCSE community. In this issue, Bulletin co-editor Leo Porter interviewed Mark Guzdial. Mark Guzdial is a Professor of Electrical Engineering and Computer Science at the University of ...
Comments