Stefan Manegold
Skip Abstract Section
Abstract
The holy grail for database architecture research is to find a solution that is Scalable & Speedy, to run on anything from small ARM processors up to globally distributed compute clusters, Stable & Secure, to service a broad user community, Small & Simple, to be comprehensible to a small team of programmers, Self-managing, to let it run out-of-the-box without hassle.
In this paper, we provide a trip report on this quest, covering both past experiences, ongoing research on hardware-conscious algorithms, and novel ways towards self-management specifically focused on column store solutions.
- D. J. Abadi. Query Execution in Column-Oriented Database Systems. PhD thesis, MIT, Cambridge, MA, USA, 2008. Google Scholar
Digital Library
- R. Agrawal, A. Ailamaki, P. A. Bernstein, E. A. Brewer, M. J. Carey, S. Chaudhuri, A. Doan, D. Florescu, M. J. Franklin, H. Garcia-Molina, J. Gehrke, L. Gruenwald, L. M. Haas, A. Y. Halevy, J. M. Hellerstein, Y. E. Ioannidis, H. F. Korth, D. Kossmann, S. Madden, R. Magoulas, B. C. Ooi, T. O'Reilly, R. Ramakrishnan, S. Sarawagi, M. Stonebraker, A. S. Szalay, and G. Weikum. The claremont report on database research. Communications of the ACM, 52(6):56--65, 2009. Google ScholarDigital Library
- S. Agrawal, S. Chaudhuri, L. Kollár, A. P. Marathe, V. R. arasayya, and M. Syamala. Database Tuning Advisor for Microsoft SQL Server. In VLDB, 2004.Google Scholar
- A. Ailamaki, P. A. Boncz, S. Manegold, Q. Luo, and K. A. Ross, editors. Int'l Workshop on Data Management on New Hardware (DaMoN), 2005--2009. http://dblp.uni-trier.de/db/conf/damon/.Google Scholar
- A. Ailamaki, D. J. DeWitt, M. D. Hill, and M. Skounakis. Weaving Relations for Cache Performance. In VLDB, 2001. Google ScholarDigital Library
- A. Ailamaki, D. J. DeWitt, M. D. Hill, and D. A. Wood. DBMSs on a Modern Processor: Where does time go? In VLDB, 1999. Google ScholarDigital Library
- P. A. Bernstein, M. L. Brodie, S. Ceri, D. J. DeWitt, M. J. Franklin, H. Garcia-Molina, J. Gray, G. Held, J. M. Hellerstein, H. V. Jagadish, M. Lesk, D. Maier, J. F. Naughton, H. Pirahesh, M. Stonebraker, and J. D. Ullman. The asilomar report on database research. ACM SIGMOD Record, 27(4):74--80, 1998. Google ScholarDigital Library
- P. A. Boncz, T. Grust, M. van Keulen, S. Manegold, J. Rittinger, and J. Teubner. MonetDB/XQuery: A Fast XQuery Processor Powered by a Relational Engine. In SIGMOD, 2006. Google ScholarDigital Library
- P. A. Boncz, S. Manegold, and M. L. Kersten. Database Architecture Optimized for the New Bottleneck: Memory Access. In VLDB, 1999. Google ScholarDigital Library
- S. Chen, A. Ailamaki, P. B. Gibbons, and T. C. Mowry. Improving hash join performance through prefetching. ACM Transactions on Database Systems (TODS), 32(3), 2007. Google ScholarDigital Library
- G. P. Copeland and S. Khoshafian. A Decomposition Storage Model. In SIGMOD, 1985. Google ScholarDigital Library
- R. Cornacchia, S. Heman, M. Zukowski, A. P. de Vries, and P. A. Boncz. Flexible and efficient IR using Array Databases. The VLDB Journal, 17(1):151--168, Jan. 2008. Google ScholarDigital Library
- P. Frey, R. Goncalves, M. L. Kersten, and J. Teubner. Spinning Relations: High-Speed Networks for Distributed Join Processing. In DaMoN, 2009. Google ScholarDigital Library
- R. A. Hankins and J. M. Patel. Data Morphing: An Adaptive, Cache-Conscious Storage Technique. In VLDB, 2003. Google ScholarDigital Library
- S. Harizopoulos and A. Ailamaki. STEPS towards Cache-resident Transaction Processing. In VLDB, 2004. Google ScholarDigital Library
- S. Harizopoulos, V. Shkapenyuk, and A. Ailamaki. QPipe: a simultaneously pipelined relational query engine. In SIGMOD, 2005. Google ScholarDigital Library
- B. He and Q. Luo. Cache-oblivious query processing. In CIDR, 2007.Google Scholar
- S. Idreos, M. L. Kersten, and S. Manegold. Self-organizing Tuple Reconstruction in Column-stores. In SIGMOD, 2009. Google ScholarDigital Library
- M. Ivanova, M. L. Kersten, N. Nes, and R. Goncalves. An Architecture for Recycling Intermediates in a Column-store. In SIGMOD, 2009. Google ScholarDigital Library
- R. A. Kader, P. A. Boncz, S. Manegold, and M. van Keulen. ROX: Run-time Optimization of XQueries. In SIGMOD, 2009. Google ScholarDigital Library
- M. L. Kersten, E. Liarou, and R. Goncalves. A Query Language for a Data Refinery Cell. In Int'l Workshop on Event-driven Architecture, Processing and Systems (EDA-PS), 2007.Google Scholar
- M. L. Kersten and S. Manegold. Cracking the Database Store. In CIDR, 2005.Google Scholar
- E. Liarou, R. Goncalves, and S. Idreos. Exploiting the Power of Relational Databases for Efficient Stream Processing. In EDBT, 2009. Google ScholarDigital Library
- S. Manegold. Understanding, Modeling, and Improving Main-Memory Database Performance. PhD thesis, Universiteit van Amsterdam, Amsterdam, The Netherlands, Dec. 2002.Google Scholar
- S. Manegold, P. A. Boncz, and M. L. Kersten. What happens during a Join? --- Dissecting CPU and Memory Optimization Effects. In VLDB, pages 339--350, Cairo, Egypt, Sept. 2000. Google ScholarDigital Library
- S. Manegold, P. A. Boncz, and M. L. Kersten. Generic Database Cost Models for Hierarchical Memory Systems. In VLDB, 2002. Google ScholarDigital Library
- S. Manegold, P. A. Boncz, and M. L. Kersten. Optimizing Main-Memory Join On Modern Hardware. IEEE Transactions on Knowledge and Data Engineering (TKDE), 14(4):709--730, 2002. Google ScholarDigital Library
- S. Manegold, P. A. Boncz, N. Nes, and M. L. Kersten. Cache-Conscious Radix-Decluster Projections. In VLDB, 2004. Google ScholarDigital Library
- P. O'Neil and D. Quass. Improved Query Performance with Variant Indexes. In SIGMOD, 1997. Google ScholarDigital Library
- R. Ramamurthy, D. DeWitt, and Q. Su. A Case for Fractured Mirrors. In VLDB, 2002. Google ScholarDigital Library
- J. Rao and K. A. Ross. Cache Conscious Indexing for Decision-Support in Main Memory. In VLDB, 1999. Google ScholarDigital Library
- J. Rao and K. A. Ross. Making B+-Trees Cache Conscious in Main Memory. In SIGMOD, 2000. Google ScholarDigital Library
- M. Shao, J. Schindler, S. W. Schlosser, A. Ailamaki, and G. R. Ganger. Clotho: decoupling memory page layout from storage organization. In VLDB, 2004. Google ScholarDigital Library
- A. Shatdal, C. Kant, and J. Naughton. Cache Conscious Algorithms for Relational Query Processing. In VLDB, 1994. Google ScholarDigital Library
- A. Shoshani and D. Rotem. Scientific Data Management Challenges, Technology, and Deployment. Chapman & Hall, 2009. Google ScholarDigital Library
- L. Sidirourgos, R. Goncalves, M. L. Kersten, N. Nes, and S. Manegold. Column-Store Support for RDF Data Management: not all swans are white. In VLDB, 2008. Google ScholarDigital Library
- M. Stonebraker, D. J. Abadi, A. Batkin, X. Chen, M. Cherniack, M. Ferreira, E. Lau, A. Lin, S. R. Madden, E. J. O'Neil, P. E. O'Neil, A. Rasin, N. Tran, and S. B. Zdonik. C-Store: A Column-Oriented DBMS. In VLDB, 2005. Google ScholarDigital Library
- M. Stonebraker, S. Madden, D. J. Abadi, S. Harizopoulos, N. Hachem, and P. Helland. The End of an Architectural Era (It's Time for a Complete Rewrite). In VLDB, 2007. Google ScholarDigital Library
- P. Valduriez. Join Indices. ACM Transactions on Database Systems (TODS), 12(2):218--246, June 1987. Google ScholarDigital Library
- J. Zhou and K. A. Ross. Buffering Accesses to Memory-Resident Index Structures. In VLDB, 2003. Google ScholarDigital Library
- J. Zhou and K. A. Ross. Buffering database operations for enhanced instruction cache performance. In SIGMOD, 2004. Google ScholarDigital Library
- D. C. Zilio, J. Rao, S. Lightstone, G. M. Lohman, A. Storm, C. Garcia-Arellano, and S. Fadden. DB2 Design Advisor: Integrated Automatic Physical Database Design. In VLDB, 2004. Google ScholarDigital Library
- M. Zukowski. Balancing Vectorized Query Execution with Bandwidth-Optimized Storage. PhD thesis, Universiteit van Amsterdam, Amsterdam, The Netherlands, Sept. 2009.Google Scholar
- M. Zukowski, S. Heman, N. Nes, and P. A. Boncz. Super-scalar ram-cpu cache compression. In ICDE, 2006. Google ScholarDigital Library
- M. Zukowski, S. Heman, N. Nes, and P. A. Boncz. Cooperative Scans: Dynamic Bandwidth Sharing in a DBMS. In VLDB, 2007. Google ScholarDigital Library
- M. Zukowski, N. Nes, and P. A. Boncz. DSM vs. NSM: CPU Performance Tradeoffs in Block-Oriented Query Processing. In DaMoN, 2008. Google ScholarDigital Library
Index Terms
- Database architecture evolution: mammals flourished long before dinosaurs became extinct
Comments