nach oben

Erschienen in:

2019 | OriginalPaper | Buchkapitel

Automated Hot_Text and Huge_Pages: An Easy-to-Adopt Solution Towards High Performing Services

verfasst von : Zhenyun Zhuang, Mark Santaniello, Shumin Zhao, Bikash Sharma, Rajit Kambo

Erschienen in: Web Services – ICWS 2019

Verlag: Springer International Publishing

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

Performance optimizations of large scale services can lead to significant wins on service efficiency and performance. CPU resource is one of the most common performance bottlenecks, hence improving CPU performance has been the focus of many performance optimization efforts. In particular, reducing iTLB (instruction TLB) miss rates can greatly improve CPU performance and speed up service running.

At Facebook, we have achieved CPU reduction by applying a solution that firstly identifies hot-text of the (software) binary and then places the binary on huge pages (i.e., 2 MB+ memory pages). The solution is wrapped into an automated framework, enabling service owners to effortlessly adopt it. Our framework has been applied to many services at Facebook, and this paper shares our experiences and findings.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Vorheriges Kapitel A Web-Service to Monitor a Wireless Sensor Network

Nächstes Kapitel ThunderML: A Toolkit for Enabling AI/ML Models on Cloud for Industry 4.0

Please refer to Sect. 2 for detailed explanations of iTLB misses.

We observed that most services are relatively stable with regard to hot functions, hence weekly profiling suffices.

Chen, G.J., et al.: Realtime data processing at Facebook. In: Proceedings of the 2016 International Conference on Management of Data, SIGMOD 2016, New York, NY, USA (2016)

Dong, S., Callaghan, M., Galanis, L., Borthakur, D., Savor, T., Strum, M.: Optimizing space amplification in RocksDB. In: Proceedings of the 8th Biennial Conference on Innovative Data Systems Research (CIDR 2017). Chaminade, California (2017)

Annamalai, M., et al.: Sharding the shards: managing datastore locality at scale with Akkio. In: Proceedings of the 12th USENIX Conference on Operating Systems Design and Implementation, OSDI 2018, Berkeley, CA, USA (2018)

Wicht, B., Vitillo, R.A., Chen, D., Levinthal, D.: Hardware counted profile-guided optimization. CoRR, vol. abs/1411.6361 (2014). http://arxiv.org/abs/1411.6361

Transparent Hugepage Support. https://www.kernel.org/doc/Documentation/vm/transhuge.txt

Intel HasWell Architecture. https://ark.intel.com/content/www/us/en/ark/products/codename/42174/haswell.html

Advanced usage of last branch records. https://lwn.net/Articles/680996/

HFSort. https://github.com/facebook/hhvm/tree/master/hphp/tools/hfsort

Ottoni, G., Maher, B.: Optimizing function placement for large-scale data-center applications. In: Proceedings of the 2017 International Symposium on Code Generation and Optimization, CGO 2017, Piscataway, NJ, USA (2017)

10.

Data pipelines at Facebook. https://www.meetup.com/DataCouncil-AI-NewYorkCity-Data-Engineering-Science/events/189614862/

11.

Barrigas, H., Barrigas, D., Barata, M., Furtado, P., Bernardino, J.: Overview of Facebook scalable architecture. In: Proceedings of the International Conference on Information Systems and Design of Communication, ISDOC 2014 (2014)

12.

Buck: A high-performance build tool. https://buckbuild.com/

13.

NM utility. https://sourceware.org/binutils/docs/binutils/nm.html

14.

Chen, D., Li, D.X., Moseley, T.: AutoFDO: automatic feedback-directed optimization for warehouse-scale applications. In: Proceedings of the 2016 International Symposium on Code Generation and Optimization, CGO 2016, New York, NY, USA (2016)

15.

Tallam, S., Coutant, C., Taylor, I.L., Li, X.D., Demetriou, C.: Safe ICF: pointer safe and unwinding aware identical code folding in gold. In: GCC Developers Summit (2010)

16.

Panchenko, M., Auler, R., Nell, B., Ottoni, G.: Bolt: a practical binary optimizer for data centers and beyond. In: Proceedings of the 2019 IEEE/ACM International Symposium on Code Generation and Optimization, CGO 2019, pp. 2–14. IEEE Press, Piscataway (2019)

17.

Binary Optimization and Layout Tool. https://github.com/facebookincubator/BOLT

18.

Luk, C.-K., Muth, R., Patil, H., Cohn, R., Lowney, G.: Ispike: a post-link optimizer for the Intel Itanium architecture. In: Proceedings of the International Symposium on Code Generation and Optimization: Feedback-directed and Runtime Optimization, CGO 2004, Washington, DC, USA (2004)

19.

Nowak, A., Yasin, A., Mendelson, A., Zwaenepoel, W.: Establishing a base of trust with performance counters for enterprise workloads. In: Proceedings of the 2015 USENIX Conference on USENIX Annual Technical Conference, USENIX ATC 2015, Berkeley, CA, USA, pp. 541–548 (2015)

20.

Scaling server software at Facebook. In Applicative 2016, Applicative 2016, speaker-Watson, Dave (2016)

21.

RocksDB: A persistent key-value store. https://rocksdb.org/

22.

Ouaknine, K., Agra, O., Guz, Z.: Optimization of RocksDB for Redis on flash. In: Proceedings of the International Conference on Compute and Data Analysis, ICCDA 2017, New York, NY, USA (2017)

Titel: Automated Hot_Text and Huge_Pages: An Easy-to-Adopt Solution Towards High Performing Services
verfasst von: Zhenyun Zhuang
Mark Santaniello
Shumin Zhao
Bikash Sharma
Rajit Kambo
Verlag: Springer International Publishing
Buch: Web Services – ICWS 2019
Print ISBN: 978-3-030-23498-0

Electronic ISBN: 978-3-030-23499-7

Copyright-Jahr: 2019
DOI: https://doi.org/10.1007/978-3-030-23499-7_10

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner