Anzeige
Erschienen in:
2014 | OriginalPaper | Buchkapitel
Compression Accelerator for Hadoop Appliance
verfasst von : Sang Don Kim, Seong Mo Lee, Sang Muk Lee, Ji Hoon Jang, Jae-Gi Son, Young Hwan Kim, Seung Eun Lee
Erschienen in: Internet of Vehicles – Technologies and Services
Verlag: Springer International Publishing
Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.
Wählen Sie Textabschnitte aus um mit Künstlicher Intelligenz passenden Patente zu finden. powered by
Markieren Sie Textabschnitte, um KI-gestützt weitere passende Inhalte zu finden. powered by
In this paper, we propose an accelerator for Hadoop appliances. Data servers receive significant data traffic because of several services based on networks. Processing such big data requires sufficient communication bandwidth for big data management. In order to increase communication bandwidth, compression algorithms are adopted in Hadoop appliances, although additional computation overhead is required. Our accelerator compresses data from a PCIe (Peripheral Component Interconnect Express) interface, thus reducing the size of data that should be transmitted through a network. As a result, computation overhead of the main processor in a server is decreased and communication bandwidth is increased.