A Microservices-Based Social Data Analytics Platform Over DC/OS

With increasing popularity of cloud services, the microservices architecture has been gaining more attention in the software development industry. The idea of the microservices architecture is to use a collection of loosely coupled services to compose a large-scale software application. In traditional monolithic architecture, by contrast, every piece of code is put together, and the application is developed, tested, and deployed as a single application. Obviously, it is challenging for the traditional architecture to scale properly. In this research, we implemented a social data analytics platform based on the microservices architecture over DC/OS. Specifically, our data analytics service is built by composing many open-source software including Spark, Kafka, and Node.js. On streaming processing, our platform offers a visual interface to show the hottest hashtags of the most popular user posts from an online forum. On batch processing, our platform is able to show the statistics such the top-10 liked or commented posts and the gender counts of the posters. The experimental results show that our data analytics platform can do streaming processing and batch processing successfully and reveal useful analytical results.