Skip to main content
Top

2016 | OriginalPaper | Chapter

Implementation of Data Analytics for MongoDB Using Trigger Utility

Authors : Kalpana Dwivedi, Sanjay Kumar Dubey

Published in: Computational Intelligence in Data Mining—Volume 1

Publisher: Springer India

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

SQL based traditional databases like Oracle; SQL server offers the capability to develop programs like Trigger. Trigger is a very important feature provided by many databases, especially useful in monitoring, rule enforcement, data validation and data analytics etc. MongoDB is non SQL document oriented database. MongoDB is the fastest growing and most demanding non SQL database. Since MongoDB primarily is operated using its out of box tools like mongo, mongos, bsondump, mongod, mongoexport and Java script function. MongoDB does not provide in-built feature for triggers which is very efficient in data analytics, monitoring and reporting purpose. Paper presents two utility in which one utility is a listener or poller utility which is developed to give similar feature like trigger and after that second utility is developed which gives historical data analytic capability on Mongo database by using the trigger utility. It pulls the data from analytic collection and generates the graph. Data analytic tools plays vital role in decision making in today’s complex business environment where data size is very huge and unstructured by nature.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Chang, F., Dean, J., Ghemawat, S., Hsieh, W., Burrows, M., Chandra, T., Andrew Fikes, A., Gruber, R.: Bigtable: a distributed storage system for structured data OSDI’06. In: Seventh Symposium on Operating System Design and Implementation, Seattle, WA (2006) Chang, F., Dean, J., Ghemawat, S., Hsieh, W., Burrows, M., Chandra, T., Andrew Fikes, A., Gruber, R.: Bigtable: a distributed storage system for structured data OSDI’06. In: Seventh Symposium on Operating System Design and Implementation, Seattle, WA (2006)
2.
go back to reference Han, J., Le, G.: Survey on NoSQL database in IEEE (2011). 978-1-4577-0208-2 Han, J., Le, G.: Survey on NoSQL database in IEEE (2011). 978-1-4577-0208-2
3.
go back to reference Abouzeid, A.: Hadoop DB: an architectural hybrid of mapreduce and DBMS technologies for analytical workloads. In: Proceedings of the VLDB End Abouzeid, A.: Hadoop DB: an architectural hybrid of mapreduce and DBMS technologies for analytical workloads. In: Proceedings of the VLDB End
4.
go back to reference Levitt, N.: Will NoSQL databases live up to their promise. IEEE Comput. Soc. 43(2), 922–933 (2009) Levitt, N.: Will NoSQL databases live up to their promise. IEEE Comput. Soc. 43(2), 922–933 (2009)
5.
go back to reference Han, I., Haihong, E., Le, G., Du, J.: Survey on NoSQL database. In: 6th International Conference on Pervasive Computing and Applications, pp. 363–366 (2011) Han, I., Haihong, E., Le, G., Du, J.: Survey on NoSQL database. In: 6th International Conference on Pervasive Computing and Applications, pp. 363–366 (2011)
6.
go back to reference Padhy, R., Patra, M., Satapathy, S.: RDBMS to NoSQL: Reviewing some next-generation non-relational database’s. Int. J. Adv. Eng. Sci. Technol. 11(1), 015–030 (2011) Padhy, R., Patra, M., Satapathy, S.: RDBMS to NoSQL: Reviewing some next-generation non-relational database’s. Int. J. Adv. Eng. Sci. Technol. 11(1), 015–030 (2011)
7.
go back to reference Rutishauser, N.: TPC-H applied to MongoDB: how a NoSQL database performs supervised by Prof. Dr. Michael B¨ohlen. Amr Noureldin 349 (2012) Rutishauser, N.: TPC-H applied to MongoDB: how a NoSQL database performs supervised by Prof. Dr. Michael B¨ohlen. Amr Noureldin 349 (2012)
8.
go back to reference DeCandia, G., Hastorun, D., Jampani, M.: Dynamo: amazon’s highly available key-value store. SOSP’07. Stevenson, Washington, USA (2007) DeCandia, G., Hastorun, D., Jampani, M.: Dynamo: amazon’s highly available key-value store. SOSP’07. Stevenson, Washington, USA (2007)
9.
go back to reference Tudorica, B., Bucur, C.: A comparison between several NoSQL databases with comments and notes. In: Roedunet International Conference (2011) Tudorica, B., Bucur, C.: A comparison between several NoSQL databases with comments and notes. In: Roedunet International Conference (2011)
10.
go back to reference Kanade, A., Gopal, A.: An experimental study on open source RDBMS FDI issues and prospects. In: National Conference, pp. 203–206 (2013) Kanade, A., Gopal, A.: An experimental study on open source RDBMS FDI issues and prospects. In: National Conference, pp. 203–206 (2013)
11.
go back to reference Hecht, R., Jablinski, S.: NoSQL evaluation a use case oriented survey. In: Proceedings International Conference on Cloud and Service Computing, pp. 12–14 (2011) Hecht, R., Jablinski, S.: NoSQL evaluation a use case oriented survey. In: Proceedings International Conference on Cloud and Service Computing, pp. 12–14 (2011)
12.
go back to reference Adam, L., Jakob Mattson, J.: Investigating storage solutions for large data: a comparison of well performing and scalable data storage solutions for real time extraction and batch insertion of data (2011) Adam, L., Jakob Mattson, J.: Investigating storage solutions for large data: a comparison of well performing and scalable data storage solutions for real time extraction and batch insertion of data (2011)
13.
go back to reference Yang, H., Dasdan, A., Hsiao, R., Parker, D.: Map-reduce-merge: simplified relational data processing on large clusters. In: Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD ‘07), pp. 1029–1040. ACM, New York, NY, USA (2007) Yang, H., Dasdan, A., Hsiao, R., Parker, D.: Map-reduce-merge: simplified relational data processing on large clusters. In: Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD ‘07), pp. 1029–1040. ACM, New York, NY, USA (2007)
14.
go back to reference Veen, J., Waaij, B., Meijer, R.: Sensor data storage performance: SQL or NoSQL. In: Physical or Virtual Fifth International Conference on Cloud Computing, pp. 431–438. IEEE (2012) Veen, J., Waaij, B., Meijer, R.: Sensor data storage performance: SQL or NoSQL. In: Physical or Virtual Fifth International Conference on Cloud Computing, pp. 431–438. IEEE (2012)
15.
go back to reference Sanders, G., Shin, S.: Denormalization effects on performance of RDBMS. In: Proceedings of the 34th Hawaii International Conference on System Sciences, pp. 1–9. IEEE (2001) Sanders, G., Shin, S.: Denormalization effects on performance of RDBMS. In: Proceedings of the 34th Hawaii International Conference on System Sciences, pp. 1–9. IEEE (2001)
16.
go back to reference Cruz, F., J. Pereira, J., Oliveira, R.: An effective scalable SQL engine for NoSQL databases in distributed applications and interoperable systems, pp. 155–168. Springer (2013) Cruz, F., J. Pereira, J., Oliveira, R.: An effective scalable SQL engine for NoSQL databases in distributed applications and interoperable systems, pp. 155–168. Springer (2013)
17.
go back to reference Calil, A., Mello, R.: SimpleSQL: a relational layer for SimpleDB in ADBIS, pp. 99–110 (2012) Calil, A., Mello, R.: SimpleSQL: a relational layer for SimpleDB in ADBIS, pp. 99–110 (2012)
18.
go back to reference Stonebraker, M.: SQL databases v. NoSQL databases. Commun. ACM 53(4), 10–11 (2010) Stonebraker, M.: SQL databases v. NoSQL databases. Commun. ACM 53(4), 10–11 (2010)
19.
go back to reference Roijackers, J., Fletcher, L.H.G.: On bridging relational and document-centric data stores in BNCOD, pp. 135–148 (2013) Roijackers, J., Fletcher, L.H.G.: On bridging relational and document-centric data stores in BNCOD, pp. 135–148 (2013)
20.
go back to reference Hacigumus, H., Tatemura, J., PHsiung, W., Moon, H., Chi, Y.: CloudDB: one size fits all revived in services, pp. 148–149 (2010) Hacigumus, H., Tatemura, J., PHsiung, W., Moon, H., Chi, Y.: CloudDB: one size fits all revived in services, pp. 148–149 (2010)
21.
go back to reference Ameri, P., Grabowski, U., Meyer, J., Streit, A.: On the application and performance of MongoDB for climate satellite data. In: Proceedings of 13th International Conference on Trust, Security and Privacy in Computing and Communications in IEEE (2014) Ameri, P., Grabowski, U., Meyer, J., Streit, A.: On the application and performance of MongoDB for climate satellite data. In: Proceedings of 13th International Conference on Trust, Security and Privacy in Computing and Communications in IEEE (2014)
22.
go back to reference Wu, S., Jiang, S., Ooi, B., Tan, K.: Distributed online aggregations. In: Proceedings VLDB, pp. 443–454 (2009) Wu, S., Jiang, S., Ooi, B., Tan, K.: Distributed online aggregations. In: Proceedings VLDB, pp. 443–454 (2009)
23.
go back to reference Pavlo, A.: A comparison of approaches to large-scale data analysis. In: Proceedings of the ACM SIGMOD, pp. 165–178 (2009) Pavlo, A.: A comparison of approaches to large-scale data analysis. In: Proceedings of the ACM SIGMOD, pp. 165–178 (2009)
24.
go back to reference Padhy, R., Patra, M., Satapathy, S.: RDBMS to NoSQL: reviewing some next-generation non-relational database’s. Int. J. Adv. Eng. Sci. Technol. 11(1), 015–030 (2011) Padhy, R., Patra, M., Satapathy, S.: RDBMS to NoSQL: reviewing some next-generation non-relational database’s. Int. J. Adv. Eng. Sci. Technol. 11(1), 015–030 (2011)
25.
26.
go back to reference Huang, S., Cai, L., Liu, Z., Hu, Y.: Non-structure data storage technology: a discussion computer and information science (ICIS), pp. 482–487 (2012) Huang, S., Cai, L., Liu, Z., Hu, Y.: Non-structure data storage technology: a discussion computer and information science (ICIS), pp. 482–487 (2012)
27.
go back to reference Tauro, C.S.A.: Comparative study of the new generation, agile, scalable, high performance NOSQL database. Int. J. Comput. Appl. 48(20), Commun. ACM, 25(4), 0975–888 (2012) Tauro, C.S.A.: Comparative study of the new generation, agile, scalable, high performance NOSQL database. Int. J. Comput. Appl. 48(20), Commun. ACM, 25(4), 0975–888 (2012)
28.
go back to reference Chitra, K., Jeevarani, B.: Study on basically available, scalable and eventually consistent NOSQL databases. Int. J. Adv. Res. Comput. Sci. Softw. Eng. 3(7) (2013) Chitra, K., Jeevarani, B.: Study on basically available, scalable and eventually consistent NOSQL databases. Int. J. Adv. Res. Comput. Sci. Softw. Eng. 3(7) (2013)
29.
go back to reference Mohan, B., Govardhan, A.: Online aggregation using MapReduce in MongoDB. Int. J. Adv. Res. Comput. Sci. Softw. Eng. 3(9) (2013) Mohan, B., Govardhan, A.: Online aggregation using MapReduce in MongoDB. Int. J. Adv. Res. Comput. Sci. Softw. Eng. 3(9) (2013)
30.
go back to reference Dede, E., Govindraju, M.: Performance evaluation of a MongoDB and Hadoop platform for scientific data analysis. In: Proceedings of the 4th ACM Workshop on Scientific Cloud Computing (2013) Dede, E., Govindraju, M.: Performance evaluation of a MongoDB and Hadoop platform for scientific data analysis. In: Proceedings of the 4th ACM Workshop on Scientific Cloud Computing (2013)
31.
go back to reference Khan, S., Mane, V.: SQL support over MongoDB using metadata. Int. J. Sci. Res. Public. 3(10) (2013) Khan, S., Mane, V.: SQL support over MongoDB using metadata. Int. J. Sci. Res. Public. 3(10) (2013)
32.
go back to reference Liu, Y., Wang, Y., Jin, Y.: Research on the improvement of MongoDB auto-sharding in cloud environment in computer science and education (ICCSE), pp. 851–854 (2012) Liu, Y., Wang, Y., Jin, Y.: Research on the improvement of MongoDB auto-sharding in cloud environment in computer science and education (ICCSE), pp. 851–854 (2012)
33.
go back to reference Boicea, A., Radulescu, F., Agapin, L.: MongoDB vs Oracle: database comparison. In: Third International Conference on Emerging Intelligent Data and Web Technologies (2012) Boicea, A., Radulescu, F., Agapin, L.: MongoDB vs Oracle: database comparison. In: Third International Conference on Emerging Intelligent Data and Web Technologies (2012)
34.
go back to reference Zhao, G., Huang, W., Liang, S., Tang1, Y.: Modeling MongoDB with relational model. In: Fourth International Conference on Emerging Intelligent Data and Web Technologies (2013) Zhao, G., Huang, W., Liang, S., Tang1, Y.: Modeling MongoDB with relational model. In: Fourth International Conference on Emerging Intelligent Data and Web Technologies (2013)
35.
go back to reference Kanade, A., Gopal, A., Kanade, S.: A study of normalization and embedding in MongoDB in IEEE (2014) Kanade, A., Gopal, A., Kanade, S.: A study of normalization and embedding in MongoDB in IEEE (2014)
36.
go back to reference Murugesan, P., Ray, I.: Audit log management in MongoDB. In: IEEE 10th World Congress on Services (2014) Murugesan, P., Ray, I.: Audit log management in MongoDB. In: IEEE 10th World Congress on Services (2014)
37.
go back to reference Xinwei, J., Guicheng, S.: Managing RFID data in MongoDB Workshop on Advanced Research and Technology in Industry Applications (WARTIA) in IEEE (2014) Xinwei, J., Guicheng, S.: Managing RFID data in MongoDB Workshop on Advanced Research and Technology in Industry Applications (WARTIA) in IEEE (2014)
38.
go back to reference Dwivedi, K., Dubey S.K.: Analytical review on Hadoop distributed files system. In: Proceeding of 5th International Conference on the Next Generation Information Technology Summit (Confluence), pp. 174–181. IEEE (2014) Dwivedi, K., Dubey S.K.: Analytical review on Hadoop distributed files system. In: Proceeding of 5th International Conference on the Next Generation Information Technology Summit (Confluence), pp. 174–181. IEEE (2014)
39.
go back to reference Parker, Z., Poe, S., Vrbsky, S.: Comparing NoSQL MongoDB to an SQL DB. In: Proceedings of the 51st ACM Southeast Conference (2013) Parker, Z., Poe, S., Vrbsky, S.: Comparing NoSQL MongoDB to an SQL DB. In: Proceedings of the 51st ACM Southeast Conference (2013)
40.
go back to reference Abramova, V., Bernardino, J.: NoSQL Databases: MongoDB vs. Cassandra. In: Proceedings of the International C* Conference on Computer Science and Software Engineering (2013) Abramova, V., Bernardino, J.: NoSQL Databases: MongoDB vs. Cassandra. In: Proceedings of the International C* Conference on Computer Science and Software Engineering (2013)
Metadata
Title
Implementation of Data Analytics for MongoDB Using Trigger Utility
Authors
Kalpana Dwivedi
Sanjay Kumar Dubey
Copyright Year
2016
Publisher
Springer India
DOI
https://doi.org/10.1007/978-81-322-2734-2_5

Premium Partner