Skip to main content

2017 | OriginalPaper | Buchkapitel

Towards Big Data Quality Framework for Malaysia’s Public Sector Open Data Initiative

verfasst von : Mohamad Taha Ijab, Azlina Ahmad, Rabiah Abdul Kadir, Suraya Hamid

Erschienen in: Advances in Visual Informatics

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper is about the conceptual development of the Big Data Quality Framework for Malaysia’s Public Sector Open Data Initiative (My-PSODI). At the moment, there is a lack of Big Data Quality Framework in existence particularly that is focusing on the specific context and needs of Malaysia’s Public Sector Open Data initiative. Most of existing data quality frameworks are catering the needs of traditional data types (i.e., structured data) and are very generic in nature. Due to the explosion of big data which consists mostly of unstructured data and structured data, and Malaysia’s vision of leveraging data in modernizing its service delivery, a new framework addressing the needs of Big Data for Malaysia is needed. Based on an extensive literature review, we develop a conceptual framework and systematic methodologies of how to construct the said framework to its fruition.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
4.
Zurück zum Zitat Laranjeiro, N., Soydemir, S.N., Bernardino, J.: A survey on data quality: classifying poor data. In: IEEE 21st Pacific Rim International Symposium on Dependable Computing, 18–20 November, Zhangjiajie, China (2015) Laranjeiro, N., Soydemir, S.N., Bernardino, J.: A survey on data quality: classifying poor data. In: IEEE 21st Pacific Rim International Symposium on Dependable Computing, 18–20 November, Zhangjiajie, China (2015)
7.
Zurück zum Zitat Abdel Hafez, H.A.: Mining big data in telecommunications industry: challenges, techniques, and revenue opportunity. Int. J. Comput. Electr. Autom. Control Inf. Eng. 10(1), 183–190 (2016) Abdel Hafez, H.A.: Mining big data in telecommunications industry: challenges, techniques, and revenue opportunity. Int. J. Comput. Electr. Autom. Control Inf. Eng. 10(1), 183–190 (2016)
8.
Zurück zum Zitat Cai, L., Zhu, Y.: The challenges of data quality and data quality assessment in the big data era. Data Sci. J. 14(2), 1–10 (2015) Cai, L., Zhu, Y.: The challenges of data quality and data quality assessment in the big data era. Data Sci. J. 14(2), 1–10 (2015)
9.
Zurück zum Zitat Saha, B., Srivastava, D.: Data quality: the other face of big data. In: IEEE 30th International Conference on Data Engineering (ICDE), 31 March–4 April, Chicago, IL (2014) Saha, B., Srivastava, D.: Data quality: the other face of big data. In: IEEE 30th International Conference on Data Engineering (ICDE), 31 March–4 April, Chicago, IL (2014)
10.
Zurück zum Zitat Chen, M., Song, M., Han, J., Haihong, E.: Survey on data quality. In: 2012 World Congress on Information and Communication Technologies (WICT), 30 October–2 November, Trivandrum, India (2012) Chen, M., Song, M., Han, J., Haihong, E.: Survey on data quality. In: 2012 World Congress on Information and Communication Technologies (WICT), 30 October–2 November, Trivandrum, India (2012)
12.
Zurück zum Zitat Lucas, A.: Corporate data quality management: from theory to practice. In: 5th Iberian Conference on Information Systems and Technologies (CISTI), 16–19 June, Santiago, Spain (2010) Lucas, A.: Corporate data quality management: from theory to practice. In: 5th Iberian Conference on Information Systems and Technologies (CISTI), 16–19 June, Santiago, Spain (2010)
13.
Zurück zum Zitat Abdullah, N., Ismail, S.A., Sophiayati, S., Mohd Sam, S.: Data quality in big data: a review. Int. J. Adv. Soft Comput. Appl. 7(3), 16–27 (2015) Abdullah, N., Ismail, S.A., Sophiayati, S., Mohd Sam, S.: Data quality in big data: a review. Int. J. Adv. Soft Comput. Appl. 7(3), 16–27 (2015)
14.
Zurück zum Zitat Fan, W., Geerts, F.: Foundations of data management. Synth. Lect. Data Manag. 4(5), 1–217 (2012). Morgan & Claypool Fan, W., Geerts, F.: Foundations of data management. Synth. Lect. Data Manag. 4(5), 1–217 (2012). Morgan & Claypool
15.
Zurück zum Zitat General Administration of Quality Supervision, Inspection and Quarantine of the People’s Republic of China. Quality management systems-fundamentals and vocabulary (GB/T19000—2008/ISO9000:2005), Beijing (2008) General Administration of Quality Supervision, Inspection and Quarantine of the People’s Republic of China. Quality management systems-fundamentals and vocabulary (GB/T19000—2008/ISO9000:2005), Beijing (2008)
16.
Zurück zum Zitat Wang, R.Y., Strong, D.M.: Beyond accuracy: what data quality means to data consumers. J. Manag. Inf. Syst. 12(4), 5–33 (1996)CrossRef Wang, R.Y., Strong, D.M.: Beyond accuracy: what data quality means to data consumers. J. Manag. Inf. Syst. 12(4), 5–33 (1996)CrossRef
17.
Zurück zum Zitat Crosby, P.B.: Quality is Free: The Art of Making Quality Certain. McGraw-Hill, New York (1988) Crosby, P.B.: Quality is Free: The Art of Making Quality Certain. McGraw-Hill, New York (1988)
18.
Zurück zum Zitat Juran, J.M.: Juran on Leadership for Quality: An Executive Handbook. The Free Press, New York (1989) Juran, J.M.: Juran on Leadership for Quality: An Executive Handbook. The Free Press, New York (1989)
19.
Zurück zum Zitat Alexander, J.E., Tate, M.A.: Web Wisdom: How to Evaluate and Create Information on the Web. Erlbaum, Mahwah (1999) Alexander, J.E., Tate, M.A.: Web Wisdom: How to Evaluate and Create Information on the Web. Erlbaum, Mahwah (1999)
20.
Zurück zum Zitat Shanks, G., Corbitt, B.: Understanding data quality: social and cultural aspects. In: Proceedings of the 10th Australasian Conference on Information Systems, pp. 785–797. MCB University Press Ltd., Wellington (1999) Shanks, G., Corbitt, B.: Understanding data quality: social and cultural aspects. In: Proceedings of the 10th Australasian Conference on Information Systems, pp. 785–797. MCB University Press Ltd., Wellington (1999)
21.
Zurück zum Zitat Zhu, X., Gauch, S.: Incorporating quality metrics in centralised/distributed information retrieval on the world wide web. In: SIGIR 2000 Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 24–28 July, Athens, Greece (2000) Zhu, X., Gauch, S.: Incorporating quality metrics in centralised/distributed information retrieval on the world wide web. In: SIGIR 2000 Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 24–28 July, Athens, Greece (2000)
22.
Zurück zum Zitat Batini, C., Scannapeico, M.: Data Quality: Concepts, Methodologies and Techniques. Springer, Berlin (2006)MATH Batini, C., Scannapeico, M.: Data Quality: Concepts, Methodologies and Techniques. Springer, Berlin (2006)MATH
23.
Zurück zum Zitat Krogstie, J.: Capturing enterprise data integration challenges using a semiotic data quality framework. Bus. Inf. Syst. Eng. 57(1), 27–36 (2015)CrossRef Krogstie, J.: Capturing enterprise data integration challenges using a semiotic data quality framework. Bus. Inf. Syst. Eng. 57(1), 27–36 (2015)CrossRef
24.
Zurück zum Zitat Taleb, I., Dssouli, R., Serhani, M.A.: Big data pre-processing: a quality framework. In: 4th IEEE International Congress on Big Data, Santa Clara, CA 29 October–1 November (2015) Taleb, I., Dssouli, R., Serhani, M.A.: Big data pre-processing: a quality framework. In: 4th IEEE International Congress on Big Data, Santa Clara, CA 29 October–1 November (2015)
25.
Zurück zum Zitat Juddoo, S.: Overview of data quality challenges in the context of big data. In: International Conference on Computing, Communication and Security (ICCCS), Mauritius, 4–5 December (2015) Juddoo, S.: Overview of data quality challenges in the context of big data. In: International Conference on Computing, Communication and Security (ICCCS), Mauritius, 4–5 December (2015)
26.
Zurück zum Zitat Batini, C., Rula, A., Scannapieco, M., Viscusi, G.: From Data Quality to Big Data Quality, Big Data Concepts, Methodologies, Tools, and Applications, pp. 1934–1956. IGI Global, Hershey (2016)CrossRef Batini, C., Rula, A., Scannapieco, M., Viscusi, G.: From Data Quality to Big Data Quality, Big Data Concepts, Methodologies, Tools, and Applications, pp. 1934–1956. IGI Global, Hershey (2016)CrossRef
27.
Zurück zum Zitat Ijab, M.T., Ahmad, A., Abdul Kadir, R.: Challenge of data quality: towards a big data quality framework. In: IMPACT: Technologies for Society’s Well-Being, Universiti Kebangsaan Malaysia (UKM), p. 44 (2016) Ijab, M.T., Ahmad, A., Abdul Kadir, R.: Challenge of data quality: towards a big data quality framework. In: IMPACT: Technologies for Society’s Well-Being, Universiti Kebangsaan Malaysia (UKM), p. 44 (2016)
Metadaten
Titel
Towards Big Data Quality Framework for Malaysia’s Public Sector Open Data Initiative
verfasst von
Mohamad Taha Ijab
Azlina Ahmad
Rabiah Abdul Kadir
Suraya Hamid
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-70010-6_8