Skip to main content
Top
Published in: Knowledge and Information Systems 3/2017

12-04-2017 | Regular Paper

CITIESData: a smart city data management framework

Authors: Xiufeng Liu, Alfred Heller, Per Sieverts Nielsen

Published in: Knowledge and Information Systems | Issue 3/2017

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Smart city data come from heterogeneous sources including various types of the Internet of Things such as traffic, weather, pollution, noise, and portable devices. They are characterized with diverse quality issues and with different types of sensitive information. This makes data processing and publishing challenging. In this paper, we propose a framework to streamline smart city data management, including data collection, cleansing, anonymization, and publishing. The paper classifies smart city data in sensitive, quasi-sensitive, and open/public levels and then suggests different strategies to process and publish the data within these categories. The paper evaluates the framework using a real-world smart city data set, and the results verify its effectiveness and efficiency. The framework can be a generic solution to manage smart city data.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
1.
go back to reference Barnaghi P, Bermudez-Edo M, Tonjes R (2015) Challenges for quality of data in smart cities. J Data Inf Qual 6(2–3):6 Barnaghi P, Bermudez-Edo M, Tonjes R (2015) Challenges for quality of data in smart cities. J Data Inf Qual 6(2–3):6
2.
go back to reference Bischof S, Karapantelakis A, Nechifor CS, Sheth A, Mileo A, Barnaghi P (2014) Semantic modelling of smart city data. In: W3C workshop on the web of things—enablers and services for an open web of devices. W3C Bischof S, Karapantelakis A, Nechifor CS, Sheth A, Mileo A, Barnaghi P (2014) Semantic modelling of smart city data. In: W3C workshop on the web of things—enablers and services for an open web of devices. W3C
3.
go back to reference Bischof S, Polleres A, Sperl S (2013) City data pipeline In: Proceedings of the I-SEMANTICS posters and demonstrations track, p 45 Bischof S, Polleres A, Sperl S (2013) City data pipeline In: Proceedings of the I-SEMANTICS posters and demonstrations track, p 45
4.
go back to reference Bovee M, Srivastava RP, Mak B (2003) A conceptual framework and belief-function approach to assessing overall information quality. Int J Intell Syst 18(1):51–74CrossRefMATH Bovee M, Srivastava RP, Mak B (2003) A conceptual framework and belief-function approach to assessing overall information quality. Int J Intell Syst 18(1):51–74CrossRefMATH
5.
go back to reference Cappiello C, Francalanci C, Pernici B (2003) Time-related factors of data quality in multichannel information systems. J Manag Inf Syst 20(3):71–91CrossRef Cappiello C, Francalanci C, Pernici B (2003) Time-related factors of data quality in multichannel information systems. J Manag Inf Syst 20(3):71–91CrossRef
6.
go back to reference Carpineto C, Romano G (2015) K\(\theta \)-affinity privacy: releasing infrequent query refinements safely. Inf Process Manag 51(2):74–88CrossRef Carpineto C, Romano G (2015) K\(\theta \)-affinity privacy: releasing infrequent query refinements safely. Inf Process Manag 51(2):74–88CrossRef
7.
go back to reference Darari F, Manurung R (2011) LinkedLab: a linked data platform for research communities. In: Advanced computer science and information system (ICACSIS), pp 253–258 Darari F, Manurung R (2011) LinkedLab: a linked data platform for research communities. In: Advanced computer science and information system (ICACSIS), pp 253–258
8.
go back to reference Fung B, Wang K, Chen R, Yu PS (2010) Privacy-preserving data publishing: a survey of recent developments. ACM Comput Surv (CSUR) 42(4):14CrossRef Fung B, Wang K, Chen R, Yu PS (2010) Privacy-preserving data publishing: a survey of recent developments. ACM Comput Surv (CSUR) 42(4):14CrossRef
9.
go back to reference Gao F, Ali MI, Mileo A (2014) Semantic discovery and Integration of urban data streams In: Proceedings of the 5th workshop on semantics for smarter cities, pp 15–30 Gao F, Ali MI, Mileo A (2014) Semantic discovery and Integration of urban data streams In: Proceedings of the 5th workshop on semantics for smarter cities, pp 15–30
10.
go back to reference Glasmeier A, Christopherson S (2015) Thinking about smart cities. Camb J Reg Econ Soc 8(1):3–12CrossRef Glasmeier A, Christopherson S (2015) Thinking about smart cities. Camb J Reg Econ Soc 8(1):3–12CrossRef
11.
go back to reference Gubbi J, Buyya R, Marusic S, Palaniswami M (2013) Internet of things (IoT): a vision, architectural elements, and future directions. Future Gener Comput Syst 29(7):1645–1660CrossRef Gubbi J, Buyya R, Marusic S, Palaniswami M (2013) Internet of things (IoT): a vision, architectural elements, and future directions. Future Gener Comput Syst 29(7):1645–1660CrossRef
12.
go back to reference Haslhofer B, Schandl B (2008) The OAI2LOD server: exposing OAI-PMH metadata as linked data. In: Proceedings of WWW workshop linked data on the web Haslhofer B, Schandl B (2008) The OAI2LOD server: exposing OAI-PMH metadata as linked data. In: Proceedings of WWW workshop linked data on the web
13.
go back to reference He Q, Antón AI (2003) A framework for modeling privacy requirements in role engineering. In: Proceedings of REFSQ, pp 137–146 He Q, Antón AI (2003) A framework for modeling privacy requirements in role engineering. In: Proceedings of REFSQ, pp 137–146
14.
go back to reference Li N, Li T, Venkatasubramanian S (2007) t-closeness: privacy beyond k-anonymity and l-diversity. In: Proceedings of ICDE, pp 106–115 Li N, Li T, Venkatasubramanian S (2007) t-closeness: privacy beyond k-anonymity and l-diversity. In: Proceedings of ICDE, pp 106–115
15.
go back to reference Li T, Li N (2009) On the tradeoff between privacy and utility in data publishing. In: Proceedings of SIGKDD, pp 517–526 Li T, Li N (2009) On the tradeoff between privacy and utility in data publishing. In: Proceedings of SIGKDD, pp 517–526
16.
go back to reference Liu X, Nielsen PS (2015) Streamlining smart meter data analytics. In: Proceedings of the 10th conference on sustainable development of energy, water and environment systems. SDEWES2015.0558, pp 1–14 Liu X, Nielsen PS (2015) Streamlining smart meter data analytics. In: Proceedings of the 10th conference on sustainable development of energy, water and environment systems. SDEWES2015.0558, pp 1–14
17.
go back to reference Liu X, Nielsen PS (2016) An ICT-solution for smart meter data analytics. Energy 115(3):1710–1722CrossRef Liu X, Nielsen PS (2016) An ICT-solution for smart meter data analytics. Energy 115(3):1710–1722CrossRef
18.
go back to reference Lopez V, Kotoulas S, Sbodio ML, Stephenson M, Gkoulalas-Divanis A, Aonghusa PM (2012) QuerioCity: a linked data platform for urban information management. The semantic web, pp 148–163 Lopez V, Kotoulas S, Sbodio ML, Stephenson M, Gkoulalas-Divanis A, Aonghusa PM (2012) QuerioCity: a linked data platform for urban information management. The semantic web, pp 148–163
19.
go back to reference Machanavajjhala A, Kifer D, Gehrke J, Venkitasubramaniam M (2013) l-diversity: privacy beyond k-anonymity. ACM Trans Knowl Discov Data 1(1):3CrossRef Machanavajjhala A, Kifer D, Gehrke J, Venkitasubramaniam M (2013) l-diversity: privacy beyond k-anonymity. ACM Trans Knowl Discov Data 1(1):3CrossRef
20.
go back to reference Malin B (2008) k-unlinkability: a privacy protection model for distributed data. Data Knowl Eng 64(1):294–311CrossRef Malin B (2008) k-unlinkability: a privacy protection model for distributed data. Data Knowl Eng 64(1):294–311CrossRef
21.
go back to reference Manville C, Cochrane G, Cave J et al (2014) Mapping smart cities in the EU[J]. European Parliament; Directorate general for internal policies, policy department economic and scientific policy A Manville C, Cochrane G, Cave J et al (2014) Mapping smart cities in the EU[J]. European Parliament; Directorate general for internal policies, policy department economic and scientific policy A
22.
go back to reference Navarro-Arribas G, Torra V, Erola A, Castella-Roca J (2012) User k-anonymity for privacy preserving data mining of query logs. Inf Process Manag 48(3):476–487CrossRef Navarro-Arribas G, Torra V, Erola A, Castella-Roca J (2012) User k-anonymity for privacy preserving data mining of query logs. Inf Process Manag 48(3):476–487CrossRef
23.
go back to reference Parreira JX, Dhungana D, Engelbrecht G (2015) The role of RDF stream processing in an smart city ICT infrastructure–the Aspern smart city use case. The semantic web: ESWC 2015 satellite events, pp 343–352 Parreira JX, Dhungana D, Engelbrecht G (2015) The role of RDF stream processing in an smart city ICT infrastructure–the Aspern smart city use case. The semantic web: ESWC 2015 satellite events, pp 343–352
24.
go back to reference Pipino L, Lee YW, Wang RY (2012) Data quality assessment. Commun ACM 4:211–218 Pipino L, Lee YW, Wang RY (2012) Data quality assessment. Commun ACM 4:211–218
25.
go back to reference Qin H, Li H, Zhao X (2010) Development status of domestic and foreign smart city. Glob Presence 9:50–52 Qin H, Li H, Zhao X (2010) Development status of domestic and foreign smart city. Glob Presence 9:50–52
26.
go back to reference Rahm E, Do HH (2000) Data cleaning: problems and current approaches. IEEE Data Eng Bull 23(4):3–13 Rahm E, Do HH (2000) Data cleaning: problems and current approaches. IEEE Data Eng Bull 23(4):3–13
27.
go back to reference Redman TC (1996) Data quality for the information age. Artech House, Boston, MA Redman TC (1996) Data quality for the information age. Artech House, Boston, MA
28.
go back to reference Samarati P, Sweeney L (1998) Generalizing data to provide anonymity when disclosing information. In: Proceedings of SIGMOD-SIGACT-SIGART symposium on the principles of database systems Samarati P, Sweeney L (1998) Generalizing data to provide anonymity when disclosing information. In: Proceedings of SIGMOD-SIGACT-SIGART symposium on the principles of database systems
29.
go back to reference Santos H, Pinheiro P, McGuinness DL (2015) Contextual data collection for smart cities. In: Proceedings of the 6th workshop on semantics for smarter cities Santos H, Pinheiro P, McGuinness DL (2015) Contextual data collection for smart cities. In: Proceedings of the 6th workshop on semantics for smarter cities
30.
go back to reference Scannapieco M, Catarci T (2002) Data quality under a computer science perspective. Arch Comput 2:1–15 Scannapieco M, Catarci T (2002) Data quality under a computer science perspective. Arch Comput 2:1–15
31.
go back to reference Snigdha C, Tanveer AF, Hima PK, Mukesh KM, Venkata S (2015) Cleansing a database system to improve data quality. US Patent US9,104709 B2 Snigdha C, Tanveer AF, Hima PK, Mukesh KM, Venkata S (2015) Cleansing a database system to improve data quality. US Patent US9,104709 B2
32.
go back to reference Su K, Li J, Fu H (2011) Smart city and the applications. In: Electronics, communications and control (ICECC), pp 1028–1031 Su K, Li J, Fu H (2011) Smart city and the applications. In: Electronics, communications and control (ICECC), pp 1028–1031
33.
go back to reference Sweeney L (2002) Achieving k-anonymity privacy protection using generalization and suppression. J Uncertain Fuzziness Knowl Based Syst 10(5):571–588MathSciNetCrossRefMATH Sweeney L (2002) Achieving k-anonymity privacy protection using generalization and suppression. J Uncertain Fuzziness Knowl Based Syst 10(5):571–588MathSciNetCrossRefMATH
34.
go back to reference Thomsen C, Pedersen TB (2009) Pygrametl: a powerful programming framework for extract-transform-load programmers. In: Proceedings of DOLAP, pp 49–56 Thomsen C, Pedersen TB (2009) Pygrametl: a powerful programming framework for extract-transform-load programmers. In: Proceedings of DOLAP, pp 49–56
35.
go back to reference Thusoo A, Sarma JS, Jain N, Shao Z, Chakka P, Zhang N, Murthy R (2010) Hive-a petabyte scale data warehouse using Hadoop. In: Proceedings of ICDE, pp 996–1005 Thusoo A, Sarma JS, Jain N, Shao Z, Chakka P, Zhang N, Murthy R (2010) Hive-a petabyte scale data warehouse using Hadoop. In: Proceedings of ICDE, pp 996–1005
36.
go back to reference Wand Y, Wang RY (1996) Anchoring data quality dimensions in ontological foundations. Commun ACM 39(11):86–95CrossRef Wand Y, Wang RY (1996) Anchoring data quality dimensions in ontological foundations. Commun ACM 39(11):86–95CrossRef
37.
go back to reference Wong RC, Li J, Fu AWC, Wang K (2007) K-anonymity: an enhanced k-anonymity model for privacy preserving data publishing. In: Proceedings of SIGKDD, pp 754–759 Wong RC, Li J, Fu AWC, Wang K (2007) K-anonymity: an enhanced k-anonymity model for privacy preserving data publishing. In: Proceedings of SIGKDD, pp 754–759
38.
go back to reference Zanella A, Bui N, Castellani A, Vangelista L, Zorzi M (2014) Internet of things for smart cities. Internet Things J 1(1):22–32CrossRef Zanella A, Bui N, Castellani A, Vangelista L, Zorzi M (2014) Internet of things for smart cities. Internet Things J 1(1):22–32CrossRef
39.
go back to reference Zaveri A, Rula A, Maurino A, Pietrobon R, Lehmann J, Auer S (2016) Quality assessment for linked data: a survey. Semantic Web J 7(1):63–93CrossRef Zaveri A, Rula A, Maurino A, Pietrobon R, Lehmann J, Auer S (2016) Quality assessment for linked data: a survey. Semantic Web J 7(1):63–93CrossRef
Metadata
Title
CITIESData: a smart city data management framework
Authors
Xiufeng Liu
Alfred Heller
Per Sieverts Nielsen
Publication date
12-04-2017
Publisher
Springer London
Published in
Knowledge and Information Systems / Issue 3/2017
Print ISSN: 0219-1377
Electronic ISSN: 0219-3116
DOI
https://doi.org/10.1007/s10115-017-1051-3

Other articles of this Issue 3/2017

Knowledge and Information Systems 3/2017 Go to the issue

Premium Partner