Top

Journal of Intelligent Manufacturing

Published in:

30-06-2015

Towards a product design assessment of visual analytics in decision support applications: a systematic review

Authors: Ovo Adagha, Richard M. Levy, Sheelagh Carpendale

Published in: Journal of Intelligent Manufacturing | Issue 7/2017

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

There is currently an increasing effort to develop visual analytics (VA) tools that can support human analytical reasoning and decision making. In the last decade, advances in this field has allowed the application of various kinds of VA systems in real-world settings. While this represents a promising start from a product design perspective, part of the challenge to the research community is that current VA tools have evolved without due consideration of standardized design criteria and processes. Accordingly, some questions remain to be addressed on what are the useful, underlying attributes of effective VA tools and how their impact can be measured in human-product interaction. These considerations indicate a need to identify a specific range of VA tools and assess their capabilities through state-of-the-art empirical analysis. To address these issues, we conducted a systematic review of 470 VA papers published between 2006 and 2012. We report on the bibliometric techniques, the evaluation attributes and the metrics that were used to sample and analyze the body of literature. The analysis focused mainly on 26 papers that implemented visual analytics decision support tools. The results are presented in the form of six inductively derived design recommendations that, when taken together, uniquely contribute to the fields of product design and visual analytics.

previous article Effects of stress and effort on self-rated reports in experimental study of design activities

next article Expectation effect of perceptual experience in sensory modality transitions: modeling with information theory

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Afzal, S., Maciejewski, R., & Ebert, D. S. (2011). Visual analytics decision support environment for epidemic modeling and response evaluation. In 2011 IEEE conference on visual analytics science and technology (VAST) (pp. 191–200).

Alavi, M., & Napier, H. A. (1984). An experiment in applying the adaptive design approach to DSS development. Information and Management, 7(1), 21–28.CrossRef

Alben, L. (1996). Quality of experience. Interactions, 3(3), 11–15.CrossRef

Andrienko, G., Andrienko, N., & Bartling, U. (2007). Visual analytics approach to user-controlled evacuation scheduling. In IEEE symposium on visual analytics science and technology (pp. 43–50).

Aragon, C. R., Aldering, G. S., & Thomas, R. C. (2008). Using visual analytics to maintain situation awareness in astrophysics. In IEEE symposium on visual analytics science and technology (pp. 27–34).

Bennett, J. L. (1976). User-oriented graphics systems for decision support in unstructured tasks. In Proceedings of the ACM/SIGGRAPH workshop on user-oriented design of interactive graphics systems.

Bilgic, M. (2006). D-dupe: An interactive tool for entity resolution in social networks. In IEEE symposium on visual analytics science and technology (pp. 43–50).

Booshehrian, M., Möller, T., Peterman, R. M., & Munzner, T. (2012). Vismon: Facilitating analysis of trade-offs, uncertainty, and sensitivity in fisheries management decision making. Computer Graphics Forum, 31(3), 1235–1244.CrossRef

Burnell, L., Priest, J., & Briggs, K. (1991). An intelligent decision theoretic approach to producibility optimization in conceptual design. Journal of Intelligent Manufacturing, 2(3), 189–196.CrossRef

Chang, R., Ghoniem, M., Kosara, R., Ribarsky, W., Yamg, Y., Suma, E., et al. (2007). WireVis: Visualization of categorical, time-varying data from financial transactions. In IEEE symposium on visual analytics science and technology (pp. 155–162).

Chen, C., Ibekwe-sanjuan, F., Sanjuan, E., & Weaver, C. (2006). Visual analysis of conflicting opinions. In IEEE symposium on visual analytics science and technology.

Chinchor, N., Cook, K., & Scholtz, J. (2012). Building adoption of visual analytics software. In J. Dill, R. Earnshaw, D. Kasik, J. Vince, & P. C. Wong (Eds.), Expanding the frontiers of visual analytics and visualization (pp. 509–530). London: Springer.CrossRef

Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37–46.CrossRef

Crossno, P. J., Dunlavy, D. M., & Shead, T. M. (2009). LSAView: A tool for visual exploration of latent semantic modeling. In 2009 IEEE symposium on visual analytics science and technology (pp. 83–90). IEEE.

Damodaran, L. (1996). User involvement in the systems design process—a practical guide for users. Behaviour and Information Technology, 15(6), 363–377.

Davis, F. (1985). A technology acceptance model for empirically testing new end-user information systems: Theory and results. Doctoral dissertation, Massachusetts Institute of Technology.

Davis, F. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13(3), 319–340.CrossRef

Despont-Gros, C., Mueller, H., & Lovis, C. (2005). Evaluating user interactions with clinical information systems: A model based on human-computer interaction models. Journal of Biomedical Informatics, 38, 244–255.CrossRef

Diakopoulos, N., Naaman, M., & Kivran-swaine, F. (2010). Diamonds in the rough: Social media visual analytics for journalistic inquiry. In IEEE symposium on visual analytics science and technology (pp. 115–122).

Endsley, M. R. (1988). Design and evaluation for situation awareness enhancement. In Proceedings of the human factors and ergonomics society annual meeting (pp. 97–101).

Endsley, M. R. (1995). Toward a theory of situation awareness in dynamic systems. Human Factors: The Journal of the Human Factors and Ergonomics Society, 37(1), 32–64.CrossRef

Green, T. M., Wakkary, R., & Arias-hernández, R. (2011). Expanding the scope: Interaction design perspectives for visual analytics. In 44th Hawaii international conference on system sciences (pp. 1–10).

Guo, D. (2007). Visual analytics of spatial interaction patterns for pandemic decision support. International Journal of Geographical Information Science, 21(8), 859–877.CrossRef

Guo, Z., Ward, M. O., & Rundensteiner, E. a. (2009). Model space visualization for multivariate linear trend discovery. In 2009 IEEE symposium on visual analytics science and technology (pp. 75–82). IEEE.

Han, Y., Stuntebeck, E. P., Stasko, J. T., & Abowd, G. D. (2009). A visual analytics system for radio frequency fingerprinting-based localization. In 2009 IEEE symposium on visual analytics science and technology (pp. 35–42). IEEE.

Hassenzahl, M. (2005). The thing and I: Understanding the relationship between user and product. Funology, 3, 31–42.

Hassenzahl, M., & Tractinsky, N. (2006). User experience—a research agenda. Behaviour and Information Technology, 25, 91–97.

Higgins, J. P., & Green, S. (2008). Cochrane handbook for systematic reviews of interventions: Cochrane book series.

ISO 9241–110. (2006). Ergonomics of Human System Interaction.

Jeong, D. H., Dou, W., Lipford, H. R., Stukes, F., Chang, R., & Ribarsky, W. (2008). Evaluating the relationship between user interaction and financial visual analysis. In Visual analytics science and technology (pp. 83–90).

Kang, Y., & Stasko, J. (2012). Examining the use of a visual analytics system for sensemaking tasks: Case studies with domain experts. IEEE Transactions on Visualization and Computer Graphics, 18(12), 2869–2878.CrossRef

Kim, S. Y., Jang, Y., Mellema, A., Ebert, D. S., & Collinss, T. (2007). Visual analytics on mobile devices for emergency response. In IEEE symposium on visual analytics science and technology (pp. 35–42). Sacramento: IEEE.

Kluse, M., Peurrung, A., & Gracio, D. (2012). The evolving leadership path of visual analytics. In J. Dill, R. Earnshaw, D. Kasik, J. Vince, & P. C. Wong (Eds.), Expanding the frontiers of visual analytics and visualization (pp. 31–42). London: Springer.CrossRef

Konecni, S., Grinstein, G., Costello, L., & Byrne, H. (2010). Scenario design for evaluation of visual analytics tools to support pandemic preparedness and response. In IEEE conference on visual analytics science and technology.

Liu, C., Ramirez-Serrano, A., & Yin, G. (2011). Customer-driven product design and evaluation method for collaborative design environments. Journal of Intelligent Manufacturing, 22, 751–764.CrossRef

Lubart, T. I., & Georgsdottir, A. (2004). Creativity: Developmental and cross-cultural Issues. In S. Lau, H. A.N., & G. Y. Ng (Eds.), Creativity: When east meets west (pp. 1–32). Singapore: World Scientific.

Luo, H. (2006). Exploring large-scale video news via interactive visualization. In IEEE symposium on visual analytics science and technology (pp. 75–82).

Luo, D., & Ghoniem, M. (2007). NewsLab: Exploratory broadcast news video analysis. In IEEE symposium on visual analytics science and technology (pp. 123–130).

MacDonald, C. M. (2012). Understanding usefulness in human-computer interaction to enhance user experience evaluation. Doctoral dissertation, Drexel University.

MacEachren, A. M., Jaiswal, A., Robinson, A. C., Pezanowski, S., Savelyev, A., Mitra, P., et al. (2011). SensePlace2: GeoTwitter analytics support for situational awareness. In 2011 IEEE conference on visual analytics science and technology (VAST) (pp. 181–190). IEEE.

Maciejewski, R., Kim, S., King-smith, D., Ostmo, K., Klosterman, N., Mikkilineni, A. K., et al. (2008). Situational awareness and visual analytics for emergency response and training. In IEEE conference on technologies for homeland security (pp. 252–256).

Maciejewski, R., Rudolph, S., Hafen, R., Abusalah, A. M., Yakout, M., Ouzzani, M., et al. (2010). A visual analytics approach to understanding spatiotemporal hotspots. IEEE Transactions on Visualization and Computer Graphics, 16(2), 205–220.CrossRef

Maciejewski, R., Tyner, B., Jang, Y., Zheng, C., Nehme, R. V., Ebert, D. S., et al. (2007). LAHVA: Linked animal—human health visual analytics. In IEEE symposium on visual analytics science and technology (pp. 27–34). IEEE.

Malik, A., Maciejewski, R., Maule, B., & Ebert, D. S. (2011). A visual analytics process for maritime resource allocation and riskassessment. In 2011 IEEE conference on visual analytics science and technology (VAST) (pp. 221–230). IEEE.

Mane, K. K., Bizon, C., Schmitt, C., Owen, P., Burchett, B., Pietrobon, R., et al. (2012). VisualDecisionLinc: A visual analytics approach for comparative effectiveness-based clinical decision support in psychiatry. Journal of Biomedical Informatics, 45(1), 101–106.

Plaisant, C., Grinstein, G., Scholtz, J., Whiting, M., O’Connell, T., Laskowski, S., et al. (2008). Evaluating visual analytics at the 2007 VAST symposium contest. IEEE on Computer Graphics and Applications, 28(2), 12–21.CrossRef

Reddy, R., Höferlin, M., Dambier, M., & Weiskopf, D. (2012). Visual analytics for dynamic evacuation planning. In Proceedings of EuroVA 2012: International workshop on visual analytics (pp. 13–17).

Rudolph, S., Savikhin, A., & Ebert, D. S. (2009). FinVis: Applied visual analytics for personal financial planning. In 2009 IEEE symposium on visual analytics science and technology (pp. 195–202). IEEE.

Savikhin, A., Fraser, S., Fisher, B., & Ebert, D. S. (2011). An experimental study of financial portfolio selection with visual analytics for decision support. In 44th Hawaii international conference on system sciences (HICSS) (pp. 1–10).

Savikhin, A., Maciejewski, R., & Ebert, D. S. (2008). Applied visual analytics for economic decision-making. In 2008 IEEE symposium on visual analytics science and technology (pp. 107–114). IEEE.

Scholtz, J. (2006a). Beyond usability: Evaluation aspects of visual analytic environments. In IEEE symposium on visual analytics science and technology (pp. 145–150).

Scholtz, J. (2006b). Metrics for evaluating human information interaction systems. Interacting with Computers, 18, 507–527.

Shrinivasan, Y. B., Gotzy, D., & Lu, J. (2009). Connecting the dots in visual analysis. In 2009 IEEE symposium on visual analytics science and technology (pp. 123–130). IEEE.

Soban, D. S., Salmon, J., & Fahringer, P. (2011). A visual analytics framework for strategic airlift decision making. The Journal of Defense Modeling and Simulation: Applications, Methodology, Technology.

Stemler, S. (2001). An overview of content analysis. Practical Assessment, Research and Evaluation, 7(17), 137–146.

Stoffel, A., Zhang, L., Weber, S. H., & Keim, D. A. (2012). AMPLIO VQA—A web based visual query analysis system for micro grid energy mix planning.

Thomas, J., & Cook, K. (2005). Illuminating the path: The research and development agenda for visual analytics. Los Alamitos, CA: IEEE Computer Society.

Thomas, J., & Cook, K. (2006). A visual analytics agenda. IEEE on Computer Graphics and Applications, 26(1), 10–13.CrossRef

Tintarev, N., & Masthoff, J. (2012). Evaluating the effectiveness of explanations for recommender systems. User Modeling and User-Adapted Interaction.

Tullis, T., & Albert, W. (2008). Measuring the user experience. In Measuring the user experience: Collecting, analyzing, and presenting usability metrics (pp. 142–144).

Wang, X., Charlotte, U. N. C., Bier, E. A., & Ribarsky, W. (2011). A two-stage framework for designing visual analytics system in organizational environments. In IEEE symposium on visual analytics science and technology (pp. 251–260).

Weaver, C., Fyfe, D., Robinson, A., Holdsworth, D., Peuquet, D., & MacEachren, A. M. (2007). Visual exploration and analysis of historic hotel visits. Information Visualization, 6(1), 89–103.

Title: Towards a product design assessment of visual analytics in decision support applications: a systematic review
Authors: Ovo Adagha
Richard M. Levy
Sheelagh Carpendale
Publication date: 30-06-2015
Publisher: Springer US
Published in: Journal of Intelligent Manufacturing / Issue 7/2017
Print ISSN: 0956-5515
Electronic ISSN: 1572-8145
DOI: https://doi.org/10.1007/s10845-015-1118-5

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Other articles of this Issue 7/2017

Product attributes and user experience design: how to convey product information through user-centered service

Decision theoretic modeling of affective and cognitive needs for product experience engineering: key issues and a conceptual framework

Cognitive shape similarity assessment for 3D part search

The gap between design intent and user response: identifying typical and novel car design elements among car brands for evaluating visual significance

Effects of stress and effort on self-rated reports in experimental study of design activities

Resource scheduling based on energy consumption for sustainable manufacturing

Premium Partners