Abstract
Cellular Automata (CA) are discrete simulation models, thus producing spatio-temporal data through experiments, as well as stochastic models, thus generating multi-run data. Identifying temporal patterns, such as cycles, is important to understand the behavior of the model. Assessing variability is also essential to estimate which parameter values may require more runs and what consensus emerges across simulation runs. However, these two tasks are currently arduous as the commonly employed slider-based visualizations offer little support to identify temporal trends or excessive model variability. In this article, we addressed these two tasks by developing, implementing, and evaluating a new visual analytics environment that uses several linked visualizations. Our empirical evaluation of the proposed environment assessed (i) whether modelers could identify temporal patterns and variability, (ii) how features of simulations impacted performances, and (iii) whether modelers can use the familiar slider-based visualization together with our new environment. Results shows that participants were confident on results obtained using our new environment. They were also able to accomplish the two target tasks without taking longer than they would with current solutions. Our qualitative analysis found that some participants saw value in switching between our proposed visualization and the commonly used slider-based version. In addition, we noted that errors were affected not only by the type of visualizations but also by specific features of the simulations. Future work may combine and adapt these visualizations depending on salient simulation parameters.
- W. Aigner and others. 2007. Visualizing time-oriented data: A systematic view. Computers 8 Graphics 31 (2007), 401--409. Google ScholarDigital Library
- A. Alexandridis, D. Vakalis, C. I. Siettos, and G. V. Bafas. 2008. A cellular automata model for forest fire spread prediction: The case of the wildfire that swept through Spetses Island in 1990. Applied Mathematics and Computing 204, 1 (2008), 191--201.Google ScholarCross Ref
- G. Andrienko and others. 2010. Space-in-time and time-in-space self-organizing maps for exploring spatiotemporal patterns. Computer Graphics Forum 29, 3 (2010), 913--922. Google ScholarDigital Library
- Gennady Andrienko and Natalia Andrienko. 2010. A general framework for using aggregation in visual exploration of movement data. The Cartographic Journal 47, 1 (2010), 22--40.Google ScholarCross Ref
- Stavros Athanassopoulos and others. 2012. Cellular automata: Simulations using Matlab. In Proceedings of the 6th International Conference on Digital Society (ICDS). Valencia, Spain, 63--68. https://www.ceid.upatras.gr/webpages/faculty/papaioan/ICDS2012.pdf.Google Scholar
- P. Bak, C. Tang, and K. Wiesenfeld. 1987. Self-organized criticality: An explanation of 1/f noise. Physical Review Letters 59, 4 (1987), 381--384.Google ScholarCross Ref
- Fabian Beck, Michael Burch, and Daniel Weiskopf. 2016. A matrix-based visual comparison of time series sports data. In Proceedings of the Conference on Vision, Modeling and Visualization (VMV’16). Eurographics Association, 53--60. https://dl.acm.org/citation.cfm?id=3056911. Google ScholarDigital Library
- Enrico Bertini and Denis Lalanne. 2010. Investigating and reflecting on the integration of automatic data analysis and visualization in knowledge discovery. SIGKDD Explorer Newsletter 11, 2 (May 2010), 9--18. Google ScholarDigital Library
- Marija Bezbradica, Martin Crane, and Heather J. Ruskin. 2016. Applications of high performance algorithms to large scale cellular automata frameworks used in pharmaceutical modelling. Journal of Cell Automata 11, 1 (2016), 21--45.Google Scholar
- Maryam Booshehrian and others. 2012. Vismon: Facilitating analysis of trade-offs, uncertainty, and sensitivity in fisheries management decision making. Computer Graphics Forum 31 (2012), 1235--1244. Google ScholarDigital Library
- Udeepta D. Bordoloi, David L. Kao, and Han-Wei Shen. 2004. Visualization techniques for spatial probability density function data. Data Science Journal 3 (2004), 153--162.Google ScholarCross Ref
- Rita Borgo and others. 2013. Glyph-based visualization: Foundations, design guidelines, techniques and applications. Eurographics State of the Art Reports (2013), 39--63.Google Scholar
- Rik Crutzen and others. 2015. Identifying binge drinkers based on parenting dimensions and alcohol-specific parenting practices: Building classifiers on adolescent-parent paired data. BMC Public Health 15, 1 (05 Aug 2015), 747.Google Scholar
- Rik Crutzen and Philippe Giabbanelli. 2014. Using classifiers to identify binge drinkers based on drinking motives. Substance Use 8 Misuse 49, 1--2 (2014), 110--115.Google Scholar
- Vahid Dabbaghian and others. 2010. A cellular automata model on residential migration in response to neighborhood social dynamics. Mathematical and Computer Modelling 52, 9--10 (2010), 1752--1762. Google ScholarDigital Library
- Fordyce A. Davidson. 2007. Mathematical modelling of mycelia: A question of scale. Fungal Biology Reviews 21, 1 (2007), 30--41.Google ScholarCross Ref
- I. Demir, C. Dick, and R. Westermann. 2014. Multi-charts for comparative 3d ensemble visualization. IEEE Transactions on Visualization and Computer Graphics 20, 12 (2014), 2694--2703.Google ScholarCross Ref
- L. Hernandez Encinas and others. 2007. Modelling forest fire spread using hexagonal cellular automata. Applied Mathematical Modelling 31, 6 (2007), 1213--1227.Google ScholarCross Ref
- F. Ferstl and others. 2017. Time-hierarchical clustering and visualization of weather forecast ensembles. IEEE Transactions on Visualization and Computer Graphics 23, 1 (2017), 831--840. Google ScholarDigital Library
- Johannes Fuchs and others. 2013. Evaluation of alternative glyph designs for time series data in a small multiple setting. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’13). ACM, New York, 3237--3246. https://hal.archives-ouvertes.fr/hal-00781504/. Google ScholarDigital Library
- Philippe J. Giabbanelli, Azadeh Alimadad, Vahid Dabbaghian, and Diane T. Finegood. 2012. Modeling the influence of social networks and environment on energy balance and obesity. Journal of Computational Science 3, 1 (2012), 17--27.Google ScholarCross Ref
- Philippe J. Giabbanelli, Guru Jagadeesh Babu, and Magda Baniukiewicz. 2016. A novel visualization environment to support modelers in analyzing data generated by cellular automata. In Digital Human Modeling: Applications in Health, Safety, Ergonomics and Risk Management, Vincent G. Duffy (Ed.). Springer-Verlag, Cham, 529--540. https://link.springer.com/chapter/10.1007/978-3-319-40247-5_53.Google Scholar
- Philippe J. Giabbanelli and Rik Crutzen. 2014. Creating groups with similar expected behavioural response in randomized controlled trials: A fuzzy cognitive map approach. BMC Medical Research Methodology 14, 1 (2014), 130.Google ScholarCross Ref
- Philippe J. Giabbanelli and Piper J. Jackson. 2015. Using visual analytics to support the integration of expert knowledge in the design of medical models and simulations. Procedia Computer Science 51 (2015), 755--764. https://www.sciencedirect.com/science/article/pii/S1877050915010030. Google ScholarDigital Library
- A. Giordano and others. 2017. Parallel execution of cellular automata through space partitioning: The landslide simulation sciddicas3-hex case study. In Proceedings of the 25th Euromicro International Conference on Parallel, Distributed and Network-based Processing (PDP). 505--510. https://ieeexplore.ieee.org/abstract/document/7912695.Google ScholarCross Ref
- Qingfeng Guan and others. 2016. A hybrid parallel cellular automata model for urban growth simulation over GPU/CPU heterogeneous architectures. International Journal of Geographical Information Science 30, 3 (2016), 494--514.Google ScholarDigital Library
- Daniel Haehn and others. 2014. Design and evaluation of interactive proofreading tools for connectomics. IEEE Transactions on Visualization and Computer Graphics 20, 12 (2014), 2466--2475.Google ScholarCross Ref
- Ming C. Hao and others. 2012. Visual exploration of frequent patterns in multivariate time series. Information Visualization 11, 1 (2012), 71--83. Google ScholarDigital Library
- S. Havre and others. 2002. ThemeRiver: Visualizing thematic changes in large document collections. IEEE Transactions on Visualization and Computer Graphics 8, 1 (2002), 9--20. Google ScholarDigital Library
- Ken Hinckley and others. 1997. Usability analysis of 3d rotation techniques. In Proceedings of the 10th Annual ACM Symposium on User Interface Software and Technology (UIST’97). ACM, 1--10. https://dl.acm.org/citation.cfm?id=263408. Google ScholarDigital Library
- Thomas Höllt and others. 2016. Visual analysis of reservoir simulation ensembles. In Proceedings of the Workshop on Visualisation in Environmental Sciences (EnvirVis’16). Eurographics Association, 1--5. https://dl.acm.org/citation.cfm?id=3057017. Google ScholarDigital Library
- Raj Jain. 1990. The Art of Computer Systems Performance Analysis: Techniques for Experimental Design, Measurement, Simulation, and Modeling. John Wiley 8 Sons.Google Scholar
- H. Janicke, A. Wiebel, G. Scheuermann, and W. Kollmann. 2007. Multifield visualization using local statistical complexity. IEEE Transactions on Visualization and Computer Graphics 13, 6 (2007), 1384--1391.Google ScholarDigital Library
- Ioannis Karafyllidis and Adonios Thanailakis. 1997. A model for predicting forest fire spreading using cellular automata. Ecological Modelling 99 (1997), 87--97.Google ScholarCross Ref
- J. Kehrer and H. Hauser. 2013. Visualization and visual analysis of multifaceted scientific data: A survey. IEEE Transactions on Visualization and Computer Graphics 19, 3 (2013), 495--513. Google ScholarDigital Library
- D. A. Keim. 2000. Designing pixel-oriented visualization techniques: Theory and applications. IEEE Transactions on Visualization and computer graphics 6, 1 (2000), 59--78. Google ScholarDigital Library
- Marta Kersten-Oertel and others. 2014. An evaluation of depth enhancing perceptual cues for vascular volume visualization in neurosurgery. IEEE Transactions on Visualization and Computer Graphics 20, 3 (2014), 391--403. Google ScholarDigital Library
- Gordon Kindlmann. 2004. Superquadric tensor glyphs. In Proceedings of the 6th Joint Eurographics - IEEE TCVG Conference on Visualization (VISSYM’04). Eurographics Association, 147--154. https://dl.acm.org/citation.cfm?id=2384248. Google ScholarDigital Library
- K. Konstantinidis and others. 2014. Identification and retrieval of dna genomes using binary image representations produced by cellular automata. In Proceedings of the IEEE International Conference on Imaging Systems and Techniques (IST). IEEE, 134--137. https://ieeexplore.ieee.org/abstract/document/6958460.Google ScholarCross Ref
- Z. Konyha, K. Matkovic, and H. Hauser. 2009. Interactive visual analysis in engineering: A survey. Proceedings of the Spring Conference on Computer Graphics (2009), 31--38. https://www.cg.tuwien.ac.at/research/publications/2009/Konyha_2009_survey/.Google Scholar
- Patrick Kothur and others. 2014. Interactive visual summaries for detection and assessment of spatiotemporal patterns in geospatial time series. Information Visualization 13, 3 (2014), 283--298. Google ScholarDigital Library
- P. Kothur and others. 2015. Visual analytics for correlation-based comparison of time series ensembles. Computer Graphics Forum 34, 3 (2015), 411--420. Google ScholarDigital Library
- Kuno Kurzhals and others. 2016. Gaze stripes: Image-based visualization of eye tracking data. IEEE Transactions on Visualization and Computer Graphics 22, 1 (2016), 1005--1014.Google ScholarDigital Library
- E. A. Lavin and P. J. Giabbanelli. 2017. Analyzing and simplifying model uncertainty in fuzzy cognitive maps. In Proceedings of the 2017 Winter Simulation Conference (WSC). 1868--1879. https://ieeexplore.ieee.org/abstract/document/8247923. Google ScholarDigital Library
- Kai Lawonn and others. 2017. Visualization and extraction of carvings for heritage conservation. IEEE Transactions on Visualization and Computer Graphics 23, 1 (2017), 801--810. Google ScholarDigital Library
- Andreas J. Lind and Stefan Bruckner. 2017. Comparing cross-sections and 3D renderings for surface matching tasks using physical ground truths. IEEE Transactions on Visualization and Computer Graphics 23, 1 (2017), 781--790. Google ScholarDigital Library
- David López and others. 2016. Towards an understanding of mobile touch navigation in a stereoscopic viewing environment for 3D data exploration. IEEE Transactions on Visualization and Computer Graphics 22, 5 (2016), 1616--1629. Google ScholarDigital Library
- K. L. Ma. 2007. Machine learning to boost the next generation of visualization technology. IEEE Computer Graphics and Applications 27, 5 (2007), 6--9. Google ScholarDigital Library
- R. Macefield. 2009. How to specify the participant group size for usability studies: A practitioner’s guide. Journal of Usability Studies 5, 1 (2009), 34--45. Google ScholarDigital Library
- K. Matkovic and others. 2005. Interactive visual analysis and exploration of injection systems simulations. In VIS 05. IEEE Visualization, 2005. 391--398.Google Scholar
- Marielle Mokhtari, Eric Boivin, and Denis Laurendeau. 2013. Making Sense of Large Datasets in the Context of Complex Situation Understanding. Springer-Verlag, Berlin, Heidelberg, 251--260.Google Scholar
- Douglas C. Montgomery. 2012. The 2k factorial design. In Design and Analysis of Experiments, 8th ed. John Wiley and Sons, 233--303.Google Scholar
- T. Nocke, M. Flechsig, and U. Bohm. 2007. Visual exploration and evaluation of climate-related simulation data. In 2007 Winter Simulation Conference. 703--711. https://ieeexplore.ieee.org/document/4419664. Google ScholarDigital Library
- M. Novotny and H. Hauser. 2006. Outlier-preserving focus+context visualization in parallel coordinates. IEEE Transactions on Visualization and Computer Graphics 12, 5 (2006), 893--900. Google ScholarDigital Library
- Vasileios G. Ntinas and others. 2016. GPU and FPGA parallelization of fuzzy cellular automata for the simulation of wildfire spreading. In Parallel Processing and Applied Mathematics, R. Wyrzykowski and others (Eds.). Springer-Verlag, Cham, 560--569.Google Scholar
- Patrick O’Leary and others. 2016. Cinema image-based in situ analysis and visualization of MPAS-ocean simulations. Parallel Comput. 55 (2016), 43--48. Visualization and Data Analytics for Scientific Discovery. Google ScholarDigital Library
- Alex Pang. 2001. Visualizing uncertainty in geo-spatial data. In Proceedings of the Workshop on the Intersections Between Geospatial Information and Information Technology. http://www.sci.utah.edu/∼kpotter/Library/Papers/pang:2001:UVGD/index.html.Google Scholar
- S. P. Parikh and others. 2005. Usability study of a control framework for an intelligent wheelchair. In Proceedings of the 2005 IEEE International Conference on Robotics and Automation. 4745--4750. https://ieeexplore.ieee.org/abstract/document/1570853.Google ScholarCross Ref
- H. Piringer, W. Berger, and J. Krasser. 2010. HyperMoVal: Interactive visual validation of regression models for real-time simulation. Computer Graphics Forum 29, 3 (2010), 983--992. Google ScholarDigital Library
- S. F. Pratt, P. J. Giabbanelli, P. Jackson, and V. K. Mago. 2012. Rebel with many causes: A computational model of insurgency. In Proceedings of the 2012 IEEE International Conference on Intelligence and Security Informatics. 90--95. https://ieeexplore.ieee.org/abstract/document/6284097/.Google Scholar
- Ela Rana and others. 2015. Exploring the relationship between adherence to treatment and viral load through a new discrete simulation model of HIV infectivity. In Proceedings of the 3rd ACM SIGSIM Conference on Principles of Advanced Discrete Simulation (SIGSIM PADS’15). ACM, New York, 145--156. https://dl.acm.org/citation.cfm?id=2769477. Google ScholarDigital Library
- Khairi Reda and others. 2015. Effects of display size and resolution on user behavior and insight acquisition in visual exploration. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI’15). ACM, New York, 2759--2768. https://dl.acm.org/citation.cfm?id=2702406. Google ScholarDigital Library
- Silvio Rizzi and others. 2016. Coupling LAMMPS and the vl3 Framework for Co-Visualization of atomistic simulations. In Proceedings of the 2016 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW). IEEE Press, 1038--1042. https://ieeexplore.ieee.org/abstract/document/7529976.Google Scholar
- T. Ropinski and B. Preim. 2008. Taxonomy and usage guidelines for glyph-based medical visualization. Proceedings of Simulation and Visualization (SimVis) (2008), 121--138. http://scivis.itn.liu.se/publications/2008/RP08/.Google Scholar
- Caitlin Ross and others. 2016. Visual data-analytics of large-scale parallel discrete-event simulations. In Proceedings of the 7th International Workshop on Performance Modeling, Benchmarking and Simulation of High Performance Computing Systems (PMBS’16). IEEE Press, 87--97. https://ieeexplore.ieee.org/abstract/document/7836417. Google ScholarDigital Library
- Richard C. Rothermel. 1972. A mathematical model for predicting fire spread in wildland fuels. In Research Paper INT-115. U.S. Department of Agriculture, Intermountain Forest and Range Experiment Station.Google Scholar
- Bahador Saket, Alex Endert, and John Stasko. 2016. Beyond usability and performance: A review of user experience-focused evaluations in visualization. In Proceedings of the 6th Workshop on Beyond Time and Errors on Novel Evaluation Methods for Visualization. ACM, 133--142. https://dl.acm.org/citation.cfm?id=2993903. Google ScholarDigital Library
- B. Shneiderman. 1996. The eyes have it: A task by data type taxonomy for information visualizations. In Proceedings of the 1996 IEEE Symposium on Visual Languages. 336--343. https://ieeexplore.ieee.org/abstract/document/545307. Google ScholarDigital Library
- Q. Shu and others. 2016. EnsembleGraph: Interactive visual analysis of spatiotemporal behaviors in ensemble simulation data. In Proceedings of the 2016 IEEE Pacific Visualization Symposium (PacificVis). 56--63. https://ieeexplore.ieee.org/abstract/document/7465251.Google ScholarCross Ref
- Janet M, Six and Ritch Macefield. 2016. How to determine the right number of participants for usability studies. UXmatters (2016).Google Scholar
- Yusuke Tajima and Takashi Nagatani. 2001. Scaling behavior of crowd flow outside a hall. Physica A: Statistical Mechanics and its Applications 292, 1 (2001), 545--554.Google Scholar
- S. J. E. Taylor and others. 2013. Grand challenges on the theory of modeling and simulation. In Proceedings of the Symposium on Theory of Modeling 8 Simulation. Society for Computer Simulation International, San Diego, CA, 34:1--34:8. https://dl.acm.org/citation.cfm?id=2499668. Google ScholarDigital Library
- A. Tolk. 2015. The next generation of modeling 8 simulation: integrating big data and deep learning. In Proceedings of the Summer Conference on Computer Simulation. Society for Computer Simulation International, San Diego, CA, 1--8. https://dl.acm.org/citation.cfm?id=2874964. Google ScholarDigital Library
- C. Tominski, P. Schulze-Wollgast, and H. Schumann. 2005. 3D information visualization for time dependent data on maps. In Proceedings of the 9th International Conference on Information Visualisation (IV’05). 175--181. https://ieeexplore.ieee.org/abstract/document/1509075. Google ScholarDigital Library
- Giuseppe A. Trunfio. 2004. Predicting wildfire spread through a hexagonal cellular automata model. In Proceedings of the 6th International Conference on Cellular Automata for Research and Industry (ACRI’04), Peter Sloot, Bastien Chopard, and Alfons Hoekstra (Eds.). Springer-Verlag, 385--394. https://link.springer.com/chapter/10.1007/978-3-540-30479-1_40.Google Scholar
- Gregory E. Tucker and others. 2016. CellLab-CTS 2015: Continuous-time stochastic cellular automaton modeling using Landlab. Geoscientific Model Development 9 (2016), 823--839.Google ScholarCross Ref
- William Albert and Thomas Tullis. 2013. Performance metrics. In Measuring the User Experience 2nd ed., 63--98.Google Scholar
- A. Unger and H. Schumann. 2009. Visual support for the understanding of simulation processes. In 2009 IEEE Pacific Visualization Symposium. 57--64. https://ieeexplore.ieee.org/abstract/document/4906838. Google ScholarDigital Library
- Manuela Waldner and others. 2014. Attractive flicker: Guiding attention in dynamic narrative visualizations. IEEE Transactions on Visualization and Computer Graphics 20, 12 (2014), 2456--2465.Google ScholarCross Ref
- Matthew O. Ward. 2008. Multivariate Data Glyphs: Principles and Practice. Springer-Verlag, Berlin, Heidelberg, 179--198.Google Scholar
- Fang Weifeng, Yang Lizhong, and Fan Weicheng. 2003. Simulation of bi-direction pedestrian movement using a cellular automata model. Physica A: Statistical Mechanics and its Applications 321, 3 (2003), 633-640.Google Scholar
- C. M. Wittenbrink, A. T. Pang, and S. K. Lodha. 1996. Glyphs for visualizing uncertainty in vector fields. IEEE Transactions on Visualization and Computer Graphics 2, 3 (1996), 266--279. Google ScholarDigital Library
- Stephen Wolfram. 1986. Theory and Applications of Cellular Automata. World Scientific Publishing.Google Scholar
- H. Wu and others. 2005. Modeling long-term HIV dynamics and antiretroviral response: Effects of drug potency, pharmacokinetics, adherence, and drug resistance. Journal of Acquired Immune Deficiency Syndromes3 (2005), 272--283.Google ScholarCross Ref
Index Terms
- Visual Analytics to Identify Temporal Patterns and Variability in Simulations from Cellular Automata
Recommendations
An interactive volume visualization system for transient flow analysis
VG '03: Proceedings of the 2003 Eurographics/IEEE TVCG Workshop on Volume graphicsThis paper describes the design and performance of an interactive visualization system developed specifically for improved understanding of time-varying volume data from thermal flow simulations for vehicle cabin and ventilation design. The system uses ...
Visual Analytics: A 2D-3D visualization support for human-centered rule mining
On account of the enormous amounts of rules that can be produced by data mining algorithms, knowledge post-processing is a difficult stage in an association rule discovery process. In order to find relevant knowledge, the user needs to rummage through ...
Visual data-analytics of large-scale parallel discrete-event simulations
PMBS '16: Proceedings of the 7th International Workshop on Performance Modeling, Benchmarking and Simulation of High Performance Computing SystemsParallel discrete-event simulation (PDES) is an important tool in the codesign of extreme-scale systems because PDES provides a cost-effective way to evaluate designs of high-performance computing systems. Optimistic synchronization algorithms for PDES, ...
Comments