0
Research Papers

An Experimental Study of Continuous and Discrete Visualization Paradigms for Interactive Trade Space Exploration

[+] Author and Article Information
Brian J. German, Karen M. Feigh

Assistant Professor

Matthew J. Daskilewicz

Graduate Research Assistant
Georgia Institute of Technology,
Atlanta, GA 30332

Contributed by the Computers and Information Division of ASME for publication in the Journal of Computing and Information Science in Engineering. Manuscript received April 29, 2012; final manuscript received February 16, 2013; published online April 22, 2013. Editor: Bahram Ravani.

J. Comput. Inf. Sci. Eng 13(2), 021004 (Apr 22, 2013) (12 pages) Paper No: JCISE-12-1070; doi: 10.1115/1.4023857 History: Received April 29, 2012; Revised February 16, 2013

Software tools that enable interactive data visualization are now commonly available for engineering design. These tools allow engineers to inspect, filter, and select promising alternatives from large multivariate design spaces based upon an examination of the tradeoffs between multiple objectives. There are two general approaches for visually representing data: (1) discretely, by plotting a sample of designs as distinct points; and (2) continuously, by plotting the functional relationships between design variables and design metrics as curves or surfaces. In this paper, we examine these two approaches through a human subjects experiment. Participants were asked to complete two design tasks with an interactive visualization tool: one by using a sample of discrete designs and one by using a continuous representation of the design space. Metrics describing the optimality of the design outcomes, the usage of different graphics, and the task workload were quantified by mouse tracking, user process descriptions, and analysis of the selected designs. The results indicate that users had more difficultly in selecting multiobjective optimal designs with common continuous graphics than with discrete graphics. The findings suggest that innovative features and additional usability studies are required in order for continuous trade space visualization tools to achieve their full potential.

FIGURES IN THIS ARTICLE
<>
Copyright © 2013 by ASME
Topics: Design , Visualization
Your Session has timed out. Please sign back in to continue.

References

Hayes, C. C., and Akhavi, F., 2008, “Design Decision Making: Adapting Mathematical Paradigms to Fit Designers Actual Needs,” Proceedings of the Human Factors and Ergonomics Society 52nd Annual Meeting.
Wolf, D., Hyland, J., and Simpson, T. W., 2011, “The Importance of Training for Interactive Trade Space Exploration: A Study of Novice and Expert Users,” ASME J. Comput. Inf. Sci. Eng., 11(3), p. 031009. [CrossRef]
Simon, H. A., 1955, “A Behavioral Model of Rational Choice,” Q. J. Econ., 69, pp. 99–118. [CrossRef]
Tory, M., and Möller, T., 2004, “Rethinking Visualization: A High Level Taxonomy,” Proceedings of the IEEE Symposium on Information Visualization.
Colgan, L., Spence, R., and Rankin, P., 1995, “The Cockpit Metaphor,” Behav. Inf. Technol., 14(4), pp. 251–263. [CrossRef]
Tweedie, L., Spence, R., Dawkes, H., and Su, H., 1996, “Externalising Abstract Mathematical Models,” CHI’96.
Becker, R. A., Cleveland, W. S., and Wilks, A. R., 1987, “Dynamic Graphics for Data Analysis,” Stat. Sci., 2(4), pp. 355–383. [CrossRef]
Tweedie, L., Spence, B., Williams, D., and Bhogal, R., 1994, “The Attribute Explorer,” Conference Companion CHI’94.
Spence, R., 1999, “The Facilitation of Insight for Analog Design,” IEEE Trans. Circuits Syst., II: Analog Digital Signal Process., 46(5), pp. 540–548. [CrossRef]
Winer, E., and Bloebaum, C., 2001, “Visual Design Steering for Optimization Solution Improvement,” Struct. Multidiscip. Optim., 22(3), pp. 219–229. [CrossRef]
Winer, E., and Bloebaum, C., 2002, “Development of Visual Design Steering as an Aid in Large-Scale Multidisciplinary Design Optimization—Part I: Method Development,” Struct. Multidiscip. Optim., 23(6), pp. 412–424. [CrossRef]
Winer, E., and Bloebaum, C., 2002, “Development of Visual Design Steering as an Aid in Large-Scale Multidisciplinary Design Optimization—Part II: Method Validation,” Struct. Multidiscip. Optim., 23(6), pp. 425–435. [CrossRef]
Stump, G. M., Yukish, M. A., Martin, J. D., and Simpson, T. W., 2004, “The ARL Trade Space Visualizer: An Engineering Decision-Making Tool,” Collection of Technical Papers—10th AIAA/ISSMO Multidisciplinary Analysis and Optimization Conference, Vol. 5, pp. 2976–2986.
Balling, R., 1999, “Design by Shopping: A New Paradigm,” Proceedings of the 3rd World Congress of Structural and Multidisciplinary Optimization.
Stump, G., and Simpson, T. W., 2002, “Multidimensional Visualization and Its Application to a Design by Shopping Paradigm,” 9th AIAA/ISSMO Symposium on Multidisciplinary Analysis and Optimization.
Stump, G. M., Simpson, T. W., Yukish, M., and Harris, E. N., 2003, “Design Space Visualization and Its Application to a Design by Shopping Paradigm,” Proceedings of the ASME Design Engineering Technical Conference, Vol. 2B, pp. 795–804.
Stump, G., Yukish, M., and Merenich, J., 2005, “Tracing Interesting Features in Trade Spaces to Conceptual Model Design Rules,” 2005 IEEE Aerospace Conference, pp. 4227–4238.
Stump, G., Lego, S., Yukish, M., Simpson, T. W., and Donndelinger, J. A., 2008, “Visual Steering Commands for Trade Space Exploration: User-Guided Sampling With Example,” 2007 Proceedings of the ASME International Design Engineering Technical Conferences and Computers and Information in Engineering Conference (DETC2007), Vol. 6B, pp. 1367–1376.
Simpson, T. W., Spencer, D. B., Yukish, M. A., and Stump, G., 2008, “Visual Steering Commands and Test Problems to Support Research in Trade Space Exploration,” 12th AIAA/ISSMO Multidisciplinary Analysis and Optimization Conference.
Simpson, T. W., Carlsen, D. E., Congdon, C. D., Stump, G., and Yukish, M. A., 2008, “Trade Space Exploration of a Wing Design Problem Using Visual Steering and Multi-Dimensional Data Visualization,” 49th AIAA/ASME/AHS/ASC Structures, Structural Dynamics, and Materials Conference.
Stump, G. M., Yukish, M., and O'Hara, J. J., 2006, “A Group Decision-Making Interface for Conceptual Design,” IEEE Aerospace Conference Proceedings, Vol. 2006.
O'Hara, J. J., Stump, G. M., Yukish, M. A., Harris, E. N., Hanowski, G. J., and Carty, A., 2007, “Advanced Visualization Techniques for Trade Space Exploration,” Collection of Technical Papers—AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics and Materials Conference, Vol. 2, pp. 2137–2142.
Packham, I., and Denham, S., 2003, “Visualization Methods for Supporting the Exploration of High Dimensional Problem Spaces in Engineering Design,” Proceedings of the Coordinated and Multiple Views in Exploratory Visualization.
Packham, I., Rafiq, M., Borthwick, M., and Denham, S., 2005, “Interactive Visualisation for Decision Support and Evaluation of Robustness in Theory and in Practice,” Adv. Eng. Inf., 19, pp. 263–280. [CrossRef]
Daskilewicz, M. J., and German, B. J., 2009, “Aspects of Effective Visualization of Multidimensional Design Spaces,” 9th AIAA Aviation Technology, Integration, and Operations Conference (ATIO).
Daskilewicz, M. J., and German, B. J., 2012, “Observations on the Topology of Pareto Frontiers With Implications for Design Decision Making,” AIAA Aerospace Sciences Meeting.
Simpson, T. W., and Meckesheimer, M., 2004, “Evaluation of a Graphical Design Interface for Design Space Visualization,” Collection of Technical Papers—AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics and Materials Conference, Vol. 3, pp. 1898–1908.
Carlsen, D., Malone, M., Kollat, J., and Simpson, T., 2008, “Evaluating the Performance of Visual Steering Commands for User-Guided Pareto Frontier Sampling During Trade Space Exploration,” Proceedings of the ASME 2008 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference.
Tory, M., and Möller, T., 2004, “Human Factors in Visualization Research,” IEEE Trans. Vis. Comput. Graph., 10(1), pp. 72–84. [CrossRef] [PubMed]
Hay, W. W., 1982, Railroad Engineering, 2nd ed., John Wiley and Sons, New York.
White, F. M., 1994, Fluid Mechanics, 3rd ed., McGraw-Hill, New York.
Daskilewicz, M. J., and German, B. J., 2012, “Rave: A Computational Framework to Facilitate Research in Design Decision Support,” ASME J. Comput. Inf. Sci. Eng., 12(2), p. 021005. [CrossRef]
Inselberg, A., and Dimsdale, B., 1990, “Parallel Coordinates: A Tool for Visualizing Multi-Dimensional Geometry,” Proceedings of the First IEEE Conference on Visualization, 1990 (Visualization ’90), Oct., pp. 361–378.
Hart, S. G., and Staveland, L. E., 1988, “Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research,” Human Mental Workload, North Holland Press, Amsterdam.
Hart, S. G., 2006, “NASA-Task Load Index (NASA-TLX): 20 Years Later,” Proceedings of the Human Factors and Ergonomics Society 50th Annual Meeting, Human Factors and Ergonomics Society, pp. 904–908.

Figures

Grahic Jump Location
Fig. 2

Continuous visualization workspace for the turbofan training task

Grahic Jump Location
Fig. 1

Discrete visualization workspace for the turbofan training task

Grahic Jump Location
Fig. 3

Impact of visualization type on the participant's ability to achieve the type of design outcome they attempted

Grahic Jump Location
Fig. 7

Time spent in the prediction profiler plot by trial order

Grahic Jump Location
Fig. 8

Correlation of recolor usage with the level of optimality in the resultant design

Grahic Jump Location
Fig. 4

Total time spent interacting with the visualization workspace

Grahic Jump Location
Fig. 5

Time spent interacting with each graphic in the discrete version of the visualization workspace

Grahic Jump Location
Fig. 6

Time spent interacting with each graphic in the continuous version of the visualization workspace

Tables

Errata

Discussions

Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging and repositioning the boxes below.

Related Journal Articles
Related eBook Content
Topic Collections

Sorry! You do not have access to this content. For assistance or to subscribe, please contact us:

  • TELEPHONE: 1-800-843-2763 (Toll-free in the USA)
  • EMAIL: asmedigitalcollection@asme.org
Sign In