Research Papers

Exploring the Effectiveness of Using Graveyard Data When Generating Design Alternatives

[+] Author and Article Information
Garrett Foster

Research Assistant
e-mail: gdfoster@ncsu.edu

Scott Ferguson

Assistant Professor
e-mail: scott_ferguson@ncsu.edu
North Carolina State University,
Department of Mechanical and Aerospace
Engineering Raleigh, NC 27695

Contributed by the Computers and Information Division of ASME for publication in the Journal of Computing and Information Science in Engineering. Manuscript received January 11, 2013; final manuscript received June 7, 2013; published online August 19, 2013. Assoc. Editor: Joshua D. Summers.

J. Comput. Inf. Sci. Eng 13(4), 041003 (Aug 19, 2013) (11 pages) Paper No: JCISE-13-1006; doi: 10.1115/1.4024913 History: Received January 11, 2013; Revised June 07, 2013

The objective of this paper is to demonstrate that unique alternative designs can be efficiently found by searching the discarded data (or graveyard) from a multiobjective genetic algorithm (MOGA). Motivation for using graveyard data to generate design alternatives arises from the computational cost associated with real-time design space exploration of multiobjective optimization problems. The effectiveness of this approach is explored by comparing (1) the uniqueness of alternatives found using graveyard data and those generated using an optimization-based search, and (2) how alternative generation near the Pareto frontier is impacted. Two multiobjective case study problems are introduced—a two bar truss and an I-beam design optimization. Results from these studies indicate that using graveyard data allows for the discovery of alternative designs that are at least 70% as unique as alternatives found using an optimization-based alternative identification approach, while saving a significant number of functional evaluations. Additionally, graveyard data are shown to be better suited for alternative generation near the Pareto frontier than standard sampling techniques. Finally, areas of future work are also discussed.

Copyright © 2013 by ASME
Your Session has timed out. Please sign back in to continue.


Otto, K. N., and Antonsson, E. K., 1991, “Trade-Off Strategies in Engineering Design,” Res. Eng. Des., 3(2), pp. 87–103. [CrossRef]
Mattson, C. A., and Messac, A., 2005, “Pareto Frontier Based Concept Selection Under Uncertainty, With Visualization,” Optim. Eng., Kluwer Publishers—Special Issue on Multidisciplinary Design Optimization, Invited Paper, 6(1), pp. 85–115. [CrossRef]
Gurnani, A., Ferguson, S., Donndelinger, J., and Lewis, K., 2005, “A Constraint-Based Approach to Feasibility Assessment in Conceptual Design,” Artif. Intell. Eng. Des., Anal. Manuf., Special Issue on constraints and Design, 20(4), pp. 351–367. [CrossRef]
Stump, G., Yukish, M., and Simpson, T. W., 2004, “The ARL Trade Space Visualizer: An Engineering Decision-Making Tool,” Proceedings of the Tenth AIAA/ISSMO Multidisciplinary Analysis and Optimization Conference, Albany, NY, Paper No. AIAA-2004-4568.
Ross, A. M., Hastings, D. E., Warmkessel, J. M., and Diller, N. P.2004, “Multi-Attribute Tradespace Exploration as Front End for Effective Space System Design,” J. Spacecr. Rockets, 41(1), pp. 20–28. [CrossRef]
Stump, G., Lego, S., Yukish, M., Simpson, T. W., and Donndelinger, J. A., 2009, “Visual Steering Commands for Trade Space Exploration: User-Guided Sampling With Example,” J. Comput. Inf. Sci. Eng., 9(4), p. 044501. [CrossRef]
Daskilewicz, M. J., and German, B. J., 2012, “Rave: A Computational Framework to Facilitate Research in Design Decision Support,” J. Comput. Inf. Sci. Eng., 12(2), p. 021005. [CrossRef]
See, T. K., Gurnani, A., and Lewis, K., 2004, “Multi-Attribute Decision Making Using Hypothetical Equivalents and Inequivalents,” J. Mech. Des., 126(6), pp. 950–959. [CrossRef]
See, T. K., and Lewis, K., 2006, “A Formal Approach to Handling Conflicts in Multiattribute Group Decision Making,” J. Mech. Des., 128(4), pp. 678–689. [CrossRef]
Hollingsworth, P. M., 2004, “Requirements Controlled Design: A Method for Discovery of Discontinuous System Boundaries in the Requirements Hyperspace,” Ph.D. thesis, Georgia Tech, Atlanta, GA.
Ross, A. M., and Hastings, D. E., 2006, “Assessing Changeability in Aerospace Systems Architecting and Design Using Dynamic Multi-Attribute Tradespace Exploration,” AIAA Space 2006, San Jose, CA, Paper No. AIAA-2006-7255.
Hazelrigg, G. A., 1998, “A Framework for Decision-Based Engineering Design,” J. Mech. Des., 120(4), pp. 653–658. [CrossRef]
Balling, R., 1999, “Design by Shopping: A New Paradigm?,” Proceedings of the Third World Congress of Structural and Multidisciplinary Optimization WCSMO-3, Buffalo, NY, University at Buffalo, pp. 295–297.
Winer, E. H., and Bloebaum, C. L., 2001, “Visual Design Steering for Optimization Solution Improvement,” Struct. Multidisc. Optim., 22(3), pp. 219–229. [CrossRef]
Winer, E. H., and Bloebaum, C. L., 2002, “Development of Visual Design Steering as an Aid in Large-Scale Multidisciplinary Design Optimization. Part I: Method Development,” Struct. Multidisc. Optim., 23(6), pp. 412–424. [CrossRef]
Brill, E. D., Jr., 1979, “The Use of Optimization Models in Public-Sector Planning,” Manage. Sci., 25(5), pp. 413–422. [CrossRef]
Chang, S-Y., Brill, E. D., Jr., and Hopkins, L. D., 1983, “Modeling to Generate Alternatives: A Fuzzy Approach,” Fuzzy Sets Syst., 9(1–3), pp. 137–151. [CrossRef]
Huang, G. H., Gaetz, B. W., and Patry, G. G., 1996, “A Grey Hop, Skip, and Jump Approach: Generating Alternatives for Expansion Planning of Waste Management Facilities,” Can. J. Civil Eng., 23(6), pp. 1207–1219. [CrossRef]
DeCarolis, J. F., 2011, “Using Modeling to Generate Alternatives (MGA) to Expand Our Thinking on Energy Futures,” Energy Econ., 33(2), pp. 145–152. [CrossRef]
Nunez, M., Datta, V. C., Molina-Cristobal, A., Guenov, M., and Riaz, A., 2012, “Enabling Exploration in the Conceptual Design and Optimisation of Complex Systems,” J. Eng. Des., 23(10–11), pp. 849–872. [CrossRef]
Jeon, Y. H., Jun, S., Kang, S., and Lee, D. H., 2012, “Systematic Design Space Exploration and Rearrangement of the MDO Problem by Using Probabilistic Methodology,” J. Mech. Sci. Technol., 26(9), pp. 2825–2836. [CrossRef]
Rahman, S., and Shrestha, G., 1992, “A Technique to Incorporate New Information in Evaluating Generation Alternatives,” IEEE Trans. Power Syst., 7(2), pp. 900–906. [CrossRef]
Daniel, H. L., Ranjithan, S. R., Brill, E. D., Jr., and Baugh, J. W., Jr., 2001, “Genetic Algorithm Approaches for Addressing Unmodeled Objectives in Optimization Problems,” Eng. Optim., 33(5), pp. 549–569. [CrossRef]
Neches, R., and Madni, A. M., 2012, “Towards Affordably Adaptable and Effective Systems,” Syst. Eng., 16, pp. 224–234. [CrossRef]
Simpson, T. W., and Martins, J. R., 2011, “Multidisciplinary Design Optimization for Complex Engineered Systems: Report From a National Science Foundation Workshop,” ASME J. Mech. Des., 133(10), p. 101002. [CrossRef]
Madni, A. M., Brenner, M. A., Costea, I., MacGregor, D., and Meshkinpour, F., 1985, “Option Generation: Problems, Principles, and Computer-Based Aiding,” Proceedings of the 1985 International Conference on Systems, Man, and Cybernetics, Tuscon, AZ, pp. 757–760.
Goldberg, D. E., 1989, Genetic Algorithms in Search, Optimization, and Machine Learning, Addison-Wesley, New York, NY.
Deb, K., Pratap, A., Agarwal, S., and Meyarivan, T., 2002, “A Fast and Elitist Multiobjective Genetic Algorithm: NSGA-II,” IEEE Trans. Evol. Comput, 6(2), pp. 182–197. [CrossRef]
Deb, K., 2009, Multi-Objective Optimization Using Evolutionary Algorithms, Wiley, New York, NY.
Mackenna, A., 2011, “Rapid Ship Design Environment,” Physics-Based Modeling in Design and Development for U.S. Defense Conference,” Denver, CO, Paper No. 13623.
Simpson, T. W., Rosen, D., Allen, J. K., and Mistree, F., 1996, “Metrics for Assessing Design Freedom and Information Certainty in the Early Stages of Design,” Proceedings of the 1996 ASME DETC and CIE, Irving, CA, Paper No. 96-DETC/DTM-1521.
Finch, W. W., and Ward, A. C., 1997, “A Set-Based System for Eliminating Infeasible Designs in Engineering Problems Dominated by Uncertainty,” Proceedings of the 1997 ASME Design Engineering Technical Conferences, Sacramento, CA, Paper No. DETC97/DTM-3886.
Chen, W., and Lewis, K., 1999, “A Robust Design Approach for Achieving Flexibility in Multidisciplinary Design,” AIAA J., 37, pp. 982–989. [CrossRef]
Shan, S., and Wang, G. G., 2004, “Space Exploration and Global Optimization for Computationally Intensive Design Problems: a Rough Set Based Approach,” Struct. Multidisc. Optim., 28(6), pp. 427–441. [CrossRef]
Madhavan, K., Shahan, D., Seepersad, C. C., Hlavinka, D. A., and Benson, W., 2008, “An Industrial Trial of a Set-Based Approach to Collaborative Design,” Proceedings of the IDETC/CIE 2008, New York, NY, Paper No. DETC2008/49953.
Campbell, M., “The Skewboid Method: A Simple and Effective Approach to Pareto Relaxation and Filtering,” 2012, ASME IDETC, Chicago, IL, Paper No. DETC2012-70323.
Messac, A., Martinez, M. P., and Simpson, T. W., 2002, “Introduction of a Product Family Penalty Function Using Physical Programming,” ASME J. Mech. Des., 124(2), pp. 164–172. [CrossRef]
Chen, W., Sahai, A., Messac, A., and Sundararaj, G. J., 2000, “Exploration of the Effectiveness of Physical Programming in Robust Design,” ASME J. Mech. Des., 122(2), pp. 155–163. [CrossRef]
Liu, H., Chen, W., Scott, M. J., and Qureshi, K., 2008, “Determination of Ranged Sets of Design Specifications by Incorporating Design-Space Heterogeneity,” Eng. Optim., 40(11), pp. 1011–1029. [CrossRef]
Bertsche, B., 2008, Reliability in Automotive and Mechanical Engineering: Determination of Component and System Reliability, Springer-Verlag, New York, NY.
Gunawan, S., and Azarm, S., 2005, “A Feasibility Robust Optimization Method Using Sensitivity Region Concept,” J. Mech. Des., 127(5), pp. 858–865. [CrossRef]
Li, M., Williams, N., and Azarm, S., 2009, “Interval Uncertainty Reduction and Single-Disciplinary Sensitivity Analysis With Multi-Objective Optimization,” J. Mech. Des., 131(3), p. 031007. [CrossRef]
Eddy, J., and Lewis, K., 2002, “Visualization of Multi-Dimensional Design and Optimization Data Using Cloud Visualization,” Proceedings of the 2002 ASME Design Engineering Technical Conferences, Montreal, Canada, Paper No. DETC2002/DAC-34130.
ShneidermanB., 1992, “Tree Visualization with Tree-Maps: 2-D Space-Filling Approach,” ACM Trans. Graph., 11(1), pp. 92–99. [CrossRef]
“Honeycomb™,” http://www.hivegroup.com/
Chien, S.-F., and Flemming, U., 2002, “Design Space Navigation in Generative Design Systems,” Autom. Constr., 11(1), pp. 1–22. [CrossRef]
Aksit, M., and Marcelloni, F., 2001, “Deferring Elimination of Design Alternatives in Object-Oriented Methods,” Concurrency Computation: Pract. Exper., 13(14), pp. 1247–1279. [CrossRef]
Ahn, B. S., and Park, H., 2008, “An Efficient Pruning Method for Decision Alternatives of OWA Operators,” IEEE Trans. Fuzzy Syst., 16(6), pp. 1542–1549. [CrossRef]
Stump, G. M., Yukish, M., and Merenich, J. J., 2005, “Tracing Interesting Features in Trade Spaces to Conceptual Model Design Rules,” 2005 IEEE Aerospace Conference, Vols. 1–4, pp. 4227–4238.
Malakooti, B., and Raman, V., 2000, “Clustering and Selection of Multiple Criteria Alternatives Using Unsupervised and Supervised Neural Networks,” J. Intell. Manuf., 11(5), pp. 435–451. [CrossRef]
Chen, Y., Kilgour, D. M., and Hipel, K. W., 2012, “A Decision Rule Aggregation Approach to Multiple Criteria-Multiple Participant Sorting,” Group Decis. Negotiation, 21(5), pp. 727–745. [CrossRef]
Malak, R., 2008, “Using Parameterized Efficient Sets to Model Alternatives for Systems Design Decisions,” Ph.D. thesis, Georgia Tech, Atlanta, GA.
Kurtoglu, T., and Campbell, M. I., 2009, “An Evaluation Scheme for Assessing the Worth of Automatically Generated Design Alternatives,” Res. Eng. Des., 20(1), pp. 59–76. [CrossRef]
Kim, J. K., and Kim, T. G., 2006, “A Plan-Generation-Evaluation Framework for Design Space Exploration of Digital Systems Design,” IEICE Trans. Fundam. Electron., Commun. Comput. Sci., E89-A(3), pp. 772–781. [CrossRef]
Halim, I., and Srinivasan, R., 2008, “Designing Sustainable Alternatives for Batch Operations Using an Intelligent Simulation-Optimization Framework,” Chem. Eng. Res. Des., 86(7A), pp. 809–822. [CrossRef]
Smith, G., Richardson, J., Summers, J. D., and Mocko, G. M., 2012, “Concept Exploration Through Morphological Charts: An Experimental Study,” ASME J. Mech. Des., 134(5), p. 051004. [CrossRef]
Krishnan, V., and Katkoori, S., 2006, “A Genetic Algorithm for the Design Space Exploration of Datapaths During High-Level Synthesis,” IEEE Trans. Evol. Comput., 10(3), pp. 213–229. [CrossRef]
Collignan, A., Sebastian, P., Pailhes, J., and Ledoux, Y., 2012, “Arc-Elasticity and Hierarchical Exploration of the Neighborhood of Solutions in Mechanical Design,” Adv. Eng. Inf., 26(3), pp. 603–617. [CrossRef]
Shir, O., Preuss, M., Naujoks, B., and Emmerich, M., 2009, “Enhancing Decision Space Diversity in Evolutionary Multiobjective Algorithms,” Evol. Multi-Criterion Optim., 5467, pp. 95–109. [CrossRef]
Toffolo, A., and Benini, E., 2003, “Genetic Diversity as an Objective in Multi-Objective Evolutionary Algorithms,” Evol. Comput., 11(2), pp. 151–167. [CrossRef] [PubMed]
Tamaskar, S., Neema, K., Kotegawa, T., and DeLaurentis, D., 2011, “Complexity Enables Design Space Exploration,” Conference Proceedings—IEEE International Conference on Systems, Man, and Cybernetics, pp. 1250–1255.
Kang, E., Jackson, E., and Schulte, W., 2011, “An Approach for Effective Design Space Exploration,” Lect. Notes Comput. Sci., 6662, pp. 33–54. [CrossRef]
Ferguson, S., Gurnani, A., Donndelinger, J., and Lewis, K., 2005, “A Study of Convergence and Mapping in Multibobjective Optimization Problems,” Int. J. Veh. Syst. Model. Test., 1(1/2/3), pp. 192–215. [CrossRef]
Simon, P. R., and Ferguson, S., 2010, “Investigating the Significance of ‘One-to-Many’ Mappings in Multiobjective Optimization,” 2010 ASME Design Engineering Technical Conferences, Montreal, Quebec, Paper No. DETC2010-28689.
Brill, E. D., Chang, S.-Y., and Hopkins, L. D., 1982, “Modeling to Generate Alternatives: The HSJ Approach and an Illustration Using a Problem in Land Use Planning,” Manage. Sci., 28(3), pp. 221–235. [CrossRef]
Kripakaran, P., and Gupta, A., 2006, “MGA–A Mathematical Approach to Generate Design Alternatives,” Lect. Notes Comput. Sci., 4200, pp. 408–415. [CrossRef]
Zechman, E. M., and Ranjithan, R. S., 2007, “Generating Alternatives Using Evolutionary Algorithms for Water Resources and Environmental Management Problems,” J. Water Resour. Plann. Manage., 133(2), pp. 156–165. [CrossRef]
Foster, G., 2011, “Expansion of Alternative Generation Techniques,” Master’s thesis, North Carolina State University, Raleigh, NC.
Foster, G., and Ferguson, S., 2010, “Exploring the Impact of Distance Metrics on Alternative Generation in a Multiobjective Problem,” 13th AIAA/ISSMO Multidisciplinary Analysis Optimization Conference, Fort Worth, TX, Paper No. AIAA-2010-9091.
Foster, G., and Ferguson, S., 2011, “Assessing the Effectiveness of Using Graveyard Data for Generating Design Alternatives,” Proceedings of the 2011 ASME Design Engineering Technical Conference, Washington, DC, Paper No. DETC2011-48636.
Sofge, D. A., 2002, “Using Genetic Algorithm Based Variable Selection to Improve Neural Network Models for Real-World Systems,” Proceedings of the 2002 International Conference on Machine Learning and Applications.
Simpson, T. W., Poplinski, J. D., Koch, P. N., and Allen, J. K., 2001, “Metamodels for Computer-Based Engineering Design: Survey and Recommendations,” Eng. Comput., 17(2), pp. 129–150. [CrossRef]
Turner, C. J., 2011, “Metamodeling in Product and Process Design,” Proceedings of the 2011 IDETC and CIE, Washington, DC, Paper No. DETC2011-47483.
Viana, F. A. C., Gogu, C., and Haftka, R. T., 2010, “Making the Most Out of Surrogate Models: Tricks of the Trade,” Proceedings of the 2010 ASME IDETC and CIE, Montreal, Canada, Paper No. DETC2010-28813.
The MathWorks, Inc., “Find Minimum of Function Using Pattern Search—MATLAB,” http://www.mathworks.com/help/toolbox/gads/patternsearch.html
Audet, C., and Dennis, J. E., Jr., 2006, Analysis of Generalized Pattern Searches, DTIC Document.
Kolda, T. G., Lewis, R. M., and Torczon, V., 2003, “Optimization by Direct Search: New Perspectives on Some Classical and Modern Methods,” SIAM Rev., 45, pp. 385–482. [CrossRef]
The MathWorks, Inc., “Genetic Algorithm Options: Options Reference (Global Optimization Toolbox),” http://www.mathworks.com/help/toolbox/gads/f6174dfi10.html
Azarm, S., Reynolds, B. J., and Narayanan, S., 1999, “Comparison of Two Multiobjective Optimization Techniques With and Within Genetic Algorithms,” Proceedings of the 1999 ASME Design Engineering Technical Conferences, Las Vegas, NV, Paper No. DETC99/DAC-8584.
Hacker, K., and Lewis, K., 2002, “Robust Design Through the Use of a Hybrid Genetic Algorithm,” Proceedings of the 2002 DETC and CIE Conference, Montreal, Canada, Paper No. DETC2002/DAC-34108.
The MathWorks, Inc., “Find Minimum of Unconstrained Multivariable Function Using Derivative-Free Method—MATLAB,” http://www.mathworks.com/help/techdoc/ref/fminsearch.html
The MathWorks, Inc., “Find Minimum of Function Using Genetic Algorithm—MATLAB,” http://www.mathworks.com/help/toolbox/gads/ga.html
The MathWorks, Inc., “Find Minimum of Constrained Nonlinear Multivariable Function—MATLAB,” http://www.mathworks.com/help/toolbox/optim/ug/fmincon.html
Tang, B., 1993, “Orthogonal Array-Based Latin Hypercubes,” J. Am. Stat. Assoc., 88(424), pp. 1392–1397. [CrossRef]
Nievergelt, J., 2000, “Exhaustive Search, Combinatorial Optimization and Enumeration: Exploring the Potential of Raw Computing Power,” Lect. Notes Comput. Sci., 1963, pp. 18–35. [CrossRef]


Grahic Jump Location
Fig. 1

Diagram of two bar truss

Grahic Jump Location
Fig. 2

Cross section of I-beam

Grahic Jump Location
Fig. 3

Illustration of percent change calculation




Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging and repositioning the boxes below.

Related Journal Articles
Related eBook Content
Topic Collections

Sorry! You do not have access to this content. For assistance or to subscribe, please contact us:

  • TELEPHONE: 1-800-843-2763 (Toll-free in the USA)
  • EMAIL: asmedigitalcollection@asme.org
Sign In