Research Papers

Analysis of Collaborative Design Networks: A Case Study of OpenIDEO

[+] Author and Article Information
Mark Fuge

Department of Mechanical Engineering,
Berkeley Institute of Design,
University of California,
Berkeley, CA 94709
e-mail: mark.fuge@berkeley.edu

Kevin Tee

Department of Computer Science,
Berkeley Institute of Design,
University of California,
Berkeley, CA 94709
e-mail: kevintee@berkeley.edu

Alice Agogino

Department of Mechanical Engineering,
Berkeley Institute of Design,
University of California,
Berkeley, CA 94709
e-mail: agogino@berkeley.edu

Nathan Maton

San Francisco, CA 94105
e-mail: nmaton@ideo.com

1Corresponding author.

Contributed by the Design Engineering Division of ASME for publication in the JOURNAL OF COMPUTING AND INFORMATION SCIENCE IN ENGINEERING. Manuscript received December 17, 2013; final manuscript received January 9, 2014; published online March 12, 2014. Editor: Bahram Ravani.

J. Comput. Inf. Sci. Eng 14(2), 021009 (Mar 12, 2014) (8 pages) Paper No: JCISE-13-1285; doi: 10.1115/1.4026510 History: Received December 17, 2013; Revised January 09, 2014

This paper presents a large-scale empirical study of OpenIDEO, an online collaborative design community. Using network analysis techniques, we describe the properties of this collaborative design network and discuss how it differs from common models of network formation seen in other social or technological networks. One major finding is that in OpenIDEO's social network the highly connected members talk more to less connected members than each other—a behavior not commonly found in other social and collaborative networks. We discuss how some of the interventions and incentives inherent in OpenIDEO's platform might cause this unique structure, and what advantages and disadvantages this structure has for coordinating distributed design teams. Specifically, its core-periphery structure is robust to network changes, but is at risk of decreasing design exploration ability if the core becomes too heavily clustered or loses efficiency. We discuss possible interventions that can prevent this outcome: encouraging core members to collaborate with periphery nodes, and increasing the diversity of the user population.

Copyright © 2014 by ASME
Topics: Design , Collaboration
Your Session has timed out. Please sign back in to continue.


Mason, W., and Watts, D. J., 2012, “Collaborative Learning in Networks,” Proc. Natl. Acad. Sci., 109(3), pp. 764–769. [CrossRef]
Stephen, A. T., Zubcsek, P. P., and Goldenberg, J., 2013, “Product Ideation in Social Networks,” Social Science Research Network Working Paper Series.
Newman, M., 2010, Networks: An Introduction, Oxford University Press, Oxford, NY.
Scott, J., 2011, “Social Network Analysis: Developments, Advances, and Prospects,” Soc. Network Anal. Min., 1(1), pp. 21–26. [CrossRef]
Madey, G., Freeh, V., and Tynan, R., 2002, “The Open Source Software Development Phenomenon: An Analysis-Based on Social Network Theory,” Proceedings of the Eighth Americas Conference on Information Systems, pp. 1806–1815.
Xu, J., Gao, Y., Christley, S., and Madey, G., 2005, “A Topological Analysis of the Open Source Software Development Community,” Proceedings of the 38th IEEE Annual Hawaii International Conference on System Sciences, Vol. 7, p. 198a.
Sarkar, S., and Dong, A., 2011, “Community Detection in Graphs Using Singular Value Decomposition,” Phys. Rev. E, 83(4), p. 046114. [CrossRef]
Ugander, J., Karrer, B., Backstrom, L., and Marlow, C., 2011, “The Anatomy of the Facebook Social Graph,” preprint arXiv:1111.4503. Available at: http://arxiv.org/abs/1111.4503
Zhang, S., Hu, Y., Zhang, X., and Li, Y., 2013, “Simulation Study on Collaborative Behaviors in Mass Collaborative Product Development,” 2013 IEEE 17th International Conference on Computer Supported Cooperative Work in Design (CSCWD), pp. 375–379.
Panchal, J. H., 2009, “Co-evolution of Products and Communities in Mass-Collaborative Product Development—A Computational Exploration,” International Conference on Engineering Design (ICED’09).
Le, Q., 2012, “Analysis and Modeling of the Product Structure and Community Structure in Open Source Processes,” Ph.D. thesis, Washington State University, Pullman, WA.
Sha, Z., and Panchal, J., 2013, “Estimating the Node-Level Behaviors in Complex Networks From Structural Datasets,” 2013 ASME Computers and Information in Engineering (CIE) Conference,ASME, Portland, Oregon, USA, August 4–7, 2013, Paper No. DETC2013-12063. [CrossRef]
Hagberg, A. A., Schult, D. A., and Swart, P. J., 2008, “Exploring Network Structure, Dynamics, and Function Using NetworkX,” Proceedings of the 7th Python in Science Conference (SciPy2008), pp. 11–15.
Palla, G., Derenyi, I., Farkas, I., and Vicsek, T., 2005, “Uncovering the Overlapping Community Structure of Complex Networks in Nature and Society,” Nature, 435(7043), pp. 814–818. [CrossRef] [PubMed]
Csermely, P., London, A., Wu, L.-Y., and Uzzi, B., 2013, “Structure and Dynamics of Core-Periphery Networks,” J. Complex Network, 1, pp. 93–123. [CrossRef]
Rombach, M. P., Porter, M. A., Fowler, J. H., and Mucha, P. J., 2013, “Core-Periphery Structure in Networks,” e-print arXiv:1202.2684 v2. Available at: http://arxiv.org/abs/1202.2684
Fortunato, S., 2010, “Community Detection in Graphs,” Phys. Rep., 486(3–5), pp. 75–174. [CrossRef]


Grahic Jump Location
Fig. 2

The concept graphs have higher diameter (b) and lower density (c) than the social graphs, despite roughly equivalent network sizes (a). This is possible due to small levels of clustering within the concept graph, and the fact that the social graph has certain mechanisms built in that reduce the graph diameter (see Sec. 4). The concept graph exhibits low centralization (e) and low global efficiency (f), while the social graph exhibits medium centralization and low efficiency. In both cases, higher efficiency would be more advantageous in order to ease transfer of ideas and feedback, respectively. Figure 1 provides some visual intuition behind these results.

Grahic Jump Location
Fig. 3

Degree complementary cumulative distribution functions for the largest connected component of different types of Open IDEO networks. Each line corresponds to a different challenge. Both types of networks are generally power-law distributed.

Grahic Jump Location
Fig. 4

Unlike most social networks, the OpenIDEO social graph appears negatively assortative (disassortative) by degree, rather than positively assortative. This means that members with high degree (lots of communication) talk more with those with low degree, rather than with others of high degree. This style of communication is highly atypical of most social networks. It reduces the diameter of the network and increases the fraction of the members in the largest graph component. The concept graph appears neither assortative nor disassortative.

Grahic Jump Location
Fig. 5

Boxplots of the number of communities detected using the k-Clique Percolation Method, for different values of k in both the concept (a) and social graphs (b) [14]. The concept graphs have a high number of small communities, while the social graphs have only a few communities that are significantly more connected. This reinforces the visual data in.

Grahic Jump Location
Fig. 6

Visualizing the communities created using the k-Clique Percolation Method, for different values of k in both the social and concept graphs [14]. This uses the networks from challenge 10 as a representative example. Colored sub-graphs represent nodes within a given community, and red nodes represent nodes in multiple communities. For the concept graphs (a)–(c), multiple, non-overlapping communities are present at different community scales (k = [3,5]). However, for the social graphs there is generally only a single core community—any additional communities tend to be heavily overlapping (e.g., the red nodes in (f).

Grahic Jump Location
Fig. 7

Removing OpenIDEO community managers from the social graph (“Social w/o CM”), we see some noticeable, but small changes: the centralization of the network decreases and the assortativity increases. The general behaviors we described above are unlikely to be caused exclusively by existing OpenIDEO community managers.



Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging and repositioning the boxes below.

Related Journal Articles
Related eBook Content
Topic Collections

Sorry! You do not have access to this content. For assistance or to subscribe, please contact us:

  • TELEPHONE: 1-800-843-2763 (Toll-free in the USA)
  • EMAIL: asmedigitalcollection@asme.org
Sign In