A novel systematic method to evaluate computer-supported collaborative design technologies

Research in Engineering Design - Tập 31 - Trang 53-81 - 2019
R. Brisco1, R. I. Whitfield1, H. Grierson1
1Department of Design, Manufacture and Engineering Management, University of Strathclyde, Glasgow, UK

Tóm tắt

Selection of suitable computer-supported collaborative design (CSCD) technologies is crucial to facilitate successful projects. This paper presents the first systematic method for engineering design teams to evaluate and select the most suitable CSCD technologies comparing technology functionality and project requirements established in peer-reviewed literature. The paper first presents 220 factors that influence successful CSCD. These factors were then systematically mapped and categorised to create CSCD requirement statements. The novel evaluation and selection method incorporates these requirement statements within a matrix and develops a discourse analysis text processing algorithm with data from collaborative projects to automate the population of how technologies impact the success of CSCD in engineering design teams. This method was validated using data collected across 3 years of a student global design project. The impact of this method is the potential to change the way engineering design teams consider the technology they use and how the selection of appropriate tools impacts the success of their CSCD projects. The development of the CSCD evaluation matrix is the first of its kind enabling a systematic and justifiable comparison and technology selection, with the aim of best supporting the engineering designers collaborative design activity.

Tài liệu tham khảo

Adams K (2015) Non-functional requirements in systems analysis and design. Springer, Berlin Ahram T, Karwowski W, Amaba B (2011) Collaborative systems engineering and social-networking approach to design and modelling of smarter products. Behav Inf Technol 30:13–26. https://doi.org/10.1080/0144929X.2010.490957 Antunes P, Ferreira A, Zurita G, Baloian N (2011) Analyzing the support for large group collaborations using Google Maps. In: 15th international conference on computer supported cooperative work in design (CSCWD), pp 748–755 Benolken P, Wewior M, Lang U (2010) A virtual workspace for distributed design and engineering tasks. In: 6th international conference on collaborative computing: networking, applications and worksharing (CollaborateCom). IEEE, pp 1–9 Bittner EAC, Leimeister JM (2013) Why shared understanding matters—engineering a collaboration process for shared understanding to improve collaboration effectiveness in heterogeneous teams. In: 46th Hawaii international conference on system sciences (HICSS). IEEE, pp 106–114 Bohemia E (2013) Design learning for tomorrow. In: Proceedings of the 2nd international conference for design education researchers, p 2 Borsato M, Peruzzini M, Stjepandić J et al (2015) Collaborative engineering. Concurrent engineering in the 21st century. Springer, Berlin, pp 165–196 Brewer PE (2015) Evaluating and maintaining effective global virtual teams. Wiley, Oxford, pp 158–181 Brisco R, Whitfield RI, Grierson H (2016) Recommendations for the use of social network sites and mobile devices in a collaborative engineering design project. In: Proceedings of the 18th international conference on engineering and product design education (E&PDE16), design education: collaboration and cross-disciplinarity. The Design Society, pp 394–399 Brisco R, Whitfield RI, Grierson H (2017) The use of social network sites in a global engineering design project. In: Proceedings of the 21th international conference on engineering design (ICED 17). The Design Society, pp 059–068 Brisco R, Whitfield RI, Grierson H (2018a) Modelling the relationship between design activity and computer-supported collaborative design factors. In: Proceedings of the DESIGN 2018 15th international design conference. The Design Society, pp 193–204 Brisco R, Whitfield RI, Grierson H, others (2018b) Are social network sites the future of engineering design education? In: DS 93: proceedings of the 20th international conference on engineering and product design education (E&PDE 2018), Dyson School of Engineering, Imperial College, London. 6th–7th September 2018. The Design Scoiety, pp 400–405 Brown P (2000) Technology and trust in teams. Research Challenges, 2000 Proceedings Academia/Industry Working Conference on 15–20. https://doi.org/10.1109/aiworc.2000.843266 Butler M (2010) Android: changing the mobile landscape. IEEE Pervasive Comput 10:4–7 Carroll JM, Neale DC, Isenhour PL et al (2003) Notification and awareness: synchronizing task-oriented collaborative activity. Int J Hum Comput Stud 58:605–632. https://doi.org/10.1016/S1071-5819(03)00024-7 Chan F, Chan M, Tang N (2000) Evaluation methodologies for technology selection. J Mater Process Technol 107:330–337 Cho JY, Cho M (2014) Student perceptions and performance in online and offline collaboration in an interior design studio. Int J Technol Des Educ 24:473–491. https://doi.org/10.1007/s10798-014-9265-0 Cochrane (2017) Covidence (Systematic Review Software) Conole G, Alevizou P (2010) A literature review of the use of Web 2.0 tools in higher education. A report commissioned by the Higher Education Academy Cross M (2014) What is social media? Social media security, pp 1–20 Duffy A (2002) Designing design. In: DS 29: Proceedings of EDIProD 2002, Zielona Góra, Poland, 10.-12.10. 2002 Elfving S (2007) Managing collaborative product development: a model for identifying key factors in product development projects Ellison NB, Steinfeld C, Lampe C (2007) TOIL: the benefits of Facebook “friends:” Social capital and college students use of online social network sites. J Comput Mediated Commun 12:1143–1168. https://doi.org/10.1111/j.1083-6101.2007.00367.x Fain N, Kline M, Kline NF, Miro (2013) The dynamics of multicultural NPD teams in virtual environments. Int J Technol Des Educ 23:273–288 Ferro T (2015) The importance of publicly available social networking sites (SNSs) to entrepreneurs. CSCW 15:917–928 French DJ, Stone B, Nysetvold TT, Hepworth A, Red WE (2016) Collaborative design principles from minecraft with applications to multi-user computer-aided design. J Comput Inf Sci Eng. https://doi.org/10.1115/1.4032667 Fruchter R, Bosch-sijtsema P, Ruohomäki V (2010) Tension between perceived collocation and actual geographic distribution in project teams. AI Soc 25:183–192. https://doi.org/10.1007/s00146-009-0254-x Garcia-Perez A, Ayres R (2010) Wikifailure: the limitations of technology for knowledge sharing. Electron J Knowl Manag 8:43–51 Gericke L, Gumienny R, Meinel C (2010) Message capturing as a paradigm for asynchronous digital whiteboard interaction. In: 6th international conference on collaborative computing: networking, applications and worksharing (CollaborateCom). IEEE, pp 1–10 Germani M, Mengoni M, Peruzzini M (2012) A QFD-based method to support SMEs in benchmarking co-design tools. Comput Ind 63:12–29 Gibson CB, Cohen SG (2004) Virtual teams that work: creating conditions for virtual team effectiveness. Pers Psychol 57:243–246. https://doi.org/10.1108/13665620210427294 Gopsill J (2014) A social media approach to support engineering design communication, p 243 Gopsill J, Mcalpine HC, Hicks BJ (2013) A social media framework to support engineering design communication. Adv Eng Inform 27:580–597. https://doi.org/10.1016/j.aei.2013.07.002 Gopsill J, Jones S, Snider CM et al (2014) Understanding the engineering design process through the evolution of engineering digital objects. In: DESIGN 2014 13th international design conference, pp 1773–1784 Gopsill JA, Mcalpine HC, Hicks BJ (2015) Supporting engineering design communication using a custom-built social media tool. Adv Eng Inform 29:523–548 Grant MJ, Booth A (2009) A typology of reviews: an analysis of 14 review types and associated methodologies. Health Inf Lib J 26:91–108 Hank C (2012) Blogging your academic self: the what, the why and the how long? Social media for academics. Elsevier, New York, pp 3–19 Hansen NB, Dalsgaard P (2012) The productive role of material design artefacts in participatory design events. In: Proceedings of the 7th Nordic conference on human–computer interaction: making sense through design. ACM, pp 665–674 Hao S, Yu B, Wu W (2007) The impact of technology selection on innovation performance. Wireless communications, networking and mobile computing, 2007. WiCom 2007. International conference on, pp 5781–5783 Hatem WA, Kwan A, Miles J (2012) Comparing the effectiveness of face to face and computer mediated collaboration. Adv Eng Inform 26:383–395. https://doi.org/10.1016/j.aei.2012.01.001 Hay L, Duffy AH, McTeague C et al (2017) A systematic review of protocol studies on conceptual design cognition: design as search and exploration. Des Sci 3:2017 Herrmann T, Nolte A, Prilla M (2013) Awareness support for combining individual and collaborative process design in co-located meetings. Comput Support Cooper Work 22:241–270 Hicks BJ (2013) the language of collaborative engineering projects. In: ICED13: 19th international conference on engineering design, pp 1–10 Hinds PJ, Bailey DE (2003) Out of sight, out of sync: understanding conflict in distributed teams. Organ Sci 14:615–632. https://doi.org/10.1287/orsc.14.6.615.24872 Hirlehei A, Hunger A (2011) In designing an end-user tailorable synchronous groupware. In: 2011 international conference on collaboration technologies and systems (CTS). IEEE, pp 373–380 Horváth I (2012) Recent developments in computer supported cooperative work in design: from group collaboration through global connectivity to informing apobetics. In: 16th international conference on computer supported cooperative work in design (CSCWD). IEEE, pp 2–13 Hosnedl S, Srp Z, Dvorak J (2008) Cooperation of engineering and industrial designers on industrial projects. In: DS 48: proceedings DESIGN 2008, the 10th international design conference, Dubrovnik, Croatia Hsu C-M (2013) The construction of a web-based learning platform from the perspective of computer support for collaborative design. Int J Online Pedagogy Course Des 3:44–67. https://doi.org/10.4018/ijopcd.2013100104 Iacob C (2011) Identifying, relating, and evaluating design patterns for the design of software for synchronous collaboration. In: Proceedings of the 3rd ACM SIGCHI symposium on engineering interactive computing systems. ACM Press, p 323 Jinghua W, Liyi Z, Hongxiang X (2014) Simulation of project scheduling through the rule-based coordination in indirect collaboration design. J Simul 8:251–258. https://doi.org/10.1057/jos.2013.25 Kvan T (2000) Collaborative design: what is it? Autom Construct 9:409–415. https://doi.org/10.1016/S0926-5805(99)00025-4 Liu W, Pasman G, Taal-fokker J, Stappers PJ (2014) Exploring “Generation Y” interaction qualities at home and at work. Cogn Technol Work 16:405–415. https://doi.org/10.1007/s10111-013-0269-4 Luck R (2013) Articulating (mis)understanding across design discipline interfaces at a design team meeting. Artif Intell Eng Des Anal Manuf 27:155–166. https://doi.org/10.1017/S089006041300005X Maier AM, Eckert CM, Clarkson PJ (2006) Identifying requirements for communication support: a maturity grid-inspired approach. Expert Syst Appl 31:663–672 Maier AM, Kreimeyer M, Lindemann U, Clarkson PJ (2009) Reflecting communication: a key factor for successful collaboration between embodiment design and simulation. J Eng Des 20:265–287 Mamo J, Farrugia P, Borg J et al (2015) Using engineering design tools in multidisciplinary distributed student teams. In: 17th international conference on engineering and product design education, pp 99–104 Margaryan A, Boursinou E, Lukic D, Zwart HD (2014) Narrating your work: an approach to supporting knowledge sharing in virtual teams. Knowl Manag Res Pract 13:1–10. https://doi.org/10.1057/kmrp.2013.58 Markus P, James T, Luc F, Udo L (2007) Cross-cultural collaboration in design engineering-influence factors and their impact on work performance. Guidelines for a decision support method adapted to NPD processes Mattessich PW, Monsey BR (1992) Collaboration: what makes it work. A review of research literature on factors influencing successful collaboration. ERIC, New York McDonnell J (2012) Accommodating disagreement: a study of effective design collaboration. Des Stud 33:44–63. https://doi.org/10.1016/j.destud.2011.05.003 Metrix comScore M (2010) Ranks Top 50 U.S. Web Properties for May 2010 (PRESS RELEASE). 2010 Mittleman DD, Murphy JD, Briggs RO (2015) Collaboration systems: concept, value, and use. In: Nunamaker Jr JF, Briggs RO, Romano Jr NC (ed) 1st ed. Routledge, New York, p 45 Moher D, Liberati A, Tetzlaff J et al (2009) Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med 6:e1000097 Nicholas JM, Steyn H (2017) Project management for engineering, business and technology. Routledge, London O’Riordan S (2014) Exploring the relationship between social network sites and the consumption of cultural goods through the lens of affordances Pavkovic N, Štorga M, Bojcetic N, Marjanovic D (2013) Facilitating design communication through engineering information traceability. Artif Intell Eng Des Anal Manuf 27:105–119. https://doi.org/10.1017/S0890060413000012 Pektaş ŞT (2015) The virtual design studio on the cloud: a blended and distributed approach for technology-mediated design education. Arch Sci Rev 58:255–265. https://doi.org/10.1080/00038628.2015.1034085 Post TW (2014) From Lycos to Ask Jeeves to Facebook: tracking the 20 most popular web sites every year since 1996 Rapanta C, Maina M, Lotz N, Bacchelli A (2013) Team design communication patterns in e-learning design and development. Educ Tech Res Dev 61:581–605. https://doi.org/10.1007/s11423-013-9306-5 Rassias N, Kirytopoulos K (2014) Evaluating risk factors in the operation of virtual teams in ICT projects. In: Industrial engineering and engineering management (IEEM), 2014 IEEE international conference on 1192–1197. https://doi.org/10.1109/ieem.2014.7058827 Reich Y, Konda S, Subrahmanian E et al (1999) Building agility for developing agile design information systems. Res Eng Design 11:67–83 Sarka P, Ipsen C, Maier AM et al (2014) Engineers are using social media for work purposes. In: 13th international design conference Sclater N (2008) Web 2. 0, personal learning environments, and the future of learning management systems. Management 2008:2008–2009 Shea TP, Sherer PD, Quilling RD, Blewett CN (2011) Managing global virtual teams across classrooms, students and faculty. J Teach Int Bus 22:300–313. https://doi.org/10.1080/08975930.2011.653911 Shen W, Barthès J-P, Luo J (2015) Computer supported collaborative design: technologies, systems, and applications. Contemporary issues in systems science and engineering. Wiley, New York, pp 537–573 Sivunen A, Valo M (2006) Team leaders’ technology choice in virtual teams. Prof Commun IEEE Trans 49:57–68. https://doi.org/10.1109/TPC.2006.870458 Torkkeli M, Tuominen M (2002) The contribution of technology selection to core competencies. Int J Prod Econ 77:271–284 Törlind P, Larsson A (2002) Support for informal communication in distributed engineering design teams. In: Annals of 2002 Int’l CIRP design seminar, pp 16–18 Van Dijk J, van der Lugt R (2013) Scaffolds for design communication: research through design of shared understanding in design meetings. Artif Intell Eng Des Anal Manuf 27:121–131. https://doi.org/10.1017/S0890060413000024 Van Grinsven J, de Vreede G-J (2002) Collaborative engineering: ‘towards design guidelines for risk management in distributed software development’. In: DS 30: Proceedings of DESIGN 2002, the 7th international design conference, Dubrovnik Vyas D, Nijholt A, Heylen D et al (2010a) Remarkable objects: supporting collaboration in a creative environment. In: Proceedings of the 12th ACM international conference on ubiquitous computing. ACM, pp 37–40 Vyas D, Nijholt A, van der Veer G (2010b) Supporting cooperative design through “living” artefacts. In: Proceedings of the 6th Nordic conference on human-computer interaction extending boundaries—NordiCHI’10. ACM Press, p 541 Vyas D, Veer G, Nijholt A (2012) Creative practices in the design studio culture: collaboration and communication. Cogn Technol Work 15:415–443. https://doi.org/10.1007/s10111-012-0232-9 Wangsa IT, Uden L, Mills SF (2011) Using activity theory to develop requirements analysis framework for collaborative working environments. In: Proceedings of the 2011 15th international conference on computer supported cooperative work in design (CSCWD). IEEE, pp 756–763 Xie C, Wu D, Luo J et al (2010) A case study of multi-team communications in construction design under supply chain partnering. Supply Chain Manag Int J 15:363–370. https://doi.org/10.1108/13598541011068279 Yap CM, Souder WE (1993) A filter system for technology evaluation and selection. Technovation 13:449–469 Zhao D, Rosson MB (2009) How and why people Twitter. In: GROUP’09 proceedings of the ACM 2009 international conference on supporting group work, pp 243–252 Zheng J, Feng Y (2012) Study on the collaborative product design platform in the context of the internet of things. In: 2nd international conference on consumer electronics, communications and networks (CECNet). IEEE, pp 3538–3542