Design decisions: concordance of designers and effects of the Arrow’s theorem on the collective preference ranking
Tóm tắt
The problem of collective decision by design teams has received considerable attention in the scientific literature of engineering design. A much debated problem is that in which multiple designers formulate their individual preference rankings of different design alternatives and these rankings should be aggregated into a collective one. This paper focuses the attention on three basic research questions: (1) “How can the degree of concordance of designer rankings be measured?”, (2) “For a given set of designer rankings, which aggregation model provides the most coherent solution?”, and (3) “To what extent is the collective ranking influenced by the aggregation model in use?”. The aim of this paper is to present a novel approach that addresses the above questions in a relatively simple and agile way. A detailed description of the methodology is supported by a practical application to a real-life case study.
Tài liệu tham khảo
citation_title=Social choice and individual values; citation_publication_date=2012; citation_id=CR1; citation_author=KJ Arrow; citation_publisher=Yale University Press
citation_title=Social choice and multicriterion decision-making; citation_publication_date=1986; citation_id=CR2; citation_author=KJ Arrow; citation_author=H Rayanaud; citation_publisher=MIT Press
citation_journal_title=Isis; citation_title=Mémoire sur les élections au scrutin, Comptes Rendus de l’Académie des Sciences. Translated by Alfred de Grazia as Mathematical derivation of an election system; citation_author=JC Borda; citation_volume=44; citation_publication_date=1781; citation_pages=42-51; citation_id=CR3
citation_journal_title=Electoral Stud; citation_title=Democratic electoral systems around the world; citation_author=NC Bormann, M Golder; citation_volume=32; citation_issue=2; citation_publication_date=2013; citation_pages=1946-2011360; citation_doi=10.1016/j.electstud.2013.01.005; citation_id=CR4
citation_title=Creating breakthrough products: innovation from product planning to program approval; citation_publication_date=2012; citation_id=CR5; citation_author=J Cagan; citation_author=CM Vogel; citation_publisher=FT Press
citation_journal_title=Inf Fusion; citation_title=Ordering based decision making—a survey; citation_author=S Chen, J Liu, H Wang, JC Augusto; citation_volume=14; citation_issue=4; citation_publication_date=2012; citation_pages=521-531; citation_doi=10.1016/j.inffus.2012.10.005; citation_id=CR6
citation_journal_title=Fuzzy Sets Syst; citation_title=A note on the internal consistency of various preference representations; citation_author=F Chiclana, F Herrera, E Herrera-Viedma; citation_volume=131; citation_issue=1; citation_publication_date=2002; citation_pages=75-78; citation_doi=10.1016/S0165-0114(01)00256-1; citation_id=CR7
citation_journal_title=Eur J Oper Res; citation_title=Distance-based and ad hoc consensus models in ordinal preference ranking; citation_author=WD Cook; citation_volume=172; citation_issue=2; citation_publication_date=2006; citation_pages=369-385; citation_doi=10.1016/j.ejor.2005.03.048; citation_id=CR8
citation_journal_title=J Mech Des; citation_title=A document analysis method for characterizing design team performance; citation_author=A Dong, AW Hill, AM Agogino; citation_volume=126; citation_issue=3; citation_publication_date=2004; citation_pages=378-385; citation_doi=10.1115/1.1711818; citation_id=CR9
citation_journal_title=J Eng Des; citation_title=Decision-making in engineering design—observations from design experiments; citation_author=S Dwarakanath, KM Wallace; citation_volume=6; citation_issue=3; citation_publication_date=1995; citation_pages=191-206; citation_doi=10.1080/09544829508907913; citation_id=CR10
citation_journal_title=Res Eng Des; citation_title=Rank ordering engineering designs: pairwise comparison charts and Borda counts; citation_author=CL Dym, WH Wood, MJ Scott; citation_volume=13; citation_publication_date=2002; citation_pages=236-242; citation_doi=10.1007/s00163-002-0019-8; citation_id=CR11
citation_journal_title=Behav Sci; citation_title=Voter concordance, simple majorities, and group decision methods; citation_author=PC Fishburn; citation_volume=18; citation_publication_date=1973; citation_pages=364-376; citation_doi=10.1002/bs.3830180505; citation_id=CR12
citation_title=The theory of social choice; citation_publication_date=1973; citation_id=CR13; citation_author=PC Fishburn; citation_publisher=Princeton University Press
citation_journal_title=Omega; citation_title=Checking the consistency of the solution in ordinal semi-democratic decision-making problems; citation_author=F Franceschini, D Maisano; citation_volume=57; citation_issue=1; citation_publication_date=2015; citation_pages=188-195; citation_doi=10.1016/j.omega.2015.04.014; citation_id=CR14
citation_journal_title=Qual Eng; citation_title=Consistency analysis in quality classification problems with multiple rank-ordered agents; citation_author=F Franceschini, D Maisano; citation_volume=29; citation_issue=4; citation_publication_date=2017; citation_pages=672-689; citation_doi=10.1080/08982112.2016.1255332; citation_id=CR15
Franceschini F, Maisano D (2018) Fusion of partial orderings for decision problems in quality management. In: Proceedings of the 3rd international conference on quality engineering and management (ICQEM 2018), July 11–13, 2018, Barcelona (Spain)
citation_journal_title=Res Eng Des; citation_title=Customer requirements prioritization on QFD: a new proposal based on the Generalized Yager’s Algorithm; citation_author=F Franceschini, D Maisano, L Mastrogiacomo; citation_volume=26; citation_issue=2; citation_publication_date=2015; citation_pages=171-187; citation_doi=10.1007/s00163-015-0191-2; citation_id=CR17
citation_journal_title=Int J Prod Res; citation_title=Prioritization of engineering characteristics in QFD in the case of customer requirements orderings; citation_author=F Franceschini, M Galetto, D Maisano, L Mastrogiacomo; citation_volume=53; citation_issue=13; citation_publication_date=2015; citation_pages=3975-3988; citation_doi=10.1080/00207543.2014.980457; citation_id=CR18
citation_journal_title=Eur J Oper Res; citation_title=A new proposal for fusing individual preference orderings by rank-ordered agents: a generalization of the Yager’s algorithm; citation_author=F Franceschini, D Maisano, L Mastrogiacomo; citation_volume=249; citation_issue=1; citation_publication_date=2016; citation_pages=209-223; citation_doi=10.1016/j.ejor.2015.08.022; citation_id=CR19
citation_title=Designing performance measurement systems: theory and practice of key performance indicators; citation_publication_date=2019; citation_isbn=978-3-030-01191-8; citation_id=CR20; citation_author=F Franceschini; citation_author=M Galetto; citation_author=D Maisano; citation_publisher=Springer
citation_journal_title=Res Eng Des; citation_title=Arrow’s theorem, multi-criteria decision problems and multi-attribute preferences in engineering design; citation_author=M Franssen; citation_volume=16; citation_issue=1–2; citation_publication_date=2005; citation_pages=42-56; citation_doi=10.1007/s00163-004-0057-5; citation_id=CR21
citation_journal_title=Res Eng Des; citation_title=The Pugh controlled convergence method: model-based evaluation and implications for design theory; citation_author=DD Frey; citation_volume=20; citation_issue=1; citation_publication_date=2009; citation_pages=41-58; citation_doi=10.1007/s00163-008-0056-z; citation_id=CR22
citation_journal_title=Res Eng Des; citation_title=Research in engineering design: the role of mathematical theory and empirical evidence; citation_author=DD Frey; citation_volume=21; citation_issue=3; citation_publication_date=2010; citation_pages=145-151; citation_doi=10.1007/s00163-010-0085-2; citation_id=CR23
citation_journal_title=J Mech Des; citation_title=Design team convergence: the influence of example solution quality; citation_author=K Fu, J Cagan, K Kotovsky; citation_volume=132; citation_issue=11; citation_publication_date=2010; citation_pages=111005; citation_doi=10.1115/1.4002202; citation_id=CR24
citation_journal_title=J Mech Des; citation_title=The implications of Arrow’s impossiblity theorem on approaches to optimal engineering design; citation_author=GA Hazelrigg; citation_volume=118; citation_issue=2; citation_publication_date=1996; citation_pages=161-164; citation_doi=10.1115/1.2826864; citation_id=CR25
citation_journal_title=J Mech Des; citation_title=An axiomatic framework for engineering design; citation_author=GA Hazelrigg; citation_volume=121; citation_issue=3; citation_publication_date=1999; citation_pages=342; citation_doi=10.1115/1.2829466; citation_id=CR26
citation_journal_title=Res Eng Des; citation_title=The Pugh controlled convergence method: model-based evaluation and implications for design theory; citation_author=GA Hazelrigg; citation_volume=21; citation_issue=3; citation_publication_date=2010; citation_pages=143-144; citation_doi=10.1007/s00163-010-0087-0; citation_id=CR27
citation_journal_title=Inf Fusion; citation_title=A review of soft consensus models in a fuzzy environment; citation_author=E Herrera-Viedma, FJ Cabrerizo, J Kacprzyk, W Pedrycz; citation_volume=17; citation_publication_date=2014; citation_pages=4-13; citation_doi=10.1016/j.inffus.2013.04.002; citation_id=CR28
citation_journal_title=J Eng Des; citation_title=Understanding and modelling heterogeneity of human preferences for engineering design; citation_author=C Hoyle, W Chen; citation_volume=22; citation_issue=8; citation_publication_date=2011; citation_pages=583-601; citation_doi=10.1080/09544821003604496; citation_id=CR29
citation_journal_title=Res Eng Des; citation_title=Clarifying the debate on selection methods for engineering: Arrow’s impossibility theorem, design performances, and information basis; citation_author=JF Jacobs, I Poel, P Osseweijer; citation_volume=25; citation_issue=1; citation_publication_date=2014; citation_pages=3-10; citation_doi=10.1007/s00163-013-0160-6; citation_id=CR30
citation_journal_title=J Eng Des; citation_title=Engineering parameter selection for design optimization during preliminary design; citation_author=A Kaldate; citation_volume=17; citation_issue=March 2015; citation_publication_date=2006; citation_pages=291-310; citation_doi=10.1080/09544820500274027; citation_id=CR31
citation_journal_title=J Mech Des; citation_title=Decision methods for design: insights from psychology; citation_author=KV Katsikopoulos; citation_volume=134; citation_issue=8; citation_publication_date=2012; citation_pages=084504; citation_doi=10.1115/1.4007001; citation_id=CR32
citation_journal_title=Int J Collab Eng; citation_title=The foundations of collaborative group decisions; citation_author=RL Keeney; citation_volume=1; citation_publication_date=2009; citation_pages=4; citation_doi=10.1504/IJCE.2009.027438; citation_id=CR33
citation_title=Rank correlation methods; citation_publication_date=1962; citation_id=CR34; citation_author=null Kendall; citation_publisher=Griffin & C.
citation_journal_title=Ann Math Stat; citation_title=The problem of m-rankings; citation_author=MG Kendall, BB Smith; citation_volume=10; citation_publication_date=1939; citation_pages=275-287; citation_doi=10.1214/aoms/1177732186; citation_id=CR35
Ladha K, Miller G, Oppenheimer J (2003 Information aggregation by majority rule: theory and experiment.
http://www.gvptsites.umd.edu/oppenheimer/research/jury.pdf
citation_journal_title=J Agric Biol Environ Stat; citation_title=Species associations: the Kendall coefficient of concordance revisited; citation_author=P Legendre; citation_volume=10; citation_publication_date=2005; citation_pages=226; citation_doi=10.1198/108571105X46642; citation_id=CR37
citation_title=Coefficient of concordance; citation_inbook_title=Encyclopedia of research design; citation_publication_date=2010; citation_pages=164-169; citation_id=CR38; citation_author=P Legendre; citation_publisher=SAGE Publications, Inc.
citation_journal_title=Organ Sci; citation_title=Fairness from the top? Perceived procedural justice and collaborative problem solving in new product development; citation_author=H Li, JB Bingham, EE Umphress; citation_volume=18; citation_issue=2; citation_publication_date=2007; citation_pages=200-216; citation_doi=10.1287/orsc.1060.0231; citation_id=CR39
McComb C, Goucher-Lambert K, Cagan J(2015), Fairness and manipulation: an empirical study of Arrow’s impossibility theorem. In: International conference on engineering design, Milan, Italy, pp 267–276
citation_journal_title=Des Sci; citation_title=Impossible by design? Fairness, strategy and Arrow’s impossibility theorem; citation_author=C McComb, K Goucher-Lambert, J Cagan; citation_volume=3; citation_publication_date=2017; citation_pages=1-26; citation_doi=10.1017/dsj.2017.1; citation_id=CR41
citation_title=Algorithmic game theory; citation_publication_date=2007; citation_id=CR42; citation_author=N Nisan; citation_publisher=Cambridge University Press
citation_inbook_title=On the relevance of theoretical results to voting system choiceElectoral systems: studies in choice and welfare; citation_publication_date=2012; citation_pages=255-274; citation_id=CR43; citation_author=H Nurmi; citation_publisher=Springer
citation_journal_title=Int J Qual Reliabil Manag; citation_title=Limitations of the house of quality to provide quantitative design information; citation_author=AT Olewnik, K Lewis; citation_volume=25; citation_issue=2; citation_publication_date=2008; citation_pages=125-146; citation_doi=10.1108/02656710810846916; citation_id=CR44
citation_journal_title=J Intell Manuf; citation_title=A hybrid fuzzy MCDM approach to machine tool selection; citation_author=S Önüt, SS Kara, T Efendigil; citation_volume=19; citation_issue=4; citation_publication_date=2008; citation_pages=443-453; citation_doi=10.1007/s10845-008-0095-3; citation_id=CR45
citation_title=Collaborative creativity, group creativity and team innovation; citation_inbook_title=Handbook of organizational creativity; citation_publication_date=2011; citation_pages=327-357; citation_id=CR46; citation_author=PB Paulus; citation_author=MT Dzindolet; citation_author=N Kohn; citation_publisher=Elsevier
citation_journal_title=Res Eng Des; citation_title=My method is better!; citation_author=Y Reich; citation_volume=21; citation_issue=3; citation_publication_date=2010; citation_pages=137-142; citation_doi=10.1007/s00163-010-0092-3; citation_id=CR47
citation_title=Geometry of voting; citation_publication_date=2011; citation_id=CR48; citation_author=DG Saari; citation_publisher=Elsevier
citation_title=Decision and elections; citation_publication_date=2011; citation_id=CR49; citation_author=DG Saari; citation_publisher=Cambridge University Press
citation_journal_title=Res Eng Des; citation_title=Are partwise comparisons reliable?; citation_author=DG Saari, KK Sieberg; citation_volume=15; citation_issue=1; citation_publication_date=2004; citation_pages=62-71; citation_doi=10.1007/s00163-003-0046-0; citation_id=CR50
citation_journal_title=Res Eng Des; citation_title=Arrow’s theorem and engineering design decision making; citation_author=MJ Scott, EK Antonsson; citation_volume=11; citation_publication_date=1999; citation_pages=218-228; citation_doi=10.1007/s001630050016; citation_id=CR51
citation_journal_title=J Mech Des; citation_title=A formal approach to handling conflicts in multiattribute group decision making; citation_author=TK See, K Lewis; citation_volume=128; citation_issue=4; citation_publication_date=2006; citation_pages=678; citation_doi=10.1115/1.2197836; citation_id=CR52
citation_title=Functional diversity and conflict in cross-functional product development teams: considering representational gaps and task characteristics; citation_inbook_title=Understanding teams; citation_publication_date=2005; citation_pages=89-110; citation_id=CR53; citation_author=LR Weingart; citation_publisher=Information Age Publishing
citation_journal_title=Fuzzy Sets Syst; citation_title=Fusion of multi-agent preference orderings; citation_author=RR Yager; citation_volume=117; citation_issue=1; citation_publication_date=2001; citation_pages=1-12; citation_doi=10.1016/S0165-0114(98)00418-7; citation_id=CR54
citation_journal_title=J Eng Des; citation_title=Analysis of decision-making methodologies for desirability score of conceptual design; citation_author=SH Yeo, MW Mak, SAP Balon; citation_volume=15; citation_issue=2; citation_publication_date=2004; citation_pages=195-208; citation_doi=10.1080/09544820310001642191; citation_id=CR55