A Decision Tree Based Methodology for Evaluating Creativity in Engineering Design

Multiple metrics have been proposed to measure the creativity of products, yet there is still a need for effective, reliable methods to assess the originality of new product designs. In the present article we introduce a method to assess the originality of concepts that are produced during idea gene...

Full description

Bibliographic Details
Main Authors: Trina C. Kershaw, Sankha Bhowmick, Carolyn Conner Seepersad, Katja Hölttä-Otto
Format: Article
Language:English
Published: Frontiers Media S.A. 2019-01-01
Series:Frontiers in Psychology
Subjects:
Online Access:https://www.frontiersin.org/article/10.3389/fpsyg.2019.00032/full
id doaj-44320974e5344ded984c4da2da2c9027
record_format Article
spelling doaj-44320974e5344ded984c4da2da2c90272020-11-24T22:03:04ZengFrontiers Media S.A.Frontiers in Psychology1664-10782019-01-011010.3389/fpsyg.2019.00032390256A Decision Tree Based Methodology for Evaluating Creativity in Engineering DesignTrina C. Kershaw0Sankha Bhowmick1Carolyn Conner Seepersad2Katja Hölttä-Otto3Department of Psychology, University of Massachusetts Dartmouth, Dartmouth, MA, United StatesDepartment of Mechanical Engineering, University of Massachusetts Dartmouth, Dartmouth, MA, United StatesDepartment of Mechanical Engineering, The University of Texas at Austin, Austin, TX, United StatesDesign Factory, Department of Mechanical Engineering, Aalto University, Helsinki, FinlandMultiple metrics have been proposed to measure the creativity of products, yet there is still a need for effective, reliable methods to assess the originality of new product designs. In the present article we introduce a method to assess the originality of concepts that are produced during idea generation activities within engineering design. This originality scoring method uses a decision tree that is centered around distinguishing design innovations at the system level. We describe the history and the development of our originality scoring method, and provide evidence of its reliability and validity. A full protocol is provided, including training procedures for coders and multiple examples of coded concepts that received different originality scores. We summarize data from over 500 concepts for garbage collection systems that were scored by Kershaw et al. (2015). We then show how the originality scoring method can be applied to a different design problem. Our originality scoring method, the Decision Tree for Originality Assessment in Design (DTOAD), has been a useful tool to identify differences in originality between various cohorts of Mechanical Engineering students. The DTOAD reveals cross-sectional differences in creativity between beginning and advanced students, and shows longitudinal growth in creativity from the beginning to the end of the undergraduate career, thus showing how creativity can be influenced by the curriculum. The DTOAD can be applied to concepts produced using different ideation procedures, including concepts produced both with and without a baseline example product, and concepts produced when individuals are primed to think of different users for their designs. Finally, we show how our the DTOAD compares to other measurements of creativity, such as novelty, fixation, and remoteness of association.https://www.frontiersin.org/article/10.3389/fpsyg.2019.00032/fullcreativityengineering designdecision treecreative productscreativity measurementcreativity metrics
collection DOAJ
language English
format Article
sources DOAJ
author Trina C. Kershaw
Sankha Bhowmick
Carolyn Conner Seepersad
Katja Hölttä-Otto
spellingShingle Trina C. Kershaw
Sankha Bhowmick
Carolyn Conner Seepersad
Katja Hölttä-Otto
A Decision Tree Based Methodology for Evaluating Creativity in Engineering Design
Frontiers in Psychology
creativity
engineering design
decision tree
creative products
creativity measurement
creativity metrics
author_facet Trina C. Kershaw
Sankha Bhowmick
Carolyn Conner Seepersad
Katja Hölttä-Otto
author_sort Trina C. Kershaw
title A Decision Tree Based Methodology for Evaluating Creativity in Engineering Design
title_short A Decision Tree Based Methodology for Evaluating Creativity in Engineering Design
title_full A Decision Tree Based Methodology for Evaluating Creativity in Engineering Design
title_fullStr A Decision Tree Based Methodology for Evaluating Creativity in Engineering Design
title_full_unstemmed A Decision Tree Based Methodology for Evaluating Creativity in Engineering Design
title_sort decision tree based methodology for evaluating creativity in engineering design
publisher Frontiers Media S.A.
series Frontiers in Psychology
issn 1664-1078
publishDate 2019-01-01
description Multiple metrics have been proposed to measure the creativity of products, yet there is still a need for effective, reliable methods to assess the originality of new product designs. In the present article we introduce a method to assess the originality of concepts that are produced during idea generation activities within engineering design. This originality scoring method uses a decision tree that is centered around distinguishing design innovations at the system level. We describe the history and the development of our originality scoring method, and provide evidence of its reliability and validity. A full protocol is provided, including training procedures for coders and multiple examples of coded concepts that received different originality scores. We summarize data from over 500 concepts for garbage collection systems that were scored by Kershaw et al. (2015). We then show how the originality scoring method can be applied to a different design problem. Our originality scoring method, the Decision Tree for Originality Assessment in Design (DTOAD), has been a useful tool to identify differences in originality between various cohorts of Mechanical Engineering students. The DTOAD reveals cross-sectional differences in creativity between beginning and advanced students, and shows longitudinal growth in creativity from the beginning to the end of the undergraduate career, thus showing how creativity can be influenced by the curriculum. The DTOAD can be applied to concepts produced using different ideation procedures, including concepts produced both with and without a baseline example product, and concepts produced when individuals are primed to think of different users for their designs. Finally, we show how our the DTOAD compares to other measurements of creativity, such as novelty, fixation, and remoteness of association.
topic creativity
engineering design
decision tree
creative products
creativity measurement
creativity metrics
url https://www.frontiersin.org/article/10.3389/fpsyg.2019.00032/full
work_keys_str_mv AT trinackershaw adecisiontreebasedmethodologyforevaluatingcreativityinengineeringdesign
AT sankhabhowmick adecisiontreebasedmethodologyforevaluatingcreativityinengineeringdesign
AT carolynconnerseepersad adecisiontreebasedmethodologyforevaluatingcreativityinengineeringdesign
AT katjaholttaotto adecisiontreebasedmethodologyforevaluatingcreativityinengineeringdesign
AT trinackershaw decisiontreebasedmethodologyforevaluatingcreativityinengineeringdesign
AT sankhabhowmick decisiontreebasedmethodologyforevaluatingcreativityinengineeringdesign
AT carolynconnerseepersad decisiontreebasedmethodologyforevaluatingcreativityinengineeringdesign
AT katjaholttaotto decisiontreebasedmethodologyforevaluatingcreativityinengineeringdesign
_version_ 1725833374147280896