Function in Engineering: Benchmarking Representations and Models
Year: 2013
Editor: Udo Lindemann, Srinivasan V, Yong Se Kim, Sang Won Lee, John Clarkson, Gaetano Cascini
Author: Summers, Joshua David; Eckert, Claudia; Goel, Ashok
Series: ICED
Institution: 1: Clemson University, United States of America; 2: Open University, UK; 3: Georgia Tech, USA
Page(s): 223-232
ISBN: 978-1-904670-45-2
ISSN: 2220-4334
Abstract
This paper presents the requirements and needs to establish a benchmarking protocol for systematic comparison of different function modeling representations. This benchmarking protocol includes representation characteristics, supported cognitive dimensions, and enabled reasoning activities. Problem types are also defined as: reverse engineering, familiar products, novel products, and single-component systems. It is recommended that researchers and developers of function modeling representations work together to define a canonically acceptable set of benchmark tests and evaluations so that clear benefits and weaknesses for the disparate collection of approaches can be compared. This paper is written as a call to action for the research community to begin to look at establishing a benchmarking standard protocol for function modeling comparison purposes. This protocol should be refined with input from developers of the competing approaches in an academically open environment.
Keywords: Function, function modeling, reasoning, representation