AI Object Detection of Parts in Engineering Drawings and a Concept of Integration in Engineering Education - AssistME
DS 130: Proceedings of NordDesign 2024, Reykjavik, Iceland, 12th - 14th August 2024
Year: 2024
Editor: Malmqvist, J.; Candi, M.; Saemundsson, R. J.; Bystrom, F. and Isaksson, O.
Author: Ant, Jan Lennart; Doksanbir, Abdullah; Dillenhofer, Fabian; Kunne, Bernd
Series: NordDESIGN
Institution: Technical University Dortmund, Germany
Page(s): 342-351
DOI number: 10.35199/NORDDESIGN2024.37
ISBN: 978-1-912254-21-7
Abstract
This article shows how AI and VR technology can be implemented into engineering design education. AI is used to recognize parts in engineering design drawings. The recognition task is done by the Scaled-YOLOv4 object detection algorithm. Implementing adjustments such as tiling and post-logic adjustments regarding the predictions, the detection quality can be improved up to a mAP value of 0.909. The detection of the AI can be transferred into a VR environment via a JSON file. It is shown that the developed AI model is capable of analyzing student’s individual solutions.
Keywords: Artificial Intelligence (AI), Design Education, Virtual Reality (VR), Engineering, Object Detection