Evaluating feedback mechanisms in the automatic creation of assembly instructions using retrieval-augmented generation

thesis Evaluating feedback mechanisms in the automatic creation of assembly instructions using retrieval-augmented generation published yes Julia Becker author Benjamin Adrian author 42266 Dominik Green author 85489 Sven Hinrichsen author 49010 DEP7020 department DEP1305 department In recent years, Retrieval Augmented Generation (RAG) has emerged as a promising technology for designing application-specific chatbots. RAG combines a Large Language Model (LLM) with application-specific information provided via a database. This opens up the possibility for companies to at least partially automate existing business processes using RAG. One use case relates to work preparation at a mechanical engineering company. Due to the high complexity of the products and the wide variety of variants, creating assembly instructions for individual assemblies and modules involves a considerable amount of administrative work. The use of RAG can help to significantly improve the efficiency of this process. However, a key challenge is to ensure high quality of automatically generated assembly instructions. While existing research has focused on feedback mechanisms for improving LLMs, the effectiveness of different prompt-based feedback types on RAG-generated technical documentation quality has not yet been sufficiently investigated. This article therefore explores how quality of assembly instructions can be improved by integrating feedback mechanisms into a RAG system. For this purpose, two different feedback mechanisms were used in a laboratory experiment. On the one hand, an exclusively quantitative feedback mechanism was used. On the other hand, quantitative and qualitative feedback were combined. The results demonstrate that feedback mechanisms contribute to improving quality of information in assembly instructions. In addition, it was found that exclusively quantitative feedback leads to similarly good results as more complex combined feedback. Elsevier BV2026 eng Procedia CIRP 2212-827110.1016/j.procir.2026.03.242 146243-248 Becker, Julia, et al. “Evaluating Feedback Mechanisms in the Automatic Creation of Assembly Instructions Using Retrieval-Augmented Generation.” Procedia CIRP, vol. 146, 2026, pp. 243–48, <a href="https://doi.org/10.1016/j.procir.2026.03.242">https://doi.org/10.1016/j.procir.2026.03.242</a>. Becker J, Adrian B, Green D, Hinrichsen S. Evaluating feedback mechanisms in the automatic creation of assembly instructions using retrieval-augmented generation. Procedia CIRP. 2026;146:243–8. J. Becker, B. Adrian, D. Green, S. Hinrichsen, Procedia CIRP 146 (2026) 243–248.

Becker, Julia, Benjamin Adrian, Dominik Green und Sven Hinrichsen. 2026. Evaluating feedback mechanisms in the automatic creation of assembly instructions using retrieval-augmented generation. Procedia CIRP 146: 243–248. doi:<a href="https://doi.org/10.1016/j.procir.2026.03.242">10.1016/j.procir.2026.03.242</a>, .

Becker, Julia u. a.: Evaluating feedback mechanisms in the automatic creation of assembly instructions using retrieval-augmented generation, in: Procedia CIRP 146 (2026), S. 243–248. J. Becker, B. Adrian, D. Green, and S. Hinrichsen, “Evaluating feedback mechanisms in the automatic creation of assembly instructions using retrieval-augmented generation,” Procedia CIRP, vol. 146, pp. 243–248, 2026, doi: <a href="https://doi.org/10.1016/j.procir.2026.03.242">10.1016/j.procir.2026.03.242</a>. Becker J et al. (2026) Evaluating Feedback Mechanisms in the Automatic Creation of Assembly Instructions Using Retrieval-Augmented Generation. Procedia CIRP 146, 243–248. Becker J, Adrian B, Green D, Hinrichsen S. Evaluating feedback mechanisms in the automatic creation of assembly instructions using retrieval-augmented generation. Procedia CIRP. 2026;146:243-248. doi:<a href="https://doi.org/10.1016/j.procir.2026.03.242">10.1016/j.procir.2026.03.242</a> Becker, Julia, Benjamin Adrian, Dominik Green, and Sven Hinrichsen. “Evaluating Feedback Mechanisms in the Automatic Creation of Assembly Instructions Using Retrieval-Augmented Generation.” Procedia CIRP 146 (2026): 243–48. <a href="https://doi.org/10.1016/j.procir.2026.03.242">https://doi.org/10.1016/j.procir.2026.03.242</a>. J. Becker, B. Adrian, D. Green, S. Hinrichsen, Evaluating feedback mechanisms in the automatic creation of assembly instructions using retrieval-augmented generation, Procedia CIRP. 146 (2026) 243–248.

Becker, Julia ; Adrian, Benjamin ; Green, Dominik ; Hinrichsen, Sven: Evaluating feedback mechanisms in the automatic creation of assembly instructions using retrieval-augmented generation. In: Procedia CIRP Bd. 146, Elsevier BV (2026), S. 243–248

Becker, J., Adrian, B., Green, D., & Hinrichsen, S. (2026). Evaluating feedback mechanisms in the automatic creation of assembly instructions using retrieval-augmented generation. Procedia CIRP, 146, 243–248. <a href="https://doi.org/10.1016/j.procir.2026.03.242">https://doi.org/10.1016/j.procir.2026.03.242</a> 140012026-09-04T15:04:12Z2026-09-04T15:07:36Z