---
_id: '11330'
abstract:
- lang: eng
  text: With the increasing complexity in manual assembly and a demographic decline
    in skilled workforce, the importance of well-documented processes through assembly
    instructions has grown. Creating these instructions is a time-consuming and knowledge-intensive
    task that typically relies on experienced employees. Although various automation
    solutions have been proposed to assist in generating assembly instructions, they
    often fall short in providing detailed textual guidance. With the rise of generative
    artificial intelligence (AI), new potentials arise in this domain. Therefore,
    this paper explores these potentials by employing various large language models
    (LLMs), prompting techniques and input data in an experimental setup for generating
    detailed assembly instructions, including the planning of assembly sequences as
    well as textual guidance on tools, assembly activities, and quality assurance
    measures. The findings reveal promising opportunities in leveraging LLMs but also
    substantial challenges, particularly in assembly sequence planning. To improve
    the reliability of generating assembly instructions, we propose a multi-agent
    concept that decomposes the complex task into simpler subtasks, each managed by
    specialized agents.
author:
- first_name: Frederic
  full_name: Meyer, Frederic
  id: '70963'
  last_name: Meyer
- first_name: Lennart
  full_name: Freitag, Lennart
  id: '73431'
  last_name: Freitag
- first_name: Sven
  full_name: Hinrichsen, Sven
  id: '49010'
  last_name: Hinrichsen
- first_name: Oliver
  full_name: Niggemann, Oliver
  id: '10876'
  last_name: Niggemann
citation:
  ama: Meyer F, Freitag L, Hinrichsen S, Niggemann O. <i>Potentials of Large Language
    Models for Generating Assembly Instructions</i>. Vol 78. (IEEE, ed.). IEEE; 2024.
    doi:<a href="https://doi.org/10.1109/ETFA61755.2024.10710806">https://doi.org/10.1109/ETFA61755.2024.10710806</a>
  apa: Meyer, F., Freitag, L., Hinrichsen, S., &#38; Niggemann, O. (2024). Potentials
    of Large Language Models for Generating Assembly Instructions. In IEEE (Ed.),
    <i>2024 IEEE 29th International Conference on Emerging Technologies and Factory
    Automation (ETFA)</i> (Vol. 78). IEEE. <a href="https://doi.org/10.1109/ETFA61755.2024.10710806">https://doi.org/10.1109/ETFA61755.2024.10710806</a>
  bjps: '<b>Meyer F <i>et al.</i></b> (2024) <i>Potentials of Large Language Models
    for Generating Assembly Instructions</i>, IEEE (ed.). Piscataway, NJ: IEEE.'
  chicago: 'Meyer, Frederic, Lennart Freitag, Sven Hinrichsen, and Oliver Niggemann.
    <i>Potentials of Large Language Models for Generating Assembly Instructions</i>.
    Edited by IEEE. <i>2024 IEEE 29th International Conference on Emerging Technologies
    and Factory Automation (ETFA)</i>. Vol. 78. Piscataway, NJ: IEEE, 2024. <a href="https://doi.org/10.1109/ETFA61755.2024.10710806">https://doi.org/10.1109/ETFA61755.2024.10710806</a>.'
  chicago-de: 'Meyer, Frederic, Lennart Freitag, Sven Hinrichsen und Oliver Niggemann.
    2024. <i>Potentials of Large Language Models for Generating Assembly Instructions</i>.
    Hg. von IEEE. <i>2024 IEEE 29th International Conference on Emerging Technologies
    and Factory Automation (ETFA)</i>. Bd. 78. Piscataway, NJ: IEEE. doi:<a href="https://doi.org/10.1109/ETFA61755.2024.10710806">https://doi.org/10.1109/ETFA61755.2024.10710806</a>,
    .'
  din1505-2-1: '<span style="font-variant:small-caps;">Meyer, Frederic</span> ; <span
    style="font-variant:small-caps;">Freitag, Lennart</span> ; <span style="font-variant:small-caps;">Hinrichsen,
    Sven</span> ; <span style="font-variant:small-caps;">Niggemann, Oliver</span>
    ; <span style="font-variant:small-caps;">IEEE</span> (Hrsg.): <i>Potentials of
    Large Language Models for Generating Assembly Instructions</i>. Bd. 78. Piscataway,
    NJ : IEEE, 2024'
  havard: F. Meyer, L. Freitag, S. Hinrichsen, O. Niggemann, Potentials of Large Language
    Models for Generating Assembly Instructions, IEEE, Piscataway, NJ, 2024.
  ieee: 'F. Meyer, L. Freitag, S. Hinrichsen, and O. Niggemann, <i>Potentials of Large
    Language Models for Generating Assembly Instructions</i>, vol. 78. Piscataway,
    NJ: IEEE, 2024. doi: <a href="https://doi.org/10.1109/ETFA61755.2024.10710806">https://doi.org/10.1109/ETFA61755.2024.10710806</a>.'
  mla: Meyer, Frederic, et al. “Potentials of Large Language Models for Generating
    Assembly Instructions.” <i>2024 IEEE 29th International Conference on Emerging
    Technologies and Factory Automation (ETFA)</i>, edited by IEEE, vol. 78, IEEE,
    2024, <a href="https://doi.org/10.1109/ETFA61755.2024.10710806">https://doi.org/10.1109/ETFA61755.2024.10710806</a>.
  short: F. Meyer, L. Freitag, S. Hinrichsen, O. Niggemann, Potentials of Large Language
    Models for Generating Assembly Instructions, IEEE, Piscataway, NJ, 2024.
  ufg: '<b>Meyer, Frederic u. a.</b>: Potentials of Large Language Models for Generating
    Assembly Instructions, Bd. 78, hg. von IEEE, Piscataway, NJ 2024.'
  van: 'Meyer F, Freitag L, Hinrichsen S, Niggemann O. Potentials of Large Language
    Models for Generating Assembly Instructions. IEEE, editor. Vol. 78, 2024 IEEE
    29th International Conference on Emerging Technologies and Factory Automation
    (ETFA). Piscataway, NJ: IEEE; 2024.'
conference:
  end_date: 2024-09-13
  location: Padova, Italy
  name: 29th International Conference on Emerging Technologies and Factory Automation
    (ETFA)
  start_date: 2024-09-10
corporate_editor:
- IEEE
date_created: 2024-04-12T07:06:41Z
date_updated: 2024-10-22T07:28:35Z
department:
- _id: DEP7020
- _id: DEP1305
doi: https://doi.org/10.1109/ETFA61755.2024.10710806
intvolume: '        78'
keyword:
- assembly instruction
- GPT
- large language model
- LLM
- prompt
language:
- iso: eng
place: Piscataway, NJ
publication: 2024 IEEE 29th International Conference on Emerging Technologies and
  Factory Automation (ETFA)
publication_identifier:
  eisbn:
  - 979-8-3503-6122-3
  isbn:
  - 979-8-3503-6123-0
publication_status: published
publisher: IEEE
quality_controlled: '1'
status: public
title: Potentials of Large Language Models for Generating Assembly Instructions
type: conference_editor_article
user_id: '83781'
volume: 78
year: '2024'
...
---
_id: '12048'
abstract:
- lang: eng
  text: Interactive stories can be an effective approach for teaching purposes. One
    shortcoming is the effort necessary to author and create these stories, especially
    complex storylines with choices for the readers. Based on recent advances in Natural
    Language Processing (NLP), new opportunities arise for assistance systems in the
    context of interactive stories. In our work, we present an authoring approach
    and prototypical tool for the creation of visual comic-strip like interactive
    stories, a type of hypercomics, that integrate an Artificial Intelligence (AI)
    assistance. Such comics are already used in our Gekonnt hanDeln web platform.
    The AI assistance provides suggestions for the overall story outline as well as
    how to design and write individual story frames. We provide a detailed description
    about the approach and its prototypical implementation. Furthermore, we present
    a study evaluating the prototype with student groups and how the prototype evolved
    in an iterative style based on the students’ feedback.
author:
- first_name: Valentin
  full_name: Grimm, Valentin
  id: '74000'
  last_name: Grimm
- first_name: Jessica
  full_name: Rubart, Jessica
  id: '45672'
  last_name: Rubart
citation:
  ama: Grimm V, Rubart J. <i>Authoring Educational Hypercomics Assisted by Large Language
    Models</i>. Association for Computing Machinery (ACM); 2024:88-97. doi:<a href="https://doi.org/10.1145/3648188.3675124">10.1145/3648188.3675124</a>
  apa: 'Grimm, V., &#38; Rubart, J. (2024). Authoring Educational Hypercomics assisted
    by Large Language Models. In <i>HT ’24: Proceedings of the 35th ACM Conference
    on Hypertext and Social Media</i> (pp. 88–97). Association for Computing Machinery
    (ACM). <a href="https://doi.org/10.1145/3648188.3675124">https://doi.org/10.1145/3648188.3675124</a>'
  bjps: '<b>Grimm V and Rubart J</b> (2024) <i>Authoring Educational Hypercomics Assisted
    by Large Language Models</i>. New York, USA: Association for Computing Machinery
    (ACM).'
  chicago: 'Grimm, Valentin, and Jessica Rubart. <i>Authoring Educational Hypercomics
    Assisted by Large Language Models</i>. <i>HT ’24: Proceedings of the 35th ACM
    Conference on Hypertext and Social Media</i>. New York, USA: Association for Computing
    Machinery (ACM), 2024. <a href="https://doi.org/10.1145/3648188.3675124">https://doi.org/10.1145/3648188.3675124</a>.'
  chicago-de: 'Grimm, Valentin und Jessica Rubart. 2024. <i>Authoring Educational
    Hypercomics assisted by Large Language Models</i>. <i>HT ’24: Proceedings of the
    35th ACM Conference on Hypertext and Social Media</i>. New York, USA: Association
    for Computing Machinery (ACM). doi:<a href="https://doi.org/10.1145/3648188.3675124">10.1145/3648188.3675124</a>,
    .'
  din1505-2-1: '<span style="font-variant:small-caps;">Grimm, Valentin</span> ; <span
    style="font-variant:small-caps;">Rubart, Jessica</span>: <i>Authoring Educational
    Hypercomics assisted by Large Language Models</i>. New York, USA : Association
    for Computing Machinery (ACM), 2024'
  havard: V. Grimm, J. Rubart, Authoring Educational Hypercomics assisted by Large
    Language Models, Association for Computing Machinery (ACM), New York, USA, 2024.
  ieee: 'V. Grimm and J. Rubart, <i>Authoring Educational Hypercomics assisted by
    Large Language Models</i>. New York, USA: Association for Computing Machinery
    (ACM), 2024, pp. 88–97. doi: <a href="https://doi.org/10.1145/3648188.3675124">10.1145/3648188.3675124</a>.'
  mla: 'Grimm, Valentin, and Jessica Rubart. “Authoring Educational Hypercomics Assisted
    by Large Language Models.” <i>HT ’24: Proceedings of the 35th ACM Conference on
    Hypertext and Social Media</i>, Association for Computing Machinery (ACM), 2024,
    pp. 88–97, <a href="https://doi.org/10.1145/3648188.3675124">https://doi.org/10.1145/3648188.3675124</a>.'
  short: V. Grimm, J. Rubart, Authoring Educational Hypercomics Assisted by Large
    Language Models, Association for Computing Machinery (ACM), New York, USA, 2024.
  ufg: '<b>Grimm, Valentin/Rubart, Jessica</b>: Authoring Educational Hypercomics
    assisted by Large Language Models, New York, USA 2024.'
  van: 'Grimm V, Rubart J. Authoring Educational Hypercomics assisted by Large Language
    Models. HT ’24: Proceedings of the 35th ACM Conference on Hypertext and Social
    Media. New York, USA: Association for Computing Machinery (ACM); 2024.'
conference:
  end_date: 2024-09-13
  location: Poznan, Poland
  name: 35th ACM Conference on Hypertext and Social Media
  start_date: 2024-09-10
date_created: 2024-11-22T12:25:29Z
date_updated: 2025-06-25T13:06:37Z
department:
- _id: DEP8008
- _id: DEP8008
doi: 10.1145/3648188.3675124
keyword:
- Storytelling
- Authoring
- GPT
- Hypercomics
- Large Language Models
language:
- iso: eng
main_file_link:
- open_access: '1'
  url: https://dl.acm.org/doi/10.1145/3648188.3675124
oa: '1'
page: 88-97
place: New York, USA
publication: 'HT ''24: Proceedings of the 35th ACM Conference on Hypertext and Social
  Media'
publication_identifier:
  isbn:
  - '979-8-4007-0595-3 '
publication_status: published
publisher: Association for Computing Machinery (ACM)
quality_controlled: '1'
status: public
title: Authoring Educational Hypercomics assisted by Large Language Models
type: conference_editor_article
user_id: '83781'
year: '2024'
...