---
_id: '13334'
abstract:
- lang: eng
  text: Retrieval-augmented generation (RAG) based on large language models (LLMs)
    has established itself as a key technology for combining domain-specific information
    with generative language skills, thereby providing transparent, up-to-date information.
    Many firms are already piloting such LLM-based information systems, but report
    a high degree of complexity in planning and implementation. A generally accepted
    regulatory framework that consistently maps key decisions is not yet available
    to companies. This article therefore presents a multi-level system that organizes
    design decisions throughout the configuration process. This framework is intended
    to support users in the planning, realizing, evaluation, and further development
    of an LLM-based information system. To achieve this goal, a qualitative-empirical
    research design was chosen. First, publications from the period 2022 to 2025 were
    identified and selected using a systematic literature search in accordance with
    the PRISMA guideline. The selected publications were then evaluated using a qualitative
    content analysis. The result is a system that was reviewed, revised and finalized
    at an expert workshop.
author:
- first_name: Dominik
  full_name: Ullrich, Dominik
  id: '85823'
  last_name: Ullrich
- first_name: Jens
  full_name: Wallys, Jens
  id: '79046'
  last_name: Wallys
- first_name: Sven
  full_name: Hinrichsen, Sven
  id: '49010'
  last_name: Hinrichsen
citation:
  ama: Ullrich D, Wallys J, Hinrichsen S. <i>Conceptual Framework for Designing Domain-Specific
    LLM-Based Information Systems</i>. Vol 200. (Ahram T, Karwowski W, Giraldi  L,
    Benelli  E, AHFE Open Access, eds.). AHFE International; 2026:63-73. doi:<a href="https://doi.org/10.54941/ahfe1007065">10.54941/ahfe1007065</a>
  apa: 'Ullrich, D., Wallys, J., &#38; Hinrichsen, S. (2026). Conceptual Framework
    for Designing Domain-Specific LLM-Based Information Systems. In T. Ahram, W. Karwowski,
    L. Giraldi , E. Benelli , &#38; AHFE Open Access (Eds.), <i>Intelligent Human
    Systems Integration (IHSI 2026): Disruptive and Innovative Technologies</i> (Vol.
    200, pp. 63–73). AHFE International. <a href="https://doi.org/10.54941/ahfe1007065">https://doi.org/10.54941/ahfe1007065</a>'
  bjps: '<b>Ullrich D, Wallys J and Hinrichsen S</b> (2026) <i>Conceptual Framework
    for Designing Domain-Specific LLM-Based Information Systems</i>, Ahram T et al.
    (eds). USA: AHFE International.'
  chicago: 'Ullrich, Dominik, Jens Wallys, and Sven Hinrichsen. <i>Conceptual Framework
    for Designing Domain-Specific LLM-Based Information Systems</i>. Edited by Tareq
    Ahram, Waldemar Karwowski, Laura Giraldi , Elisabetta Benelli , and AHFE Open
    Access. <i>Intelligent Human Systems Integration (IHSI 2026): Disruptive and Innovative
    Technologies</i>. Vol. 200. AHFE International. USA: AHFE International, 2026.
    <a href="https://doi.org/10.54941/ahfe1007065">https://doi.org/10.54941/ahfe1007065</a>.'
  chicago-de: 'Ullrich, Dominik, Jens Wallys und Sven Hinrichsen. 2026. <i>Conceptual
    Framework for Designing Domain-Specific LLM-Based Information Systems</i>. Hg.
    von Tareq Ahram, Waldemar Karwowski, Laura Giraldi , Elisabetta Benelli , und
    AHFE Open Access. <i>Intelligent Human Systems Integration (IHSI 2026): Disruptive
    and Innovative Technologies</i>. Bd. 200. AHFE International. USA: AHFE International.
    doi:<a href="https://doi.org/10.54941/ahfe1007065">10.54941/ahfe1007065</a>, .'
  din1505-2-1: '<span style="font-variant:small-caps;">Ullrich, Dominik</span> ; <span
    style="font-variant:small-caps;">Wallys, Jens</span> ; <span style="font-variant:small-caps;">Hinrichsen,
    Sven</span> ; <span style="font-variant:small-caps;">Ahram, T.</span> ; <span
    style="font-variant:small-caps;">Karwowski, W.</span> ; <span style="font-variant:small-caps;">Giraldi
    , L.</span> ; <span style="font-variant:small-caps;">Benelli , E.</span> ; <span
    style="font-variant:small-caps;">AHFE Open Access</span> (Hrsg.): <i>Conceptual
    Framework for Designing Domain-Specific LLM-Based Information Systems</i>, <i>AHFE
    International</i>. Bd. 200. USA : AHFE International, 2026'
  havard: D. Ullrich, J. Wallys, S. Hinrichsen, Conceptual Framework for Designing
    Domain-Specific LLM-Based Information Systems, AHFE International, USA, 2026.
  ieee: 'D. Ullrich, J. Wallys, and S. Hinrichsen, <i>Conceptual Framework for Designing
    Domain-Specific LLM-Based Information Systems</i>, vol. 200. USA: AHFE International,
    2026, pp. 63–73. doi: <a href="https://doi.org/10.54941/ahfe1007065">10.54941/ahfe1007065</a>.'
  mla: 'Ullrich, Dominik, et al. “Conceptual Framework for Designing Domain-Specific
    LLM-Based Information Systems.” <i>Intelligent Human Systems Integration (IHSI
    2026): Disruptive and Innovative Technologies</i>, edited by Tareq Ahram et al.,
    vol. 200, AHFE International, 2026, pp. 63–73, <a href="https://doi.org/10.54941/ahfe1007065">https://doi.org/10.54941/ahfe1007065</a>.'
  short: D. Ullrich, J. Wallys, S. Hinrichsen, Conceptual Framework for Designing
    Domain-Specific LLM-Based Information Systems, AHFE International, USA, 2026.
  ufg: '<b>Ullrich, Dominik/Wallys, Jens/Hinrichsen, Sven</b>: Conceptual Framework
    for Designing Domain-Specific LLM-Based Information Systems, Bd. 200, hg. von
    Ahram, Tareq u. a., USA 2026 (AHFE International).'
  van: 'Ullrich D, Wallys J, Hinrichsen S. Conceptual Framework for Designing Domain-Specific
    LLM-Based Information Systems. Ahram T, Karwowski W, Giraldi  L, Benelli  E, AHFE
    Open Access, editors. Intelligent Human Systems Integration (IHSI 2026): Disruptive
    and Innovative Technologies. USA: AHFE International; 2026. (AHFE International;
    vol. 200).'
conference:
  end_date: 2026-02-13
  location: Florence
  name: '9th Intelligent Human Systems Integration (IHSI 2026): Disruptive and Innovative
    Technologies'
  start_date: 2026-02-11
corporate_editor:
- AHFE Open Access
date_created: 2026-01-09T07:27:32Z
date_updated: 2026-01-12T09:36:40Z
department:
- _id: DEP7020
- _id: DEP1305
- _id: DEP7000
doi: 10.54941/ahfe1007065
editor:
- first_name: Tareq
  full_name: Ahram, Tareq
  last_name: Ahram
- first_name: Waldemar
  full_name: Karwowski, Waldemar
  last_name: Karwowski
- first_name: Laura
  full_name: Giraldi , Laura
  last_name: 'Giraldi '
- first_name: Elisabetta
  full_name: Benelli , Elisabetta
  last_name: 'Benelli '
intvolume: '       200'
keyword:
- Retrieval-Augmented Generation
- LLM-Based Information System
- Conceptual Framework
language:
- iso: eng
page: 63-73
place: USA
publication: 'Intelligent Human Systems Integration (IHSI 2026): Disruptive and Innovative
  Technologies'
publication_identifier:
  isbn:
  - 978-1-964867-76-2
  issn:
  - 2771-0718
publication_status: published
publisher: AHFE International
quality_controlled: '1'
series_title: AHFE International
status: public
title: Conceptual Framework for Designing Domain-Specific LLM-Based Information Systems
type: conference_editor_article
user_id: '83781'
volume: 200
year: '2026'
...
---
_id: '13293'
abstract:
- lang: eng
  text: The performance of large language models (LLMs) has improved significantly
    in recent years, with the result that they are now used in many companies in various
    industries. However, the design of a company-specific information system involving
    an LLM is associated with a large number of decisions. This leads to a high level
    of complexity in the design task. Against this background, companies need a structured
    approach that methodically supports the planning, development, implementation
    and long-term maintenance of LLM-based information systems so that domain- and
    company-specific requirements are taken into account as a result. This article
    therefore describes a method that supports the design, introduction and maintenance
    process of an LLM-based information system. The method consists of a process model
    and a list of design principles, which are also referred to as success factors.
    The process model developed is based on the proven six-stage REFA planning system.
    To identify and describe success factors, a systematic literature search was carried
    out. Based on an analysis of the contents of individual literature sources, success
    factors for the design of LLM-based information systems were identified. These
    success factors relate, for example, to the quality of the data provided, data
    security, user-centered system design and feedback mechanisms for improving information
    output.
author:
- first_name: Sven
  full_name: Hinrichsen, Sven
  id: '49010'
  last_name: Hinrichsen
- first_name: Robin
  full_name: Herbort, Robin
  id: '70575'
  last_name: Herbort
- first_name: Dominik
  full_name: Green, Dominik
  id: '85489'
  last_name: Green
- first_name: Benjamin
  full_name: Adrian, Benjamin
  id: '42266'
  last_name: Adrian
citation:
  ama: Hinrichsen S, Herbort R, Green D, Adrian B. <i>How to Design an Operation-Specific
    LLM-Based Information System</i>. Vol 197. (Ahram T, Motschnig R, eds.). AHFE;
    2025. doi:<a href="https://doi.org/10.54941/ahfe1006709">10.54941/ahfe1006709</a>
  apa: Hinrichsen, S., Herbort, R., Green, D., &#38; Adrian, B. (2025). How to Design
    an Operation-Specific LLM-Based Information System. In T. Ahram &#38; R. Motschnig
    (Eds.), <i>Human Interaction and Emerging Technologies (IHIET 2025)</i> (Vol.
    197). AHFE. <a href="https://doi.org/10.54941/ahfe1006709">https://doi.org/10.54941/ahfe1006709</a>
  bjps: '<b>Hinrichsen S <i>et al.</i></b> (2025) <i>How to Design an Operation-Specific
    LLM-Based Information System</i>, Ahram T and Motschnig R (eds). New York, NY:
    AHFE.'
  chicago: 'Hinrichsen, Sven, Robin Herbort, Dominik Green, and Benjamin Adrian. <i>How
    to Design an Operation-Specific LLM-Based Information System</i>. Edited by Tareq
    Ahram and Renate  Motschnig. <i>Human Interaction and Emerging Technologies (IHIET
    2025)</i>. Vol. 197. AHFE International. New York, NY: AHFE, 2025. <a href="https://doi.org/10.54941/ahfe1006709">https://doi.org/10.54941/ahfe1006709</a>.'
  chicago-de: 'Hinrichsen, Sven, Robin Herbort, Dominik Green und Benjamin Adrian.
    2025. <i>How to Design an Operation-Specific LLM-Based Information System</i>.
    Hg. von Tareq Ahram und Renate  Motschnig. <i>Human Interaction and Emerging Technologies
    (IHIET 2025)</i>. Bd. 197. AHFE International. New York, NY: AHFE. doi:<a href="https://doi.org/10.54941/ahfe1006709">10.54941/ahfe1006709</a>,
    .'
  din1505-2-1: '<span style="font-variant:small-caps;">Hinrichsen, Sven</span> ; <span
    style="font-variant:small-caps;">Herbort, Robin</span> ; <span style="font-variant:small-caps;">Green,
    Dominik</span> ; <span style="font-variant:small-caps;">Adrian, Benjamin</span>
    ; <span style="font-variant:small-caps;">Ahram, T.</span> ; <span style="font-variant:small-caps;">Motschnig,
    R.</span> (Hrsg.): <i>How to Design an Operation-Specific LLM-Based Information
    System</i>, <i>AHFE International</i>. Bd. 197. New York, NY : AHFE, 2025'
  havard: S. Hinrichsen, R. Herbort, D. Green, B. Adrian, How to Design an Operation-Specific
    LLM-Based Information System, AHFE, New York, NY, 2025.
  ieee: 'S. Hinrichsen, R. Herbort, D. Green, and B. Adrian, <i>How to Design an Operation-Specific
    LLM-Based Information System</i>, vol. 197. New York, NY: AHFE, 2025. doi: <a
    href="https://doi.org/10.54941/ahfe1006709">10.54941/ahfe1006709</a>.'
  mla: Hinrichsen, Sven, et al. “How to Design an Operation-Specific LLM-Based Information
    System.” <i>Human Interaction and Emerging Technologies (IHIET 2025)</i>, edited
    by Tareq Ahram and Renate  Motschnig, vol. 197, AHFE, 2025, <a href="https://doi.org/10.54941/ahfe1006709">https://doi.org/10.54941/ahfe1006709</a>.
  short: S. Hinrichsen, R. Herbort, D. Green, B. Adrian, How to Design an Operation-Specific
    LLM-Based Information System, AHFE, New York, NY, 2025.
  ufg: '<b>Hinrichsen, Sven u. a.</b>: How to Design an Operation-Specific LLM-Based
    Information System, Bd. 197, hg. von Ahram, Tareq/Motschnig, Renate, New York,
    NY 2025 (AHFE International).'
  van: 'Hinrichsen S, Herbort R, Green D, Adrian B. How to Design an Operation-Specific
    LLM-Based Information System. Ahram T, Motschnig R, editors. Human Interaction
    and Emerging Technologies (IHIET 2025). New York, NY: AHFE; 2025. (AHFE International;
    vol. 197).'
conference:
  end_date: 2025-08-27
  location: Vienna
  name: Human Interaction and Emerging Technologies (IHIET 2025)
  start_date: 2025-08-25
date_created: 2025-11-10T16:18:06Z
date_updated: 2025-11-24T08:29:46Z
department:
- _id: DEP7020
- _id: DEP1305
doi: 10.54941/ahfe1006709
editor:
- first_name: Tareq
  full_name: Ahram, Tareq
  last_name: Ahram
- first_name: 'Renate '
  full_name: 'Motschnig, Renate '
  last_name: Motschnig
intvolume: '       197'
keyword:
- Large language model
- Information system
- Retrieval augmented generation
language:
- iso: eng
main_file_link:
- open_access: '1'
  url: http://doi.org/10.54941/ahfe1006709
oa: '1'
place: New York, NY
publication: Human Interaction and Emerging Technologies (IHIET 2025)
publication_identifier:
  isbn:
  - 978-1-964867-73-1
  issn:
  - 2771-0718
publication_status: published
publisher: AHFE
quality_controlled: '1'
series_title: AHFE International
status: public
title: How to Design an Operation-Specific LLM-Based Information System
type: conference_editor_article
user_id: '83781'
volume: 197
year: '2025'
...
---
_id: '4897'
abstract:
- lang: eng
  text: Assistance is becoming increasingly relevant in carrying out industrial work
    in the context of cyber-physical production systems (CPPSs) and Industry 4.0.
    While assistance in a single task via a single interaction modality has been explored
    previously, crossdevice interaction could improve the quality of assistance, especially
    given the concurrent and distributed nature of work in CPPSs. In this paper, we
    present the theoretical foundations and implementation of MiWSICx (Middleware
    for Work Support in Industrial Contexts), a middleware that showcases how multiple
    interactive computing devices such as tablets, smartphones, augmented/virtual
    reality glasses, and wearables could be combined to provide crossdevice industrial
    assistance. Based on activity theory, MiWSICx models human work as activities
    combining multiple users, artifacts, and cyber-physical objects. MiWSICx is developed
    using the actor model for deployment on a variety of hardware alongside a CPPS
    to provide multiuser, crossdevice, multiactivity assistance.
author:
- first_name: Hitesh
  full_name: Dhiman, Hitesh
  id: '71767'
  last_name: Dhiman
- first_name: Carsten
  full_name: Röcker, Carsten
  id: '61525'
  last_name: Röcker
citation:
  ama: Dhiman H, Röcker C. Middleware for providing activity-driven assistance in
    cyber-physical production systems. <i>Journal of Computational Design and Engineering</i>.
    2021;8(1):428-451. doi:<a href="https://doi.org/10.1093/jcde/qwaa088">10.1093/jcde/qwaa088</a>
  apa: Dhiman, H., &#38; Röcker, C. (2021). Middleware for providing activity-driven
    assistance in cyber-physical production systems. <i>Journal of Computational Design
    and Engineering</i>, <i>8</i>(1), 428–451. <a href="https://doi.org/10.1093/jcde/qwaa088">https://doi.org/10.1093/jcde/qwaa088</a>
  bjps: <b>Dhiman H and Röcker C</b> (2021) Middleware for Providing Activity-Driven
    Assistance in Cyber-Physical Production Systems. <i>Journal of Computational Design
    and Engineering</i> <b>8</b>, 428–451.
  chicago: 'Dhiman, Hitesh, and Carsten Röcker. “Middleware for Providing Activity-Driven
    Assistance in Cyber-Physical Production Systems.” <i>Journal of Computational
    Design and Engineering</i> 8, no. 1 (2021): 428–51. <a href="https://doi.org/10.1093/jcde/qwaa088">https://doi.org/10.1093/jcde/qwaa088</a>.'
  chicago-de: 'Dhiman, Hitesh und Carsten Röcker. 2021. Middleware for providing activity-driven
    assistance in cyber-physical production systems. <i>Journal of Computational Design
    and Engineering</i> 8, Nr. 1: 428–451. doi:<a href="https://doi.org/10.1093/jcde/qwaa088,">10.1093/jcde/qwaa088,</a>
    .'
  din1505-2-1: '<span style="font-variant:small-caps;">Dhiman, Hitesh</span> ; <span
    style="font-variant:small-caps;">Röcker, Carsten</span>: Middleware for providing
    activity-driven assistance in cyber-physical production systems. In: <i>Journal
    of Computational Design and Engineering</i> Bd. 8. Oxford, Oxford University Press
    (2021), Nr. 1, S. 428–451'
  havard: H. Dhiman, C. Röcker, Middleware for providing activity-driven assistance
    in cyber-physical production systems, Journal of Computational Design and Engineering.
    8 (2021) 428–451.
  ieee: H. Dhiman and C. Röcker, “Middleware for providing activity-driven assistance
    in cyber-physical production systems,” <i>Journal of Computational Design and
    Engineering</i>, vol. 8, no. 1, pp. 428–451, 2021.
  mla: Dhiman, Hitesh, and Carsten Röcker. “Middleware for Providing Activity-Driven
    Assistance in Cyber-Physical Production Systems.” <i>Journal of Computational
    Design and Engineering</i>, vol. 8, no. 1, Oxford University Press, 2021, pp.
    428–51, doi:<a href="https://doi.org/10.1093/jcde/qwaa088">10.1093/jcde/qwaa088</a>.
  short: H. Dhiman, C. Röcker, Journal of Computational Design and Engineering 8 (2021)
    428–451.
  ufg: '<b>Dhiman, Hitesh/Röcker, Carsten (2021)</b>: Middleware for providing activity-driven
    assistance in cyber-physical production systems, in: <i>Journal of Computational
    Design and Engineering</i> <i>8</i> (<i>1</i>), S. 428–451.'
  van: Dhiman H, Röcker C. Middleware for providing activity-driven assistance in
    cyber-physical production systems. Journal of Computational Design and Engineering.
    2021;8(1):428–51.
date_created: 2021-02-04T15:20:11Z
date_updated: 2023-03-15T13:49:56Z
department:
- _id: DEP5023
- _id: DEP5027
doi: 10.1093/jcde/qwaa088
intvolume: '         8'
issue: '1'
keyword:
- human–technology interaction
- human–computer interaction
- crossdevice interaction
- cyber-physical systems
- assistance
- smart factory
- middleware
- actor model
- information system design
- industry 4.0
language:
- iso: eng
page: 428-451
place: Oxford
publication: Journal of Computational Design and Engineering
publication_identifier:
  eissn:
  - '2288-4300 '
publication_status: published
publisher: Oxford University Press
status: public
title: Middleware for providing activity-driven assistance in cyber-physical production
  systems
type: journal_article
user_id: '15514'
volume: 8
year: 2021
...