---
_id: '4094'
abstract:
- lang: eng
text: Projection-based assitive systems that guide users through assembly work are
on their way to industrial application. Previous research work investigated how
people can be supported with such systems. However, there has been little work
on the question on how to generate and author sequential instructions for assitive
systems. In this paper, we present a new concept and a prototypical implementation
of an assitive system that can be taught by demonstrating an assembly process.
By using a combination of RGB and depth cameras, we can generate an assembly instruction
of Lego Duplo bricks based on the demonstration of a user. This generated manual
can later on be used for assisting other users in the assembly process. By our
prototype system, we show the technological feasibility of assistive systems that
can learn from users.
author:
- first_name: Sebastian
full_name: Büttner, Sebastian
id: '61868'
last_name: Büttner
- first_name: Andreas
full_name: Peda, Andreas
id: '51144'
last_name: Peda
- first_name: Mario
full_name: Heinz, Mario
id: '68913'
last_name: Heinz
- first_name: Carsten
full_name: Röcker, Carsten
id: '61525'
last_name: Röcker
citation:
ama: 'Büttner S, Peda A, Heinz M, Röcker C. Teaching by Demonstrating – How Smart
Assistive Systems Can Learn from Users. In: 22nd International Conference on
Human-Computer Interaction. Vol 12203. Lecture Notes in Computer Science.
Springer; 2020:153-163. doi:https://doi.org/10.1007/978-3-030-50344-4_12'
apa: Büttner, S., Peda, A., Heinz, M., & Röcker, C. (2020). Teaching by Demonstrating
– How Smart Assistive Systems Can Learn from Users. 22nd International Conference
on Human-Computer Interaction, 12203, 153–163. https://doi.org/10.1007/978-3-030-50344-4_12
bjps: 'Büttner S et al. (2020) Teaching by Demonstrating – How Smart
Assistive Systems Can Learn from Users. 22nd International Conference on Human-Computer
Interaction, vol. 12203. Berlin: Springer, pp. 153–163.'
chicago: 'Büttner, Sebastian, Andreas Peda, Mario Heinz, and Carsten Röcker. “Teaching
by Demonstrating – How Smart Assistive Systems Can Learn from Users.” In 22nd
International Conference on Human-Computer Interaction, 12203:153–63. Lecture
Notes in Computer Science. Berlin: Springer, 2020. https://doi.org/10.1007/978-3-030-50344-4_12.'
chicago-de: 'Büttner, Sebastian, Andreas Peda, Mario Heinz und Carsten Röcker. 2020.
Teaching by Demonstrating – How Smart Assistive Systems Can Learn from Users.
In: 22nd International Conference on Human-Computer Interaction, 12203:153–163.
Lecture Notes in Computer Science. Berlin: Springer. doi:https://doi.org/10.1007/978-3-030-50344-4_12,
.'
din1505-2-1: 'Büttner, Sebastian ;
Peda, Andreas ; Heinz,
Mario ; Röcker, Carsten:
Teaching by Demonstrating – How Smart Assistive Systems Can Learn from Users.
In: 22nd International Conference on Human-Computer Interaction, Lecture
Notes in Computer Science. Bd. 12203. Berlin : Springer, 2020, S. 153–163'
havard: 'S. Büttner, A. Peda, M. Heinz, C. Röcker, Teaching by Demonstrating – How
Smart Assistive Systems Can Learn from Users, in: 22nd International Conference
on Human-Computer Interaction, Springer, Berlin, 2020: pp. 153–163.'
ieee: 'S. Büttner, A. Peda, M. Heinz, and C. Röcker, “Teaching by Demonstrating
– How Smart Assistive Systems Can Learn from Users,” in 22nd International
Conference on Human-Computer Interaction, Copenhagen, Denmark, 2020, vol.
12203, pp. 153–163. doi: https://doi.org/10.1007/978-3-030-50344-4_12.'
mla: Büttner, Sebastian, et al. “Teaching by Demonstrating – How Smart Assistive
Systems Can Learn from Users.” 22nd International Conference on Human-Computer
Interaction, vol. 12203, Springer, 2020, pp. 153–63, https://doi.org/10.1007/978-3-030-50344-4_12.
short: 'S. Büttner, A. Peda, M. Heinz, C. Röcker, in: 22nd International Conference
on Human-Computer Interaction, Springer, Berlin, 2020, pp. 153–163.'
ufg: 'Büttner, Sebastian u. a.: Teaching by Demonstrating – How Smart Assistive
Systems Can Learn from Users, in: o. Hg.: 22nd International Conference on Human-Computer
Interaction, Bd. 12203, Berlin 2020 (Lecture Notes in Computer Science), S. 153–163.'
van: 'Büttner S, Peda A, Heinz M, Röcker C. Teaching by Demonstrating – How Smart
Assistive Systems Can Learn from Users. In: 22nd International Conference on Human-Computer
Interaction. Berlin: Springer; 2020. p. 153–63. (Lecture Notes in Computer Science;
vol. 12203).'
conference:
end_date: 2020-07-24
location: Copenhagen, Denmark
name: 22nd International Conference on Human-Computer Interaction
start_date: 2020-07-19
date_created: 2020-11-26T14:10:00Z
date_updated: 2025-06-26T08:59:53Z
department:
- _id: DEP5023
doi: https://doi.org/10.1007/978-3-030-50344-4_12
intvolume: ' 12203'
keyword:
- Assitive system
- Authoring
- Instruction generation
- Computer vision
- Teaching by demonstration
language:
- iso: eng
main_file_link:
- open_access: '1'
url: https://link.springer.com/chapter/10.1007/978-3-030-50344-4_12
oa: '1'
page: 153-163
place: Berlin
publication: 22nd International Conference on Human-Computer Interaction
publication_identifier:
eisbn:
- 978-3-030-50344-4
isbn:
- 978-3-030-50343-7
publication_status: published
publisher: Springer
series_title: Lecture Notes in Computer Science
status: public
title: Teaching by Demonstrating – How Smart Assistive Systems Can Learn from Users
type: conference
user_id: '83781'
volume: 12203
year: '2020'
...
---
_id: '4096'
abstract:
- lang: eng
text: Projection-based assistive systems have shown to be a promising technology
to support workers during manual assembly processes in industrial manufacturing
by projecting instructions into the working area. While existing studies have
investigated various aspects of these systems, little research has been conducted
regarding the way in which the user accesses the provided instructions. In this
paper we analyze the eye movements of users during the repeated execution of an
assembly task at a projection-based assistive system in order to gain insights
into the utilization of the presented instructions. For this purpose, we analyzed
eye tracking recordings from a user study with 15 participants to investigate
the sequences in which the respective instructions are observed by the users.
The results show a significantly lower number of nonlinear gaze sequences as well
as a significantly higher number of steps without observing the instructions during
the repeated use of the assistive system. In addition, there was a significantly
lower task completion time during repeated use of the assistive system.
author:
- first_name: Mario
full_name: Heinz, Mario
id: '68913'
last_name: Heinz
- first_name: Sebastian
full_name: Büttner, Sebastian
id: '61868'
last_name: Büttner
- first_name: Carsten
full_name: Röcker, Carsten
id: '61525'
last_name: Röcker
citation:
ama: 'Heinz M, Büttner S, Röcker C. Exploring Users’ Eye Movements When Using Projection-based
Assembly Assistive Systems. In: 22nd International Conference on Human-Computer
Interaction. Vol 12203. Lecture Notes in Computer Science. Springer; 2020:259-272.
doi:https://doi.org/10.1007/978-3-030-50344-4_19'
apa: Heinz, M., Büttner, S., & Röcker, C. (2020). Exploring Users’ Eye Movements
When Using Projection-based Assembly Assistive Systems. 22nd International
Conference on Human-Computer Interaction, 12203, 259–272. https://doi.org/10.1007/978-3-030-50344-4_19
bjps: 'Heinz M, Büttner S and Röcker C (2020) Exploring Users’ Eye Movements
When Using Projection-Based Assembly Assistive Systems. 22nd International
Conference on Human-Computer Interaction, vol. 12203. Berlin: Springer, pp.
259–272.'
chicago: 'Heinz, Mario, Sebastian Büttner, and Carsten Röcker. “Exploring Users’
Eye Movements When Using Projection-Based Assembly Assistive Systems.” In 22nd
International Conference on Human-Computer Interaction, 12203:259–72. Lecture
Notes in Computer Science. Berlin: Springer, 2020. https://doi.org/10.1007/978-3-030-50344-4_19.'
chicago-de: 'Heinz, Mario, Sebastian Büttner und Carsten Röcker. 2020. Exploring
Users’ Eye Movements When Using Projection-based Assembly Assistive Systems. In:
22nd International Conference on Human-Computer Interaction, 12203:259–272.
Lecture Notes in Computer Science. Berlin: Springer. doi:https://doi.org/10.1007/978-3-030-50344-4_19,
.'
din1505-2-1: 'Heinz, Mario ; Büttner, Sebastian ; Röcker,
Carsten: Exploring Users’ Eye Movements When Using Projection-based Assembly
Assistive Systems. In: 22nd International Conference on Human-Computer Interaction,
Lecture Notes in Computer Science. Bd. 12203. Berlin : Springer, 2020,
S. 259–272'
havard: 'M. Heinz, S. Büttner, C. Röcker, Exploring Users’ Eye Movements When Using
Projection-based Assembly Assistive Systems, in: 22nd International Conference
on Human-Computer Interaction, Springer, Berlin, 2020: pp. 259–272.'
ieee: 'M. Heinz, S. Büttner, and C. Röcker, “Exploring Users’ Eye Movements When
Using Projection-based Assembly Assistive Systems,” in 22nd International Conference
on Human-Computer Interaction, Copenhagen, Denmark, 2020, vol. 12203, pp.
259–272. doi: https://doi.org/10.1007/978-3-030-50344-4_19.'
mla: Heinz, Mario, et al. “Exploring Users’ Eye Movements When Using Projection-Based
Assembly Assistive Systems.” 22nd International Conference on Human-Computer
Interaction, vol. 12203, Springer, 2020, pp. 259–72, https://doi.org/10.1007/978-3-030-50344-4_19.
short: 'M. Heinz, S. Büttner, C. Röcker, in: 22nd International Conference on Human-Computer
Interaction, Springer, Berlin, 2020, pp. 259–272.'
ufg: 'Heinz, Mario/Büttner, Sebastian/Röcker, Carsten: Exploring Users’ Eye
Movements When Using Projection-based Assembly Assistive Systems, in: o. Hg.:
22nd International Conference on Human-Computer Interaction, Bd. 12203, Berlin
2020 (Lecture Notes in Computer Science), S. 259–272.'
van: 'Heinz M, Büttner S, Röcker C. Exploring Users’ Eye Movements When Using Projection-based
Assembly Assistive Systems. In: 22nd International Conference on Human-Computer
Interaction. Berlin: Springer; 2020. p. 259–72. (Lecture Notes in Computer Science;
vol. 12203).'
conference:
end_date: 2020-07-24
location: Copenhagen, Denmark
name: 22nd International Conference on Human-Computer Interaction
start_date: 2020-07-19
date_created: 2020-11-26T14:10:03Z
date_updated: 2025-06-26T08:59:34Z
department:
- _id: DEP5023
doi: https://doi.org/10.1007/978-3-030-50344-4_19
intvolume: ' 12203'
keyword:
- Assistive systems
- Eye tracking
- Human behavior
language:
- iso: eng
main_file_link:
- open_access: '1'
url: https://link.springer.com/chapter/10.1007/978-3-030-50344-4_19
oa: '1'
page: 259-272
place: Berlin
publication: 22nd International Conference on Human-Computer Interaction
publication_identifier:
eisbn:
- 978-3-030-50344-4
isbn:
- 978-3-030-50343-7
publication_status: published
publisher: Springer
series_title: Lecture Notes in Computer Science
status: public
title: Exploring Users' Eye Movements When Using Projection-based Assembly Assistive
Systems
type: conference
user_id: '83781'
volume: 12203
year: '2020'
...
---
_id: '4097'
abstract:
- lang: eng
text: The capabilities of object detection are well known, but many projects don’t
use them, despite potential benefit. Even though the use of object detection algorithms
is facilitated through frameworks and publications, a big issue is the creation
of the necessary training data. To tackle this issue, this work shows the design
and evaluation of a prototype, which allows users to create synthetic datasets
for object detection in images. The prototype is evaluated using YOLOv3 as the
underlying detector and shows that the generated datasets are equally good in
quality as manually created data. This encourages a wide adoption of object detection
algorithms in different areas, since image creation and labeling is often the
most time consuming step.
author:
- first_name: Andreas
full_name: Besginow, Andreas
id: '61743'
last_name: Besginow
- first_name: Sebastian
full_name: Büttner, Sebastian
id: '61868'
last_name: Büttner
- first_name: Carsten
full_name: Röcker, Carsten
id: '61525'
last_name: Röcker
citation:
ama: 'Besginow A, Büttner S, Röcker C. Making Object Detection Available to Everyone
- A Hardware Prototype for Semi-automatic Synthetic Data Generation. In: 22nd
International Conference on Human-Computer Interaction. Vol 12203. Lecture
Notes in Computer Science . Springer; 2020:178-192. doi:https://doi.org/10.1007/978-3-030-50344-4_14'
apa: Besginow, A., Büttner, S., & Röcker, C. (2020). Making Object Detection
Available to Everyone - A Hardware Prototype for Semi-automatic Synthetic Data
Generation. 22nd International Conference on Human-Computer Interaction,
12203, 178–192. https://doi.org/10.1007/978-3-030-50344-4_14
bjps: 'Besginow A, Büttner S and Röcker C (2020) Making Object Detection
Available to Everyone - A Hardware Prototype for Semi-Automatic Synthetic Data
Generation. 22nd International Conference on Human-Computer Interaction,
vol. 12203. Berlin: Springer, pp. 178–192.'
chicago: 'Besginow, Andreas, Sebastian Büttner, and Carsten Röcker. “Making Object
Detection Available to Everyone - A Hardware Prototype for Semi-Automatic Synthetic
Data Generation.” In 22nd International Conference on Human-Computer Interaction,
12203:178–92. Lecture Notes in Computer Science . Berlin: Springer, 2020. https://doi.org/10.1007/978-3-030-50344-4_14.'
chicago-de: 'Besginow, Andreas, Sebastian Büttner und Carsten Röcker. 2020. Making
Object Detection Available to Everyone - A Hardware Prototype for Semi-automatic
Synthetic Data Generation. In: 22nd International Conference on Human-Computer
Interaction, 12203:178–192. Lecture Notes in Computer Science . Berlin: Springer.
doi:https://doi.org/10.1007/978-3-030-50344-4_14,
.'
din1505-2-1: 'Besginow, Andreas ;
Büttner, Sebastian ; Röcker,
Carsten: Making Object Detection Available to Everyone - A Hardware Prototype
for Semi-automatic Synthetic Data Generation. In: 22nd International Conference
on Human-Computer Interaction, Lecture Notes in Computer Science .
Bd. 12203. Berlin : Springer, 2020, S. 178–192'
havard: 'A. Besginow, S. Büttner, C. Röcker, Making Object Detection Available to
Everyone - A Hardware Prototype for Semi-automatic Synthetic Data Generation,
in: 22nd International Conference on Human-Computer Interaction, Springer, Berlin,
2020: pp. 178–192.'
ieee: 'A. Besginow, S. Büttner, and C. Röcker, “Making Object Detection Available
to Everyone - A Hardware Prototype for Semi-automatic Synthetic Data Generation,”
in 22nd International Conference on Human-Computer Interaction, Copenhagen,
Denmark, 2020, vol. 12203, pp. 178–192. doi: https://doi.org/10.1007/978-3-030-50344-4_14.'
mla: Besginow, Andreas, et al. “Making Object Detection Available to Everyone -
A Hardware Prototype for Semi-Automatic Synthetic Data Generation.” 22nd International
Conference on Human-Computer Interaction, vol. 12203, Springer, 2020, pp.
178–92, https://doi.org/10.1007/978-3-030-50344-4_14.
short: 'A. Besginow, S. Büttner, C. Röcker, in: 22nd International Conference on
Human-Computer Interaction, Springer, Berlin, 2020, pp. 178–192.'
ufg: 'Besginow, Andreas/Büttner, Sebastian/Röcker, Carsten: Making Object
Detection Available to Everyone - A Hardware Prototype for Semi-automatic Synthetic
Data Generation, in: o. Hg.: 22nd International Conference on Human-Computer Interaction,
Bd. 12203, Berlin 2020 (Lecture Notes in Computer Science ), S. 178–192.'
van: 'Besginow A, Büttner S, Röcker C. Making Object Detection Available to Everyone
- A Hardware Prototype for Semi-automatic Synthetic Data Generation. In: 22nd
International Conference on Human-Computer Interaction. Berlin: Springer; 2020.
p. 178–92. (Lecture Notes in Computer Science ; vol. 12203).'
conference:
end_date: 2020-07-24
location: Copenhagen, Denmark
name: 22nd International Conference on Human-Computer Interaction
start_date: 2020-07-19
date_created: 2020-11-26T14:10:04Z
date_updated: 2025-06-26T13:28:35Z
department:
- _id: DEP5023
doi: https://doi.org/10.1007/978-3-030-50344-4_14
intvolume: ' 12203'
keyword:
- Object detection
- Synthetic datasets
- Machine learning
- Deep learning
language:
- iso: eng
main_file_link:
- open_access: '1'
url: https://link.springer.com/chapter/10.1007/978-3-030-50344-4_14
oa: '1'
page: 178-192
place: Berlin
publication: 22nd International Conference on Human-Computer Interaction
publication_identifier:
eisbn:
- 978-3-030-50344-4
isbn:
- 978-3-030-50343-7
publication_status: published
publisher: Springer
series_title: 'Lecture Notes in Computer Science '
status: public
title: Making Object Detection Available to Everyone - A Hardware Prototype for Semi-automatic
Synthetic Data Generation
type: conference
user_id: '83781'
volume: 12203
year: '2020'
...