The Toolkit consist of a wearable fibre-optic sensing system for 3D-human motion capturing in combination with advanced activity and process mining capabilities.
As enabling technologies, the toolkit hardware and software components will provide the means for offering safer human-machine interaction, while maintaining enhanced collaboration levels. Moreover, the appliance of fundamental ergonomic principles (e.g. body postures) is pursued during the execution of process-related tasks, through real-time activity recognition and classification mechanisms.
Fiber-optic Sensing System
An innovative fiber-optic sensing system will be further developed and integrated into worker clothes in order to capture the human pose and motions. Shape reconstruction algorithms allow to reconstruct the shapes of the fibers. These sensors will be combinded with further sensors, e.g. intertial measuring units, to improve the overall measurement quality.
Beside the sensing components, futher electical parts, e.g. power supply, and innovative input/output parts like capacitive buttons, flexible display or light elements can be integrated into smart textiles as part of the worker clothes.
Activity and Process Mining
Using intelligent data and process mining algorithms process-related human and robot activies can be recognized and classified in real-time. Based on the data from the fiber-optical sensor system and other sensors.
The shape reconstructions will help to automatically collect data about the workplace ergonomics, e.g. angle and duration of wrist bendings. These data can be used to automatically generate ergonomic evaluations like Occupational Risk Assessment of Repetitive Movements and Exertions of the Upper Limb (OCRA).
Using meachine learning algorithms, it is possible to detect, classify and predict specific activity patterns. This enables further analysis of collaborative assembly processes and a better synchronization between human and robots.
The developed AI-based toolkit for enhancing human-robot interaction in industry 4.0 will be used and evaluated in different use cases in the Whirlpool refrigeration and microwave factory such as big parts handling or complex wireing. The use cases will be described soon.
Use Case 1
Door assembly in the refrigeration factory
Use Case 2
Drum machine unloading in the refrigeration factory
Use Case 3
Transformer assembly in the microwave factory
Use Case 4
Other workplace in the microwave factory
BIBA – Bremer Institut für Produktion und Logistik GmbH is an engineering research institute developing technical and organizational solutions for production and logistics in close cooperation with industry.Read More
Whirlpool Corporation is the world’s leading global manufacturer and marketer of major home appliances. In Europe, Whirlpool EMEA SpA has a sales presence in over 30 countries and an extremely articulated footprint.Read More
Pumacy Technologies AG is a specialist when it comes to the knowledge in companies, processes, innovations and ideas. Pumacy provides software tools for data analytics as well as activity and process mining.Read More