A. Löcklin, M. Artelt, T. Ruppert, H. Vietz, N. Jazdi, and M. Weyrich, “Trajectory Prediction of Moving Workers for Autonomous Mobile Robots on the Shop Floor,” in 2022 IEEE 27th International Conference on Emerging Technologies and Factory Automation (ETFA), September 2022, 2022.
Abstract
In partially automated manufacturing, humans work together with mobile robots. Trajectory prediction, i.e. predicting future positions of human workers, improves collaboration and coexistence between humans and robots on the shop floor. In this paper, we discuss the interrelated research questions of how human motion trajectories can be predicted and how mobile robots such as Autonomous Mobile Robots and Automated Guided Vehicles can take such predictions into account in their pathfinding and navigation. On the robot side, advanced D* pathfinding algorithms allow robots to take dynamic obstacles into account. For trajectory prediction, the position of human workers is determined by an Ultra-Wideband-based Real-Time Locating System. A trajectory prediction framework is introduced to support the implementation and use of pattern- and planning-based trajectory prediction algorithms. The evaluation is based on scenarios from the addressed problem area of manufacturing.BibTeX
A. Löcklin, F. Dettinger, M. Artelt, N. Jazdi, and M. Weyrich, “Trajectory Prediction of Workers to Improve AGV and AMR Operation based on the Manufacturing Schedule,” Procedia CIRP, Vol. 107, pp. 283-288, Mai, 2022, 2022.
Abstract
In semi-automated manufacturing, an increasing amount of intelligent mobile robots operate in close proximity to human workers. Considering future positions of humans allows to further improve the efficiency in terms of throughput of Autonomous Mobile Robots (AMR) and Automated Guided Vehicles (AGV). The longer the prediction horizon, i.e. the more position values of humans can be predicted in the near and distant future, the more a robot can adjust its route accordingly and optimize the process. This paper discusses the challenges of human motion trajectory prediction in manufacturing and presents a schedule-based approach that uses real-time schedule data obtained from Manufacturing Execution Systems (MES). Schedule-awareness in human motion trajectory prediction extends semantic mapping approaches and effectively reduces the number of probable destinations by considering which process steps are next for the currently produced goods. With a reduced set of destinations, the performance of forward-planning trajectory prediction can be improved. For evaluation, a commercial MES is used together with an Ultra-wideband-based Real-Time Locating System (RTLS) for obtaining position data of humans. On this basis, a naive Bayes classifier utilizes MES-schedule and real-time position data to predict human motion intentions. Abstract activity modeling ensures that only a few training data sets are required for deployment, thus making this approach suitable for rapidly changing manufacturing environments such as in flexible manufacturing.BibTeX
