Human and environmental feature-driven neural network for path-constrained robot navigation using deep reinforcement learning
  • Pico, Nabih
  • Montero, Estrella
  • Amirbek, Alisher
  • Auh, Eugene
  • Jeon, Jeongmin
  • ... Moon, Hyungpil
  • 외 3명
Citations

WEB OF SCIENCE

3
Citations

SCOPUS

4

초록

This paper introduces a neural network model designed for autonomous navigation in complex environments. It combines DRL methodologies to capture critical environmental features in the neural network. These features encompass data about the robot, humans, static obstacles, and path constraints. The representation, combined with weighted features from humans and environmental limitations, is processed through three multi-layer perceptrons (MLP) to calculate the value function and optimal policy, thereby enhancing navigation tasks. A novel reward function is proposed to accommodate path constraints and steer the robot's navigation policies during neural network training. Additionally, common metrics like success rate, collision avoidance, time to reach the goal, and new comprehensive log information are included to provide an overview of the robot's performance. The model's efficacy is demonstrated through navigation in simulation scenarios involving curved and cross pathways, with the agents’ random position and velocity occasionally exceeding the maximum robot speed, as well as real experiments in limited spaces. The paper provides a GitHub repository that includes comparative performance videos with state-of-the-art models in path-constrained scenarios, along with strategies for reward functions. Link: https://github.com/nabihandres/Wallproximity_DRL. © 2025 The Authors

키워드

Autonomous robot navigationMotion and path planningPath constraintReinforcement learning
제목
Human and environmental feature-driven neural network for path-constrained robot navigation using deep reinforcement learning
저자
Pico, NabihMontero, EstrellaAmirbek, AlisherAuh, EugeneJeon, JeongminAlvarez-Alvarado, Manuel S.Jamil, BabarAlgabri, RedhwanMoon, Hyungpil
DOI
10.1016/j.jestch.2025.101993
발행일
2025-04
유형
Article
저널명
Engineering Science and Technology, an International Journal
64