Army Researchers Teach Robots to be Better Teammates for Soldiers
Researchers at the U.S. Army Research, Development and Engineering Command Research Laboratory and the Robotics Institute at Carnegie Mellon University developed a new technique to quickly teach robots novel traversal behaviors with minimal human oversight. The technique allows mobile robot platforms to navigate autonomously in environments while carrying out actions a human would expect of the robot in a given situation.
According to Dr. Maggie Wigness, one of the research team's goals in autonomous systems research is to provide reliable autonomous robot teammates to the soldier.
"If a robot acts as a teammate, tasks can be accomplished faster and more situational awareness can be obtained," Wigness said. "Further, robot teammates can be used as an initial investigator for potentially dangerous scenarios, thereby keeping soldiers further from harm."
To achieve this, Wigness said the robot must be able to use its learned intelligence to perceive, reason and make decisions. "This research focuses on how robot intelligence can be learned from a few human example demonstrations," Wigness said. "The learning process is fast and requires minimal human demonstration, making it an ideal learning technique for on-the-fly learning in the field when mission requirements change."
The Research Lab and CMU researchers focused their initial investigation on learning robot traversal behaviors with respect to the robot's visual perception of terrain and objects in the environment. More specifically, the robot was taught how to navigate from various points in the environment while staying near the edge of a road, and also how to traverse covertly using buildings as cover.
According to the researchers, given different mission tasks, the most appropriate learned traversal behavior can be activated during robot operation. This is done by leveraging inverse optimal control, also commonly referred to as inverse reinforcement learning, which is a class of machine learning that seeks to recover a reward function given a known optimal policy.
In this case, a human demonstrates the optimal policy by driving a robot along a trajectory that best represents the behavior to be learned. These trajectory exemplars are then related to the visual terrain/object features, such as grass, roads and buildings, to learn a reward function with respect to these environment features. While similar research exists in the field of robotics, the work the lab is doing is especially unique.
"The challenges and operating scenarios that we focus on here at the Research Lab (ARL) are extremely unique compared to other research being performed," Wigness said. "We seek to create intelligent robotic systems that reliably operate in warfighter environments, meaning the scene is highly unstructured, possibly noisy, and we need to do this given relatively little a priori knowledge of the current state of the environment. Our techniques, by the very definition of the problem, must be robust to noise and have the ability to learn with relatively small amounts of data."
According to Wigness, this preliminary research has helped the researchers demonstrate the feasibility of quickly learning an encoding of traversal behaviors.
"As we push this research to the next level, we will begin to focus on more complex behaviors, which may require learning from more than just visual perception features," Wigness said. "Our learning framework is flexible enough to use a priori intel that may be available about an environment. This could include information about areas that are likely visible by adversaries or areas known to have reliable communication. This additional information may be relevant for certain mission scenarios, and learning with respect to these features would enhance the intelligence of the mobile robot."
The researchers are also exploring how this type of behavior learning transfers between different mobile platforms. Their evaluation to date has been performed with a small unmanned Clearpath Husky robot, which has a visual field of view that is relatively low to the ground.
"Transferring this technology to larger platforms will introduce new perception viewpoints and different platform maneuvering capabilities," Wigness said. "Learning to encode behaviors that can be easily transferred between different platforms would be extremely valuable given a team of heterogeneous robots. In this case, the behavior can be learned on one platform instead of each platform individually."
This research is funded through the Army's Robotics Collaborative Technology Alliance (RCTA), which brings together government, industrial and academic institutions to address research and development required to enable the deployment of future military unmanned ground vehicle systems ranging in size from man-portables to ground combat vehicles.
Ultimately, this research is crucial for the future battlefield, where soldiers will be able to rely on robots with more confidence to assist them in executing missions.
Top Stories
INSIDERManufacturing & Prototyping
Boeing to End 767 Production, Reduce Workforce Amid Ongoing Union Strike
INSIDERMechanical & Fluid Systems
Army Receives New Robot Combat Vehicle Prototypes
INSIDERDesign
Are Boeing 737 Rudder Control Systems at Risk of Malfunctioning?
INSIDERMechanical & Fluid Systems
Army Evaluates 3D Printing for Bradley Fighting Vehicle's Transmission Mount
INSIDERAerospace
Army Seeks to Expand 3D Printing to the Tactical Edge
ArticlesRegulations/Standards
Cummins New X15 Engine Meets Upcoming Regs While Boosting Efficiency
Webcasts
Defense
Maximize Asset Availability in the Aerospace and Defense Industry
Aerospace
The Inside Story on Space Grade Silicones
Transportation
The Rise of Software-Defined Commercial Vehicles
Test & Measurement
Avoiding Risk Analysis Pitfalls: Implementing Linked DFMEA, HARA,...
Automotive
A Quick Guide to Multi-Axis Simulation and Component Testing
Aerospace
Best Practices for Developing Safe and Secure Modular Software