search

UMD     This Site





Figure: A real quadrotor running EVDodgeNet to dodge two obstacles thrown at it simultaneously. (b) Raw event frame as seen from the front event camera. (c) Segmentation output. (d) Segmentation flow output which includes both segmentation and optical flow. (e) Simulation environment where EVDodgeNet was trained. (f) Segmentation ground truth. (g) Simulated front facing event frame.

 

The University of Maryland’s Perception and Robotics Group (PRG) has developed EVDodgeNet, a dynamic obstacle avoidance system for quadrotor UAVs (unmanned aerial vehicles) that uses event cameras as sensors.

EVDodgeNet is a deep learning-based solution for dodging multiple dynamic obstacles on a quadrotor with a single event camera and on-board computation. This approach uses a series of shallow neural networks for estimating both the ego-motion and the motion of independently moving objects. The networks are trained in simulation and directly transfer to the real world without needing fine-tuning or retraining. The approach has been successfully evaluated and demonstrated in many real-world experiments with obstacles of different shapes and sizes. The system has achieved an overall success rate of 70%, including with objects of unknown shape and in a low-light testing scenario.

The researchers believe this is the first deep learning-based solution to the problem of dynamic obstacle avoidance using event cameras on a quadrotor. The navigation stack can cater to different scenarios; for example, the system can be extended to the task of pursuit by merely reversing the control policy.

Read a paper describing the system by PRG researchers Nitin J. Sanket, Chethan M. Parameshwara, Chahat Deep Singh, Ashwin V. Kuruttukulam, ISR-affiliated Associate Research Scientist Cornelia Fermüller (UMIACS), and ISR-affiliated Professor Yiannis Aloimonos (CS/UMIACS), along with Davide Scaramuzza of the University of Zurich and ETH Zurich. PRG is part of the University of Maryland Institute for Advanced Computer Studies, the Maryland Robotics Center, and the Institute for Systems Research.



Related Articles:
Chahat Deep Singh's robot bee work featured in BBC video
MRC and MAGE Earn ARM Institute Endorsement
A cooperative control algorithm for robotic search and rescue
Aerodynamic interaction model improves quadrotor flight stability in gusty winds
GapFlyt helps aerial robots navigate more like birds and insects
Workshop honors alum Naomi Leonard
Alum Fumin Zhang elected to IEEE Fellow
UMD Team Wins IEEE IROS Best Paper Award in Agri-Robotics
Diving Deeper into Competition, and Recruitment
UMD-led Team Selected for DARPA Triage Challenge

October 30, 2019


«Previous Story  

 

 

Current Headlines

Remembering Rance Cleaveland (1961-2024)

Dinesh Manocha Inducted into IEEE VGTC Virtual Reality Academy

ECE Ph.D. Student Ayooluwa (“Ayo”) Ajiboye Recognized at APEC 2024

Balachandran, Cameron, Yu Receive 2024 MURI Award

UMD, Booz Allen Hamilton Announce Collaboration with MMEC

New Research Suggests Gossip “Not Always a Bad Thing”

Ingestible Capsule Technology Research on Front Cover of Journal

Governor’s Cabinet Meeting Features Peek into Southern Maryland Research and Collaboration

Celebrating the Impact of Black Maryland Engineers and Leaders

Six Clark School Faculty Receive 2024 DURIP Awards

 
 
Back to top  
Home Clark School Home UMD Home