Fri, 14 Feb 2025

Fri, 14 Feb 2025 Scientists work on 'superhuman' vision systems for robots

Researchers have given a robot a powerful radio-based vision system which can see through smoke.
University of Pennsylvania student Mingmin Zhao and his team were conducting a late-night experiment with a robot that uses radio waves to "see" through obstacles, including smoke and rain. However, their test was interrupted when the fire alarm went off, triggering the whole building's safety system. The team had set up a smoke machine to simulate a smoky environment for the robot to navigate. Despite this minor setback, Zhao is confident that his radio-based sensing technology has the potential to revolutionize robotics and autonomous vehicles. By using radio waves, these robots can "see" around corners, detect concealed objects, and even identify specific materials. The team's innovation uses an on-board AI system to build a 3D image of the environment based on the reflected radio waves. This allows the robot to navigate through dense smoke or rain without relying on traditional optical cameras or Lidar sensors. The technology has been likened to echolocation, used by bats and some birds, which relies on emitting sounds and detecting echoes to create a mental map of their surroundings. Researchers have also explored using this technology for security applications, such as detecting concealed weapons and "fingerprinting" the details of a room to track changes over time. Other uses include identifying specific materials or objects, even through walls or doors. Experts in the field are optimistic about the potential of radio-based sensing technology, with some already exploring its use in real-world applications, including self-driving cars and search-and-rescue robots. However, there is also a concern that this technology could be used for more sinister purposes, such as surveillance or military operations.
  >>