Engineers at the MIT Computer Science and Artificial Intelligence Laboratory have developed a clever and surprisingly simple way to see around corners. And it’s all thanks to the hidden wonders of light.
Let’s pretend you’re standing in an L-shaped hallway, looking where the inside corner of the hallway meets the floor. You can’t see what’s around the corner, but you can see light emitting from the other side, splashed onto the floor at that right angle. So long as what’s over there isn’t a single light source, like a flashlight, you won’t see one hard line of shadow. You’ll see a sort of gradient of not-quite-shadow—kind of a blurry shadow. This is known as the penumbra. If you have a corner with suitable light, go take a look. It’ll be there.
Your eyes can’t see it, but there’s a lot going on in this penumbra: It’s a reflection—a real-time, low-res view of the scene around the corner. This happens outdoors, too, thanks to light from the sun. Train a camera on this spot and magnify the color, and you can start to pick out different-colored pixels that correspond to objects otherwise obscured by the wall.
If a person walks through wearing a bright red shirt, they reflect red light into the penumbra. But more often, they block light from sunlight, so you’ll get this dark path because they’re blocking the bright light.
The naked eye cannot see these movements because the changes are taking place in just 0.1 percent of the light that is being reflected. But what the recordings from the MIT lab capture are the movements of people out of view. They are literally seeing around corners.
It’s so simple, you can capture the image with a cheap webcam. According to the MIT engineers pulling this off, it is very computationally inexpensive, since you’re basically just doing a derivative. You are just doing pixel differences, and so it works in real time.
The downside of all of this is that the camera has to be stationary to catch these subtle changes in light. But the technology may be able to get the system to work in motion sometime in the near future.
That could make self-driving cars even more powerful. The lasers they use are great at building detailed maps of the world, but not so hot at seeing around obstacles. Autonomous wheelchairs, too, could benefit from seeing around corners in office buildings and on city sidewalks. The same can be said for the healthcare robots that are already roaming the halls of hospitals. The power to see around corners could mean everything from fewer car accidents to fewer crushed toes.
