In recent years, computer scientists have been investigating a range of techniques for removing reflections from digital photographs shot through glass. Some have tried to use variability in focal distance or the polarization of light; others, like those at MIT, have exploited the fact that a pane of glass produces not one but two reflections, slightly offset from each other.
At the Institute of Electrical and Electronics Engineers’ International Conference on Acoustics, Speech, and Signal Processing this week, members of the MIT Media Lab’s Camera Culture Group will present a fundamentally different approach to image separation. Their system fires light into a scene and gauges the differences between the arrival times of light reflected by nearby objects — such as panes of glass — and more distant objects.
In earlier projects, the Camera Culture Group has measured the arrival times of reflected light by using an ultrafast sensor called a streak camera. But the new system uses a cheap, off-the-shelf depth sensor of the type found in video game systems.
At first glance, such commercial devices would appear to be too slow to make the fine discriminations that reflection removal requires. But the MIT researchers get around that limitation with clever signal processing. Consequently, the work could also have implications for noninvasive imaging technologies such as ultrasound and terahertz imaging.
“You physically cannot make a camera that picks out multiple reflections,” says Ayush Bhandari, a PhD student in the MIT Media Lab and first author on the new paper. “That would mean that you take time slices so fast that [the camera] actually starts to operate at the speed of light, which is technically impossible. So what’s the trick? We use the Fourier transform.”
The Fourier transform, which is ubiquitous in signal processing, is a method for decomposing a signal into its constituent frequencies. If fluctuations in the intensity of the light striking a sensor, or in the voltage of an audio signal, can be represented as an erratic up-and-down squiggle, the Fourier transform redescribes them as the sum of multiple, very regular squiggles, or pure frequencies.
Phased out
Each frequency in a Fourier decomposition is characterized by two properties. One is its amplitude, or how high the crests of its waves are. This describes how much it contributes to the composite signal.
The other property is phase, which describes the offset of the wave’s troughs and crests. Two nearby frequencies may be superimposed, for instance, so that their first crests are aligned; alternatively, they might align so that the first crest of one corresponds with a trough of the other. With multiple frequencies, differences in phase alignment can yield very different composite signals.
If two light signals — one reflected from a nearby object such as a window and one from a more distant object — arrive at a light sensor at slightly different times, their Fourier decompositions will have different phases. So measuring phase provides a de facto method for measuring the signals’ time of arrival.
There’s one problem: A conventional light sensor can’t measure phase. It only measures intensity, or the energy of the light particles striking it. And in other settings, such as terahertz imaging, measuring phase as well as intensity can dramatically increase costs.
Page 1 of 2
Suggested Items
Inkjet Solder Mask ‘Has Arrived’
04/10/2024 | Pete Starkey, I-Connect007I was delighted to be invited to attend an interactive webinar entitled “Solder Mask Coating Made Easy with Additive Manufacturing,” hosted by SUSS MicroTec Netherlands in Eindhoven. The webinar was introduced and moderated by André Bodegom, managing director at Adeon Technologies, and the speakers were Mariana Van Dam, senior product manager PCB imaging solutions at AGFA in Belgium; Ashley Steers, sales manager at Electra Polymers in the UK; and Dr. Luca Gautero, product manager at SUSS MicroTec Netherlands.
NetVia Group Acquires Direct Imaging from Mivatek
04/09/2024 | Miva TechnologiesMiva Technologies is pleased to announce NetVia Group, Irving, TX has acquired a new Miva 2400NG Dual Tray Direct Imaging System with 30-micron capabilities for inner, outer and soldermask imaging.
Teledyne to Acquire Adimec
02/13/2024 | TeledyneTeledyne Technologies Incorporated announced that it has entered into an agreement to acquire Adimec Holding B.V. and its subsidiaries.
Real Time with... productronica 2023: MivaTek Global Advances Technology With High-res Imaging System
12/08/2023 | Real Time with...productronicaMivaTek's Brendan Hogan talks about how the company employs Digitally Adaptive Rasterization Technology (DART) in their high-res imaging equipment. He also shares how the blurred line between semiconductors and microelectronics is driving broader application of the imaging process.
Keysight Enables Validation of Arbe 4D Imaging Radar Chipset
11/30/2023 | Keysight Technologies, Inc.Keysight Technologies, Inc. announces that Arbe has selected the E8719A Radar Target Solution (RTS) to test the Arbe 4D imaging radar chipset for automotive applications.