Indirect Time-of-Flight Depth Sensor with Two-Step Comparison Scheme for Depth Frame Difference Detection

A depth sensor with integrated frame difference detection is proposed. Instead of frame difference detection using light intensity, which is vulnerable to ambient light, the difference in depth between successive frames can be acquired. Because the conventional time-of-flight depth sensor requires t...

Full description

Bibliographic Details
Main Authors: Donguk Kim, Jaehyuk Choi
Format: Article
Language:English
Published: MDPI AG 2019-08-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/19/17/3674
id doaj-e0bb26d31e5d4f1eae18e28973bf1e5b
record_format Article
spelling doaj-e0bb26d31e5d4f1eae18e28973bf1e5b2020-11-24T21:49:00ZengMDPI AGSensors1424-82202019-08-011917367410.3390/s19173674s19173674Indirect Time-of-Flight Depth Sensor with Two-Step Comparison Scheme for Depth Frame Difference DetectionDonguk Kim0Jaehyuk Choi1College of Information and Communication Engineering, Sungkyunkwan University, Suwon 16419, KoreaCollege of Information and Communication Engineering, Sungkyunkwan University, Suwon 16419, KoreaA depth sensor with integrated frame difference detection is proposed. Instead of frame difference detection using light intensity, which is vulnerable to ambient light, the difference in depth between successive frames can be acquired. Because the conventional time-of-flight depth sensor requires two frames of depth-image acquisition with four-phase modulation, it has large power consumption, as well as a large area for external frame memories. Therefore, we propose a simple two-step comparison scheme for generating the depth frame difference in a single frame. With the proposed scheme, only a single frame is needed to obtain the frame difference, with less than half of the power consumption of the conventional depth sensor. Because the frame difference is simply generated by column-parallel circuits, no access of the external frame memory is involved, nor is a digital signal processor. In addition, we used an over-pixel metal−insulator−metal capacitor to store temporary signals for enhancing the area efficiency. A prototype chip was fabricated using a 90 nm backside illumination complementary metal−oxide−semiconductor (CMOS) image sensor process. We measured the depth frame difference in the range of 1−2.5 m. With a 10 MHz modulation frequency, a depth frame difference of >10 cm was successfully detected even for objects with different reflectivity. The maximum relative error from the difference of the reflectivity (white and wooden targets) was <3%.https://www.mdpi.com/1424-8220/19/17/3674time-of-flight (TOF)depth sensorframe differenceCMOS image sensor
collection DOAJ
language English
format Article
sources DOAJ
author Donguk Kim
Jaehyuk Choi
spellingShingle Donguk Kim
Jaehyuk Choi
Indirect Time-of-Flight Depth Sensor with Two-Step Comparison Scheme for Depth Frame Difference Detection
Sensors
time-of-flight (TOF)
depth sensor
frame difference
CMOS image sensor
author_facet Donguk Kim
Jaehyuk Choi
author_sort Donguk Kim
title Indirect Time-of-Flight Depth Sensor with Two-Step Comparison Scheme for Depth Frame Difference Detection
title_short Indirect Time-of-Flight Depth Sensor with Two-Step Comparison Scheme for Depth Frame Difference Detection
title_full Indirect Time-of-Flight Depth Sensor with Two-Step Comparison Scheme for Depth Frame Difference Detection
title_fullStr Indirect Time-of-Flight Depth Sensor with Two-Step Comparison Scheme for Depth Frame Difference Detection
title_full_unstemmed Indirect Time-of-Flight Depth Sensor with Two-Step Comparison Scheme for Depth Frame Difference Detection
title_sort indirect time-of-flight depth sensor with two-step comparison scheme for depth frame difference detection
publisher MDPI AG
series Sensors
issn 1424-8220
publishDate 2019-08-01
description A depth sensor with integrated frame difference detection is proposed. Instead of frame difference detection using light intensity, which is vulnerable to ambient light, the difference in depth between successive frames can be acquired. Because the conventional time-of-flight depth sensor requires two frames of depth-image acquisition with four-phase modulation, it has large power consumption, as well as a large area for external frame memories. Therefore, we propose a simple two-step comparison scheme for generating the depth frame difference in a single frame. With the proposed scheme, only a single frame is needed to obtain the frame difference, with less than half of the power consumption of the conventional depth sensor. Because the frame difference is simply generated by column-parallel circuits, no access of the external frame memory is involved, nor is a digital signal processor. In addition, we used an over-pixel metal−insulator−metal capacitor to store temporary signals for enhancing the area efficiency. A prototype chip was fabricated using a 90 nm backside illumination complementary metal−oxide−semiconductor (CMOS) image sensor process. We measured the depth frame difference in the range of 1−2.5 m. With a 10 MHz modulation frequency, a depth frame difference of >10 cm was successfully detected even for objects with different reflectivity. The maximum relative error from the difference of the reflectivity (white and wooden targets) was <3%.
topic time-of-flight (TOF)
depth sensor
frame difference
CMOS image sensor
url https://www.mdpi.com/1424-8220/19/17/3674
work_keys_str_mv AT dongukkim indirecttimeofflightdepthsensorwithtwostepcomparisonschemefordepthframedifferencedetection
AT jaehyukchoi indirecttimeofflightdepthsensorwithtwostepcomparisonschemefordepthframedifferencedetection
_version_ 1725890018100117504