1/3-Inch CMOS Digital Image Sensor

MT9M024: 1/3-Inch CMOS Digital Image Sensor
Features
1/3-Inch CMOS Digital Image Sensor
MT9M024 Data Sheet, Rev. G
For the latest data sheet, please visit www.onsemi.com
Features
•
•
•
•
•
•
•
•
•
Table 1:
Superior low-light performance
HD video (720p60)
Linear or high dynamic range capture
Video/Single Frame modes
On-chip AE and statistics engine
Parallel and serial output
Auto black level calibration
Context switching
Temperature Sensor
Key Parameters
Parameter
Typical Value
Optical format
1/3-inch (6 mm)
Active pixels
1280 x 960 = 1.2 Mp
Pixel size
3.75m
Color filter array
RGB Bayer or monochrome
Shutter type
Electronic rolling shutter
Input clock range
6 – 50 MHz
Output clock maximum
74.25 MHz
Applications
Output
• Video surveillance
• 720p60 video applications
• High dynamic range imaging
Frame
rate
Serial
HiSPi 12-, 14-, or 20-bit
Parallel
12-bit
Full resolution
45 fps
720p
60 fps
Responsivity
5.48 V/lux-sec
SNRMAX
43.9 dB
General Description
Maximum dynamic range
>115 dB
The ON Semiconductor MT9M024 is a 1/3-inch CMOS
digital image sensor with an active-pixel array of
1280H x 960V. It captures images in either linear or
high dynamic range modes, with a rolling-shutter
readout. It includes sophisticated camera functions
such as auto exposure control, windowing, and both
video and single frame modes. It is designed for both
low light and high dynamic range scene performance.
It is programmable through a simple two-wire serial
interface. The MT9M024 produces extraordinarily
clear, sharp digital pictures, and its ability to capture
both continuous video and single frames makes it the
perfect choice for a wide range of applications, including surveillance and HD video.
Supply
voltage
MT9M024_DS Rev. G Pub. 4/15 EN
I/O
1.8 or 2.8V*
Digital
1.8 V
Analog HiSPi
2.8 V0.4 V or 1.8 V
Power consumption
(typical)
270 mW (1280 x 720
60 fps Parallel output Linear
Mode)
460 mW (1280 x 720 60 fps
Parallel output HDR Mode)
Operating temperature
(ambient) -TA
–30°C to + 70° C (surveillance)
Package options
9x9 mm iBGA
Bare die
*1.8V VDD_IO is recommended due to better row noise performance
1
©Semiconductor Components Industries, LLC,2015
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Ordering Information
Ordering Information
Table 2:
Available Part Numbers
Part Number
Product Description
Orderable Product Attribute Description
MT9M024IA3XTC-DPBR
1.2 MP 1/3" CIS
Dry Pack with Protective Film, Double Side BBAR Glass
MT9M024IA3XTC-DRBR
1.2 MP 1/3" CIS
Dry Pack without Protective Film, Double Side BBAR Glass
MT9M024IA3XTM-DPBR
1.2 MP 1/3" CIS
Dry Pack with Protective Film, Double Side BBAR Glass
MT9M024IA3XTM-DRBR
1.2 MP 1/3" CIS
Dry Pack without Protective Film, Double Side BBAR Glass
MT9M024_DS Rev. G Pub. 4/15 EN
2
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Table of Contents
Table of Contents
Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1
Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1
General Description . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1
Ordering Information. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2
General Description . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1
Functional Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1
Pixel Data Format . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .7
Output Data Format . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .10
High Dynamic Range Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .17
Real-Time Context Switching . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .21
Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .21
Two-Wire Serial Register Interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .35
Spectral Characteristics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .39
Electrical Specifications. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .41
Power-On Reset and Standby Timing. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .54
Package Dimensions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .57
Revision History. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .59
MT9M024_DS Rev. G Pub. 4/15 EN
3
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
List of Figures
List of Figures
Figure 1:
Figure 2:
Figure 3:
Figure 4:
Figure 5:
Figure 6:
Figure 7:
Figure 8:
Figure 9:
Figure 10:
Figure 11:
Figure 12:
Figure 13:
Figure 14:
Figure 15:
Figure 16:
Figure 17:
Figure 18:
Figure 19:
Figure 20:
Figure 21:
Figure 22:
Figure 23:
Figure 24:
Figure 25:
Figure 26:
Figure 27:
Figure 28:
Figure 29:
Figure 30:
Figure 31:
Figure 32:
Figure 33:
Figure 34:
Figure 35:
Figure 36:
Figure 37:
Figure 38:
Figure 39:
Figure 40:
Block Diagram . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1
Typical Configuration: Serial Four-Lane HiSPi Interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2
Typical Configuration: Parallel Pixel Data Interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3
9 x 9 mm 63-Ball IBGA Package . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4
Pixel Array Description . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .7
Pixel Color Pattern Detail (Top Right Corner) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .8
Imaging a Scene . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .8
Spatial Illustration of Image Readout. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .10
Default Pixel Output Timing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .11
LV Format Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .12
HiSPi Transmitter and Receiver Interface Block Diagram. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .12
Timing Diagram . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .13
Block Diagram of DLL Timing Adjustment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .13
Delaying the Clock with Respect to Data. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .14
Delaying Data with Respect to the Clock. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .14
Line Timing and FRAME_VALID/LINE_VALID Signals . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .15
HDR Data Compression . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .17
PLL-Generated Master Clock PLL Setup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .22
Eight Pixels in Normal and Column Mirror Readout Modes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .25
Six Rows in Normal and Row Mirror Readout Modes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26
Frame Format with Embedded Data Lines Enabled . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .29
Format of Embedded Data Output within a Frame . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .30
Format of Embedded Statistics Output within a Frame. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .31
Single READ from Random Location . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .37
Single READ from Current Location. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .37
Sequential READ, Start from Random Location . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .37
Sequential READ, Start from Current Location . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .38
Single WRITE to Random Location. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .38
Sequential WRITE, Start at Random Location . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .38
Quantum Efficiency – Color Sensor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .39
Estimated Quantum Efficiency – Monochrome Sensor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .40
Two-Wire Serial Bus Timing Parameters. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .41
I/O Timing Diagram. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .43
Power Supply Rejection Ratio . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .50
Differential Output Voltage for Clock or Data Pairs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .52
Eye Diagram for Clock and Data Signals . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .53
Skew Within the PHY and Output Channels. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .53
Power Up . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .54
Power Down. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .56
63-Ball iBGA Package Outline Drawing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .57
MT9M024_DS Rev. G Pub. 4/15 EN
4
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
List of Tables
List of Tables
Table 1:
Table 2:
Table 1:
Table 2:
Table 3:
Table 4:
Table 5:
Table 6:
Table 7:
Table 8:
Table 9:
Table 10:
Table 11:
Table 12:
Table 13:
Table 14:
Table 15:
Table 16:
Table 17:
Table 18:
Table 19:
Table 20:
Table 21:
Table 22:
Table 23:
Table 24:
Table 25:
Table 26:
Table 27:
Table 28:
Key Parameters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1
Available Part Numbers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2
Pin Descriptions, 9 x 9 mm, 63-ball iBGA . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .5
Digital Gain Control for odd and even x_addr_start (R0x3004) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .9
Frame Time (Example Based on 1280 x 960, 45 Frames Per Second) . . . . . . . . . . . . . . . . . . . . . . . . . . .15
Frame Time: Long Integration Time . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .16
Knee Points for Compression to 14 Bits. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .18
Knee Points for Compression to 12 Bits. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .18
Digital Gain Setting for Each T1/T2 and T2/T3Ratio . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .19
Real-Time Context-Switch Registers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .21
Test Pattern Modes. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .34
Two-Wire Serial Bus Characteristics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .41
I/O Timing Characteristics (2.8V VDD_IO)1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .43
I/O Timing Characteristics (1.8V VDD_IO)1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .44
I/O Rise Slew Rate (2.8V VDD_IO)1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .44
I/O Fall Slew Rate (2.8V VDD_IO)1. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .45
I/O Rise Slew Rate (1.8V VDD_IO)1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .45
I/O Fall Slew Rate (1.8V VDD_IO)1. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .45
DC Electrical Characteristics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .46
Absolute Maximum Ratings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .46
Operating Current Consumption in Parallel Output and Linear Mode . . . . . . . . . . . . . . . . . . . . . . . .47
Operating Current Consumption in Parallel Output and HDR Mode . . . . . . . . . . . . . . . . . . . . . . . . . .47
Operating Currents in HiSPi Output and Linear Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .48
Operating Current in HiSPi Output and HDR Mode. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .49
Standby Current Consumption . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .50
Input Voltage and Current (HiSPi Power Supply 0.4 V) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .51
Input Voltage and Current (HiSPi Power Supply 1.8 V) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .51
Rise and Fall Times. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .52
Power-Up Sequence. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .55
Power-Down Sequence . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .56
MT9M024_DS Rev. G Pub. 4/15 EN
5
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
General Description
General Description
The ON Semiconductor MT9M024 can be operated in its default mode or programmed
for frame size, exposure, gain, and other parameters. The default mode output is a 960presolution image at 45 frames per second (fps). In linear mode, it outputs 12-bit raw
data, using either the parallel or serial (HiSPi™) output ports. In high dynamic range
mode, it outputs 12-bit compressed data using parallel output or 12-bit or 14-bit
compressed or 20-bit linearized data using the HiSPi port. The device may be operated
in video (master) mode or in single frame trigger mode.
FRAME_VALID and LINE_VALID signals are output on dedicated pins, along with a
synchronized pixel clock in parallel mode.
The MT9M024 includes additional features to allow application-specific tuning:
windowing and offset, adjustable auto-exposure control, auto black level correction, and
on-board temperature sensor. Optional register information and histogram statistic
information can be embedded in first and last 2 lines of the image frame.
The sensor is designed to operate in a wide temperature range (–30°C to +70°C).
Functional Overview
The MT9M024 is a progressive-scan sensor that generates a stream of pixel data at a
constant frame rate. It uses an on-chip, phase-locked loop (PLL) that can be optionally
enabled to generate all internal clocks from a single master input clock running between
6 and 50 MHz The maximum output pixel rate is 74.25 Mp/s, corresponding to a clock
rate of 74.25 MHz. Figure 1 shows a block diagram of the sensor.
Figure 1:
Block Diagram
OTPM
Active Pixel Sensor
(APS)
Array
Timing and Control
(Sequencer)
Power
Memory
External
Clock
Auto Exposure
and Stats Engine
Pixel Data Path
(Signal Processing)
Analog Processing and
A/D Conversion
PLL
Parallel
Output
Trigger
Two-Wire
Serial
Interface
Control Registers
User interaction with the sensor is through the two-wire serial bus, which communicates with the array control, analog signal chain, and digital signal chain. The core of the
sensor is a 1.2 Mp Active- Pixel Sensor array. The timing and control circuitry sequences
through the rows of the array, resetting and then reading each row in turn. In the time
interval between resetting a row and reading that row, the pixels in the row integrate
incident light. The exposure is controlled by varying the time interval between reset and
MT9M024_DS Rev. G Pub. 4/15 EN
6
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Functional Overview
readout. Once a row has been read, the data from the columns is sequenced through an
analog signal chain (providing offset correction and gain), and then through an analogto-digital converter (ADC). The output from the ADC is a 12-bit value for each pixel in
the array. The ADC output passes through a digital processing signal chain (which
provides further data path corrections and applies digital gain). The sensor also offers a
high dynamic range mode of operation where multiple images are combined on-chip to
produce a single image at 20-bit per pixel value. A compressing mode is further offered
to allow this 20-bit pixel value to be transmitted to the host system as a 12-bit value with
close to zero loss in image quality. The pixel data are output at a rate of up to 74.25 Mp/s,
in parallel to frame and line synchronization signals.
Typical Configuration: Serial Four-Lane HiSPi Interface
VDD_IO
1.5kΩ2, 3
1.5kΩ2
Digital Digital
I/O
Core
power1 power1
Master clock
(6–50 MHz)
EXTCLK
SADDR
SDATA
SCLK
TRIGGER
OE_BAR
STANDBY
RESET_BAR
TEST
From
controller
VDD_IO
VDD
Notes:
MT9M024_DS Rev. G Pub. 4/15 EN
VDD_SLVS
VDD
HiSPi
power1
VDD_SLVS
Figure 2:
VDD_PLL
VAA
Analog Analog
PLL
power1 power1 power1
VDD_PLL
VAA
VAA_PIX
SLVS0_P
SLVS0_N
SLVS1_P
SLVS1_N
SLVS2_P
SLVS2_N
SLVS3_P
SLVS3_N
SLVSC_P
SLVSC_N
DGND
AGND
Digital
ground
Analog
ground
To
controller
VAA_PIX
1. All power supplies must be adequately decoupled.
2. ON Semiconductor recommends a resistor value of 1.5k, but a greater value may be used for
slower two-wire speed.
3. This pull-up resistor is not required if the controller drives a valid logic level on SCLK at all times.
4. The parallel interface output pads can be left unconnected if the serial output interface is used.
5. ON Semiconductor recommends that 0.1μF and 10μF decoupling capacitors for each power supply
are mounted as close as possible to the pad. Actual values and results may vary depending on layout and design considerations. Check the MT9M024 demo headboard schematics for circuit recommendations.
6. ON Semiconductor recommends that analog power planes are placed in a manner such that coupling with the digital power planes is minimized.
7. I/O signals voltage must be configured to match VDD_IO voltage to minimize any leakage currents.
7
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Functional Overview
Figure 3:
Typical Configuration: Parallel Pixel Data Interface
1.5kΩ2, 3
1.5kΩ2
Digital Digital
core
I/O
power1 power1
VDD_IO
PLL Analog Analog
power1 power1 power1
VDD
Master clock
(6–50 MHz)
EXTCLK
From
Controller
SADDR
SDATA
SCLK
TRIGGER
OE_BAR
STANDBY
RESET_BAR
VDD_PLL VAA
VAA_PIX
DOUT [11:0]
PIXCLK
LINE_VALID
FRAME_VALID
To
controller
TEST
DGND
VDD_IO
VDD
VDD_PLL
VAA
VAA_PIX
Digital
ground
Notes:
MT9M024_DS Rev. G Pub. 4/15 EN
AGND
Analog
ground
1. All power supplies must be adequately decoupled.
2. ON Semiconductor recommends a resistor value of 1.5k, but a greater value may be used for
slower two-wire speed.
3. This pull-up resistor is not required if the controller drives a valid logic level on SCLK at all times.
4. ON Semiconductor recommends that 0.1μF and 10μF decoupling capacitors for each power supply
are mounted as close as possible to the pad. Actual values and results may vary depending on layout and design considerations. Check the demo headboard schematics for circuit recommendations.
5. ON Semiconductor recommends that analog power planes are placed in a manner such that coupling with the digital power planes is minimized.
6. I/O signals voltage must be configured to match VDD_IO voltage to minimize any leakage currents.
7. The serial interface output pads and VDDSLVS can be left unconnected if the parallel output interface is used.
8
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Functional Overview
Figure 4:
9 x 9 mm 63-Ball IBGA Package
1
A
2
3
4
SLVS0N
SLVS0P
SLVS1N
5
6
7
8
SLVS1P
VDD
VDD
STANDBY
B
VDD_PLL
SLVSCN
SLVSCP
SLVS2N
SLVS2P
VDD
VAA
VAA
C
EXTCLK
VDD_
SLVS
SLVS3N
SLVS3P
DGND
VDD
AGND
AGND
D
SADDR
SCLK
SDATA
DGND
DGND
VDD
VAA_PIX
VAA_PIX
E
LINE_
VALID
FRAME_
VALID
PIXCLK
FLASH
DGND
VDD_IO
NC
F
DOUT8
DOUT9
DOUT10
DOUT11
DGND
VDD_IO
TEST
G
DOUT4
DOUT5
DOUT6
DOUT7
DGND
VDD_IO
TRIGGER
OE_BAR
H
DOUT0
DOUT1
DOUT2
DOUT3
DGND
VDD_IO
VDD_IO
RESET_
BAR
NC
Reserved
Top View
(Ball Down)
MT9M024_DS Rev. G Pub. 4/15 EN
9
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Functional Overview
Table 1:
Pin Descriptions, 9 x 9 mm, 63-ball iBGA
Name
iBGA Pin
SLVS0N
A2
Type
Description
Output
HiSPi serial data, lane 0, differential N.
SLVS0P
A3
Output
HiSPi serial data, lane 0, differential P.
SLVS1N
A4
Output
HiSPi serial data, lane 1, differential N.
SLVS1P
A5
Output
HiSPi serial data, lane 1, differential P.
STANDBY
A8
Input
Standby-mode enable pin (active HIGH).
VDD_PLL
B1
Power
PLL power.
SLVSCN
B2
Output
HiSPi serial DDR clock differential N.
SLVSCP
B3
Output
HiSPi serial DDR clock differential P.
SLVS2N
B4
Output
HiSPi serial data, lane 2, differential N.
SLVS2P
B5
Output
HiSPi serial data, lane 2, differential P.
VAA
B7, B8
Power
Analog power.
EXTCLK
C1
Input
External input clock.
VDD_SLVS
C2
Power
HiSPi power.
SLVS3N
C3
Output
HiSPi serial data, lane 3, differential N.
SLVS3P
C4
Output
HiSPi serial data, lane 3, differential P.
DGND
C5, D4, D5, E5, F5, G5, H5
Power
Digital ground.
VDD
A6, A7, B6, C6, D6
Power
Digital power.
AGND
C7, C8
Power
Analog ground.
SADDR
D1
Input
Two-Wire Serial address select.
SCLK
D2
Input
Two-Wire Serial clock input.
SDATA
D3
I/O
Two-Wire Serial data I/O.
VAA_PIX
D7, D8
Power
Pixel power.
LINE_VALID
E1
Output
Asserted when DOUT line data is valid.
FRAME_VALID
E2
Output
Asserted when DOUT frame data is valid.
PIXCLK
E3
Output
Pixel clock out. DOUT is valid on rising edge of this clock.
VDD_IO
E6, F6, G6, H6, H7
Power
I/O supply power.
DOUT8
F1
Output
Parallel pixel data output.
DOUT9
F2
Output
Parallel pixel data output.
DOUT10
F3
Output
Parallel pixel data output.
DOUT11
F4
Output
Parallel pixel data output (MSB)
TEST
F7
Input.
Manufacturing test enable pin (connect to DGND).
DOUT4
G1
Output
Parallel pixel data output.
DOUT5
G2
Output
Parallel pixel data output.
DOUT6
G3
Output
Parallel pixel data output.
DOUT7
G4
Output
Parallel pixel data output.
TRIGGER
G7
Input
Exposure synchronization input.
OE_BAR
G8
Input
Output enable (active LOW).
DOUT0
H1
Output
Parallel pixel data output (LSB)
DOUT1
H2
Output
Parallel pixel data output.
DOUT2
H3
Output
Parallel pixel data output.
DOUT3
H4
Output
Parallel pixel data output.
MT9M024_DS Rev. G Pub. 4/15 EN
10
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Functional Overview
Table 1:
Pin Descriptions, 9 x 9 mm, 63-ball iBGA
Name
iBGA Pin
RESET_BAR
H8
FLASH
E4
NC
E7, E8
No connection.
Reserved
F8
No connection.
MT9M024_DS Rev. G Pub. 4/15 EN
Type
Description
Input
Asynchronous reset (active LOW). All settings are restored to
factory default.
Output
Flash control output.
11
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Pixel Data Format
Pixel Data Format
Pixel Array Structure
The MT9M024 pixel array is configured as 1412 columns by 1028 rows, (see Figure 5).
The dark pixels are optically black and are used internally to monitor black level. Of the
right 100 columns, 64 are dark pixels used for row noise correction. Of the top 24 rows of
pixels, 12 of the dark rows are used for black level correction. There are 1296 columns by
976 rows of optically active pixels. While the sensor's format is 1280 x 960, the additional
active columns and active rows are included for use when horizontal or vertical mirrored
readout is enabled, to allow readout to start on the same pixel. The pixel adjustment is
always performed for monochrome or color versions. The active area is surrounded with
optically transparent dummy pixels to improve image uniformity within the active area.
Not all dummy pixels or barrier pixels can be read out.
Figure 5:
Pixel Array Description
1412
2 light dummy + 4 barrier + 24 dark + 4 barrier + 6 dark dummy
1296 x 976 (1288 x 968 active)
4.86 x 3.66 mm2 (4.83 x 3.63 mm2)
1028
2 light dummy + 4 barrier + 100 dark + 4 barrier
2 light dummy + 4 barrier
2 light dummy + 4 barrier + 6 dark dummy
Dark pixel
MT9M024_DS Rev. G Pub. 4/15 EN
Barrier pixel
12
Light dummy
pixel
Active pixel
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Pixel Data Format
Figure 6:
Pixel Color Pattern Detail (Top Right Corner)
Column Readout Direction
Row Readout Direction
Active Pixel (0,0)
Physical Pixel (112, 44)
R G
R
G R
G R
G
G B
G
B G
B G
B
R G
R
G R
G R
G
G B
G
B G
B G
B
R G
R
G R
G R
G
G B
G
B G
B G
B
Default Readout Order
By convention, the sensor core pixel array is shown with pixel (0,0) in the top right
corner (see Figure 6). This reflects the actual layout of the array on the die. Also, the first
pixel data read out of the sensor in default condition is that of pixel (112, 44).
When the sensor is imaging, the active surface of the sensor faces the scene as shown in
Figure 7. When the image is read out of the sensor, it is read one row at a time, with the
rows and columns sequenced as shown in Figure 7 on page 8.
Figure 7:
Imaging a Scene
Lens
Scene
Sensor (rear view)
Row
Readout
Order
Column Readout Order
MT9M024_DS Rev. G Pub. 4/15 EN
Pixel (0,0)
13
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Pixel Data Format
Digital Gain Control
MT9M024 supports four digital gains for the color channels: Red, Green1 (green pixels
on the red rows), Green2 (green pixels on the blue rows), and Blue. Digital gain control of
the MT9M024 is dependent on the configuration of the x_addr_start register. Table 4
illustrates how the digital gains are applied when x_addr_start is even or odd number.
Table 2:
Digital Gain Control for odd and even x_addr_start (R0x3004)
Pixels
Red
Green1 (on Red rows)
Green2 (on Blue rows)
Blue
MT9M024_DS Rev. G Pub. 4/15 EN
x_addr_start
Gain
Register
Even
Odd
Even
Odd
Even
Odd
Even
Odd
red_gain
green1_gain
green1_gain
red_gain
green2_gain
blue_gain
blue_gain
green2_gain
R0x305A
R0x3056
R0x3056
R0x305A
R0x305C
R0x3058
R0x3058
R0x305C
14
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Output Data Format
Output Data Format
The MT9M024 image data is read out in a progressive scan. Valid image data is
surrounded by horizontal and vertical blanking (see Figure 8). The amount of horizontal
row time (in clocks) is programmable through R0x300C. The amount of vertical frame
time (in rows) is programmable through R0x300A. Line_Valid (LV) is HIGH during the
shaded region of Figure 8. Optional Embedded Register setup information and Histogram statistic information are available in first 2 and last row of image data.
Figure 8:
Spatial Illustration of Image Readout
P0,0 P0,1 P0,2.....................................P0,n-1 P0,n
P1,0 P1,1 P1,2.....................................P1,n-1 P1,n
00 00 00 .................. 00 00 00
00 00 00 .................. 00 00 00
HORIZONTAL
BLANKING
VALID IMAGE
Pm-1,0 Pm-1,1.....................................Pm-1,n-1 Pm-1,n
Pm,0 Pm,1.....................................Pm,n-1 Pm,n
00 00 00 .................. 00 00 00
00 00 00 .................. 00 00 00
00 00 00 ..................................... 00 00 00
00 00 00 ..................................... 00 00 00
00 00 00 .................. 00 00 00
00 00 00 .................. 00 00 00
VERTICAL/HORIZONTAL
BLANKING
VERTICAL BLANKING
00 00 00 ..................................... 00 00 00
00 00 00 ..................................... 00 00 00
00 00 00 .................. 00 00 00
00 00 00 .................. 00 00 00
Readout Sequence
Typically, the readout window is set to a region including only active pixels. The user has
the option of reading out dark regions of the array, but if this is done, consideration must
be given to how the sensor reads the dark regions for its own purposes.
MT9M024_DS Rev. G Pub. 4/15 EN
15
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Output Data Format
Parallel Output Data Timing
The output images are divided into frames, which are further divided into lines. By
default, the sensor produces 968 rows of 1284 columns each. The FV and LV signals indicate the boundaries between frames and lines, respectively. PIXCLK can be used as a
clock to latch the data. For each PIXCLK cycle, with respect to the falling edge, one 12-bit
pixel datum outputs on the DOUT pins. When both FV and LV are asserted, the pixel is
valid. PIXCLK cycles that occur when FV is de-asserted are called vertical blanking.
PIXCLK cycles that occur when only LV is de-asserted are called horizontal blanking.
Figure 9:
Default Pixel Output Timing
PIXCLK
FV
LV
DOUT[11:0]
P0
Vertical Blanking
Horiz Blanking
P1
P2
P3
P4
Valid Image Data
Pn
Horiz Blanking
Vertical Blanking
LV and FV
The timing of the FV and LV outputs is closely related to the row time and the frame time.
FV will be asserted for an integral number of row times, which will normally be equal to
the height of the output image.
LV will be asserted during the valid pixels of each row. The leading edge of LV will be
offset from the leading edge of FV by 6 PIXCLKs. Normally, LV will only be asserted if FV
is asserted; this is configurable as described below.
LV Format Options
The default situation is for LV to be de-asserted when FV is de-asserted. By configuring
R0x306E[1:0], the LV signal can take two different output formats. The formats for
reading out four lines and two vertical blanking lines are shown in Figure 10.
MT9M024_DS Rev. G Pub. 4/15 EN
16
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Output Data Format
Figure 10:
LV Format Options
FV
Default
LV
FV
Continuous LV
LV
The timing of an entire frame is shown in Figure 16: “Line Timing and FRAME_VALID/
LINE_VALID Signals,” on page 15.
Serial Output Data Timing
The MT9M024 also uses ON Semiconductor's High-Speed Serial Pixel Interface
(“HiSPi”). The physical interface comprises differential serial data lines and a differential
clock line. The protocol layer formats the data and synchronization signals separately,
with Sync codes defined for active image boundaries. Figure 11 shows the configuration
between the HiSPi transmitter and the receiver. There are two options for HiSPi output
SLVS or HiVCM mode selectable through register 0x306E bit 9. Setting this bit to 0
selects SLVS ; setting the bit to 1 selects HiVCM.
Figure 11:
HiSPi Transmitter and Receiver Interface Block Diagram
A camera containing
the HiSPi transmitter
Tx
PHY0
A host (DSP) containing
the HiSPi receiver
Dp0
Dp0
Dn0
Dn0
Dp1
Dp1
Dn1
Dn1
Dp2
Dp2
Dn2
Dn2
Dp3
Dp3
Dn3
Dn3
Cp0
Cp0
Cn0
Cn0
Rx
PHY0
HiSPi Physical Layer
The HiSPi physical layer has four data lanes and an associated clock lane. Depending on
the sensor operating mode and data rate, it can be configured to use either 2, 3, or 4
lanes. The PHY will serialize a 12- to 20-bit data word and transmit each bit of data
MT9M024_DS Rev. G Pub. 4/15 EN
17
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Output Data Format
centered on a rising edge of the clock, the second on the following falling edge of clock.
Figure 12 shows bit transmission. In this example, the word is transmitted in order of
MSB to LSB. The receiver latches data at the rising and falling edge of the clock.
Figure 12:
Timing Diagram
TxPost
cp
….
cn
TxPre
dp
….
MSB
dn
LSB
1 UI
DLL Timing Adjustment
The MT9M024 includes a DLL to compensate for differences in group delay for each
data lane. The DLL is connected to the clock lane and each data lane, which acts as a
control master for the output delay buffers. Once the DLL has gained phase lock, each
lane can be delayed in 1/8 unit interval (UI) steps. This additional delay allows the user
to increase the setup or hold time at the receiver circuits and can be used to compensate
for skew introduced in PCB design.
Delay compensation may be set for clock and/or data lines in the hispi_timing register
R0x31C0. If the DLL timing adjustment is not required, the data and clock lane delay
settings should be set to a default code of 0x000 to reduce jitter, skew, and power dissipation.
delay
data _lane 0
MT9M024_DS Rev. G Pub. 4/15 EN
delay
delay
DATA3_DEL[2:0]
DATA2_DEL[2:0]
DATA1_DEL[2:0]
CLOCK_DEL[2:0]
Block Diagram of DLL Timing Adjustment
DATA0_DEL[2:0]
Figure 13:
delay
delay
data _lane 1 clock _lane 0 data _lane 2 data _lane 3
18
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Output Data Format
Figure 14:
Delaying the Clock with Respect to Data
1 UI
dataN (DATAN_DEL = 000)
cp (CLOCK_DEL = 000)
cp (CLOCK_DEL = 001)
cp (CLOCK_DEL = 010)
cp (CLOCK_DEL = 011)
cp (CLOCK_DEL = 100)
cp (CLOCK_DEL = 101)
c p (CLOCK_DEL = 110)
cp (CLOCK_DEL =111)
increasing CLOCK_DEL[2:0] increases clock delay
Figure 15:
Delaying Data with Respect to the Clock
cp ( CLOCK_DEL = 000)
dataN (DATAN_DEL = 000)
dataN(DATAN_DEL = 001)
dataN(DATAN_DEL = 010)
dataN(DATAN_DEL = 011)
dataN(DATAN_DEL = 100)
dataN(DATAN_DEL = 101)
dataN(DATAN_DEL = 110)
dataN(DATAN_DEL = 111)
increasing DATAN_DEL[2:0] increases data delay
t
DLLSTEP
MT9M024_DS Rev. G Pub. 4/15 EN
19
1 UI
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Output Data Format
Frame Time
The pixel clock (PIXCLK) represents the time needed to sample 1 pixel from the array.
The sensor outputs data at the maximum rate of 1 pixel per PIXCLK. One row time
(tROW) is the period from the first pixel output in a row to the first pixel output in the
next row. The row time and frame time are defined by equations in Table 3.
Figure 16:
Line Timing and FRAME_VALID/LINE_VALID Signals
...
FRAME_VALID
...
LINE_VALID
...
Number of master clocks
Table 3:
P1
A
Q
A
Q
A
P2
Frame Time (Example Based on 1280 x 960, 45 Frames Per Second)
Parameter
Name
Equation
Default Timing
at 74.25 MHz
A
Active data time
Context A: R0x3008 - R0x3004 + 1
Context B: R0x308E - R0x308A + 1
1280 pixel clocks
= 17.23s
P1
Frame start blanking
6 (fixed)
6 pixel clocks
= 0.08s
P2
Frame end blanking
6 (fixed)
6 pixel clocks
= 0.08s
Q
Horizontal blanking
R0x300C - A
370 pixel clocks
= 4.98s
A+Q (tROW)
Line (Row) time
R0x300C
1650 pixel clocks
= 22.22s
V
Vertical blanking
Context A: (R0x300A-(R0x3006-R0x3002+1)) x (A + Q)
Context B: ((R0x30AA-(R0x3090-R0x308C+1)) x (A + Q)
49,500 pixel clocks
= 666.66s
Nrows x (A + Q)
Frame valid time
Context A: ((R0x3006-R0x3002+1)*(A+Q))-Q+P1+P2
Context B: ((R0x3090-R0x308C+1)*(A+Q))-Q+P1+P2
1,584,000 pixel clocks
= 21.33ms
F
Total frame time
V + (Nrows x (A + Q))
1,633,500 pixel clocks
= 22.22ms
Sensor timing is shown in terms of pixel clock cycles (see Figure 8 on page 10). The
recommended pixel clock frequency is 74.25 MHz. The vertical blanking and the total
frame time equations assume that the integration time (coarse integration time plus fine
integration time) is less than the number of active lines plus the blanking lines:
Window Height + Vertical Blanking
(EQ 1)
If this is not the case, the number of integration lines must be used instead to determine
the frame time, (see Table 4). In this example, it is assumed that the coarse integration
time control is programmed with 2000 rows and the fine shutter width total is zero.
For Master mode, if the integration time registers exceed the total readout time, then the
vertical blanking time is internally extended automatically to adjust for the additional
integration time required. This extended value is not written back to the
frame_length_lines register. The frame_length_lines register can be used to adjust
frame-to-frame readout time. This register does not affect the exposure time but it may
extend the readout time.
MT9M024_DS Rev. G Pub. 4/15 EN
20
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Output Data Format
Table 4:
Parameter
F’
Frame Time: Long Integration Time
Name
Equation
(Number of Pixel Clock Cycles)
Default Timing
at 74.25 MHz
Total frame time (long
integration time)
Context A: (R0x3012 x (A + Q)) + R0x3014 + P1 + P2
Context B: (R0x3016 x (A + Q)) + V R0x3018 + P1 + P2
3,300,012 pixel clocks
= 44.44ms
Note:
The MT9M024 uses column parallel analog-digital converters; thus short line timing is not possible. The minimum total line time is 1650 columns (horizontal width + horizontal blanking) for
HDR mode and 1400 for linear mode. The minimum horizontal blanking is 370.
Exposure
Total integration time is the result of Coarse_Integration_Time and Fine_Integration_Time registers, and depends also on whether manual or automatic exposure is selected.
The actual total integration time, tINT is defined as:
tINT = tINTCoarse - 410 - tINTFine
(EQ 2)
= (number of lines of integration x line time) - (410 pixel clocks of conversion time overhead) - (number of pixels of integration x pixel time)
where:
– Number of Lines of Integration (Auto Exposure Control: Enabled)
When automatic exposure control (AEC) is enabled, the number of lines of integration may vary from frame to frame, with the limits controlled by R0x311E (minimum auto exposure time) and R0x311C (maximum auto exposure time).
– Number of Lines of Integration (Auto Exposure Control: Disabled)
If AEC is disabled, the number of lines of integration equals the value in R0x3012
(context A) or R0x3016 (context B).
– Number of Pixels of Integration
The number of fine shutter width pixels is independent of AEC mode (enabled or
disabled):
• Context A: the number of pixels of integration equals the value in R0x3014.
• Context B: the number of pixels of integration equals the value in R0x3018. Maximum value for tINTFine is line length pixel clocks - 611.
Typically, the value of the Coarse_Integration_Time register is limited to the number of
lines per frame (which includes vertical blanking lines), such that the frame rate is not
affected by the integration time. For more information on coarse and fine integration
time settings limits, please refer to the Register Reference document.
Note:
In HDR mode, there are specific limitations on coarse_integration_time due to the
number of line buffers available. Please refer to the section called “HDR Specific
Exposure Settings” on page 19.
For best image quality, it is recommended that the integration time be set to two rows or
greater for the shortest exposure, particularly for monochrome sensors. For linear mode,
this would be the coarse integration time (R0x3012). For HDR mode, the integration
time should be set such that the T3 exposure is 2 rows or greater. Setting the exposure
time to 1 row may result in non-uniformity between rows.
MT9M024_DS Rev. G Pub. 4/15 EN
21
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
High Dynamic Range Mode
High Dynamic Range Mode
By default, the sensor powers up in Linear Mode, however, the MT9M024 can be configured to run in HDR mode. The HDR scheme used is multi-exposure HDR. This allows
the sensor to handle 120dB of dynamic range. The sensor also features a linear mode. In
HDR mode, the sensor sequentially captures three exposures by maintaining 3 separate
read and reset pointers that are interleaved within the rolling shutter readout. The intermediate pixel values are stored in line buffers while waiting for the 3 exposures values to
be present. As soon as a pixel's 3 exposure values are available, they are combined to
create a linearized 20-bit value for each pixel’s response. This 20-bit value is then optionally compressed back to a 12- or 14-bit value for output. For 14-bit mode, the
compressing is lossless. In 12-bit mode, there is minimal data loss. Figure 17 shows the
HDR data compression:
Figure 17:
HDR Data Compression
Digital output
code
Decompressed linear
output
ADC max code
K2 = knee point 2
K1 = knee point 1
Piece-wise Compressed
Signal Output From
Sensor
Pout = P
Signal Response to Light Intensity
MT9M024_DS Rev. G Pub. 4/15 EN
22
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
High Dynamic Range Mode
The HDR mode is selected when Operation_Mode_Ctrl, R0x3082[1:0] = 0. Further
controls on exposure time limits and compressing are controlled by R0x3082[5:2], and
R0x31D0. More details can be found in the MT9M024 Register Reference.
In HDR mode, when compression is used, there are two types of knee-points: (i) T1/T2
and T2/T3 capture knee-points and (ii) POUT and POUT2 compression knee-points
(Figure 17). Aligning the capture knee-points on top of the compression knee-points,
can avoid code losses (SNR loss) in the compression. Table 5 and Table 6 below show the
knee points for the different modes. Alternatively, the sensor automatically reports the
knee points and can be read directly from registers R0x319A and R0x319C.
Table 5:
Knee Points for Compression to 14 Bits
T1/T2
Exposure Ratio
(R1)
R0x3082[3:2]
POUT1
= P1
P2
POUT2 = (P2 - P1)/
R1 + POUT1
4x
2
12
4096
214
7168
8x
212
4096
215
7680
16x
212
4096
216
7936
Table 6:
P1
T2/T3
Exposure Ratio
(R2)
R0x3082[5:4]
PMAX
POUTMAX
= (PMAX - P2)/
(R1*R2) + POUT2
4x
8x
16x
4x
8x
16x
4x
8x
16x
216
217
218
217
218
219
218
219
220
10240
10752
11008
10752
11264
11520
11008
11520
11776
Knee Points for Compression to 12 Bits
T1/T2
Exposure Ratio
(R1)
R0x3082[3:2]
POUT1
= P1
P2
POUT2 = (P2 - P1)/
(R1* 4)+ POUT1
4x
11
2
2048
214
2944
8x
211
2048
215
3008
16x
211
2048
216
3040
MT9M024_DS Rev. G Pub. 4/15 EN
P1
23
T2/T3
Exposure Ratio
(R2)
R0x3082[5:4]
PMAX
POUTMAX
= (PMAX - P2)/
(R1*R2*4) + POUT2
4x
8x
16x
4x
8x
16x
4x
8x
16x
216
217
218
217
218
219
218
219
220
3712
3840
3904
3776
3904
3968
3808
3936
4000
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
High Dynamic Range Mode
HDR Specific Exposure Settings
In HDR mode, pixel values are stored in line buffers while waiting for all 3 exposures to
be available for final pixel data combination. There are 42 line buffers used to store intermediate T1 data. Due to this limitation, the maximum coarse integration time possible is
equal to 42*T1/T2 lines.
For example, if R0x3082[3:2] = 2, the sensor is set to have T1/T2 ratio = 16x. Therefore the
maximum number of integration lines is 42*16 = 672 lines. If coarse integration time is
greater than this, the T2 integration time will stay at 42. The sensor will calculate the
ratio internally,enabling the linearization to be performed. If companding is being than
relinearization would still follow the programmed ratio. For example if the T1/T2 ratio
was programmed to 16x but coarse integration was increased beyond 672 than one
would still use the 16x relinearization formulas.
An additional limitation is the maximum number of exposure lines in relation to the
frame_length_lines register. In Linear mode, as described on page 20, maximum
coarse_integration_time = frame_length_lines - 1. However in HDR mode, since the
coarse integration time register controls T1, the max coarse_integration time is
frame_length_lines - 45.
Putting the two criteria listed above together, it can be summarized as follows:
maximum coarse_integration_time = minimum  42  T1  T2, frame_length_lines – 45 
(EQ 3)
In HDR mode, subline integration is not utilized. As such, fine integration time register
changes will have no effect on the image.
There is also a limitation of the minimum number of exposure lines that can be used.
This is summarized in the following formula:
minimum coarse_integration_time =  0.5 *  T1  T2   T2  T3 
(EQ 4)
Due to limitation on the internal floating point calculation, the exact ratio specified by
the RATIO_T2_T3 (R0x3082[5:4]) may not be achievable.
When using companded output in combination with certain exposure ratios (other than
T1/T2 = 16x and T2/T3 = 16x), digital gain needs to be set to a fixed value. Table below
provides the proper digital gain settings for each T1/T2 and T2/T3 ratio.
Table 7:
MT9M024_DS Rev. G Pub. 4/15 EN
Digital Gain Setting for Each T1/T2 and T2/T3Ratio
T1/T2 Ratio
T2/T3 Ratio
Setting for Digital Gain Register
(0x305E Context A or 0x30C4 Context B)
4
4
4
8
8
8
16
16
16
4
8
16
4
8
16
4
8
16
0x02h
0x04h
0x08h
0x04h
0x08h
0x10h
0x08h
0x10h
Any legal value
24
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
High Dynamic Range Mode
Motion Compensation
In typical multi-exposure HDR systems, motion artifacts can be created when objects
move during the T1, T2 or T3 integration time. When this happens, edge artifacts can
potentially be visible and might look like a ghosting effect.
To correct this feature, the MT9M024 has special 2D motion compensation circuitry that
detects motion artifacts and corrects the image accordingly.
There are two motion compensation options available. One using the default HDR
motion compensation by setting R0x318C[14] = 1. Additional parameters are available to
control the extent of motion detection and correction as per the requirements of the
specific application. These can be set in R0x318C–R0x3190. The other is using the DLO
method of HDR combination. When using DLO, R0x318C[14] is ignored. DLO is
enabled by setting R0x3190[13] = 1. Noise filtering is enabled by setting R0x3190[14] = 1.
For more information, please refer to the MT9M024 Register Reference document.
MT9M024_DS Rev. G Pub. 4/15 EN
25
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Real-Time Context Switching
Real-Time Context Switching
In the MT9M024, the user may switch between two full register sets (listed in Table 8) by
writing to a context switch change bit in R0x30B0[13]. This context switch will change all
registers (no shadowing) at the frame start time and have the new values apply to the
immediate next exposure and readout time.
Table 8:
Real-Time Context-Switch Registers
Register Number
Register Description
Context A
Context B
Y_Addr_Start
R0x3002
R0x308C
X_Addr_Start
R0x3004
R0x308A
Y_Addr_End
R0x3006
R0x3090
X_Addr_End
R0x3008
R0x308E
Coarse_Integration_Time
R0x3012
R0x3016
Fine_Integration_Time
R0x3014
R0x3018
Y_Odd_Inc
R0x30A6
R0x30A8
R0x30B0[5:4]
R0x30B0[9:8]
Green1_Gain (GreenR)
R0x3056
R0x30BC
Blue_Gain
R0x3058
R0x30BE
Red_Gain
R0x305A
R0x30C0
Green2_Gain (GreenB)
R0x305C
R0x30C2
Column Gain
Global_Gain
R0x305E
R0x30C4
Frame_Length_Lines
R0x300A
R0x30AA
R0x3032[1:0]
R0x3032[5:4]
0x3082
0x3084
Digital_Binning
Operation_Mode_Ctrl
Features
See the MT9M024 Register Reference for additional details.
Reset
The MT9M024 may be reset by using RESET_BAR (active LOW) or the reset register.
Hard Reset of Logic
The RESET_BAR pin can be connected to an external RC circuit for simplicity. The
recommended RC circuit uses a 10k resistor and a 0.1F capacitor. The rise time for the
RC circuit is 1s maximum.
Soft Reset of Logic
Soft reset of logic is controlled by the R0x301A Reset register. Bit 0 is used to reset the
digital logic of the sensor while preserving the existing two-wire serial interface configuration. Furthermore, by asserting the soft reset, the sensor aborts the current frame it is
processing and starts a new frame. This bit is a self-resetting bit and also returns to “0”
during two-wire serial interface reads.
MT9M024_DS Rev. G Pub. 4/15 EN
26
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Features
Clocks
The MT9M024 requires one clock input (EXTCLK).
PLL-Generated Master Clock
The PLL contains a prescaler to divide the input clock applied on EXTCLK, a VCO to
multiply the prescaler output, and two divider stages to generate the output clock. The
clocking structure is shown in Figure 18. PLL control registers can be programmed to
generate desired master clock frequency.
Note:
Figure 18:
The PLL control registers must be programmed while the sensor is in the software
Standby state. The effect of programming the PLL divisors while the sensor is in the
streaming state is undefined.
PLL-Generated Master Clock PLL Setup
PLL Input
Clock
EXTCLK
Pre PLL
Div
(PFD)
Pre_pll_clk_div
PLL Output
Clock
SYSCLK
PLL
Multiplier
(VCO)
PLL Output
Div 1
PLL Output
Div 2
pll_multiplier
vt_sys_clk_div
vt_pix_clk_div
PIXCLK
The PLL is enabled by default on the MT9M024. To configure and use the PLL:
1. Bring the MT9M024 up as normal; make sure that fEXTCLK is between 6 and 50MHz
and ensure the sensor is in software standby (R0x301A-B[2]= 0). PLL control registers
must be set in software standby.
2. Set pll_multiplier, pre_pll_clk_div, vt_sys_clk_siv, and vt_pix_clk_div based on the
desired input (fEXTCLK) and output (fPIXCLK) frequencies. Determine the M, N, P1, and
P2 values to achieve the desired fPIXCLK using this formula:
fPIXCLK= (fEXTCLK × M) / (N × P1 x P2)
where
M = PLL_Multiplier
N = Pre_PLL_Clk_Div
P1 = Vt_Sys_Clk_Div
P2 = Vt_PIX_Clk_Div
3. Wait 1ms to ensure that the VCO has locked.
4. Set R0x301A[2]=1 to enable streaming and to switch from EXTCLK to the PLL-generated clock.
Notes:
1. The PLL can be bypassed at any time (sensor will run directly off EXTCLK) by setting
R0x30B0[14]=1. The PLL is always bypassed in software standby mode. To disable the
PLL, the sensor must be in standby mode (R0x301A[2] = 0)
2. The following restrictions apply to the PLL tuning parameters:
32  M  255
1  N  63
MT9M024_DS Rev. G Pub. 4/15 EN
27
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Features
1  P1  16(P1 = 1, 2, 4, 6,8, 10, 12, 14, 16)
4  P2  16
3. The VCO frequency, defined as f VCO = f EXTCLK  M  N must be within
384-768 MHz.
4. When PLL_Multiplier is odd, 2 MHz <= fEXTCLK / N <= 24 MHz
5. If using HiSPi output mode, use the following settings for P2 (Vt_Pix_Clk_Div).
5a. If 20-bit mode (4 lanes): set P2 (R0x302A) = 5
5b. If 12-/14-bit mode (3 lanes): set P2 (R0x302A) = 5
5c. If 12-bit mode (2 lanes): set P2 (R0x302A) = 6
5d. If 14-bit mode (2 lanes): set P2 (R0x302A) = 7
The user can utilize the Register Wizard tool accompanying DevWare to generate PLL
settings given a supplied input clock and desired output frequency.
Spread-Spectrum Clocking
To facilitate improved EMI performance, the external clock input allows for spread spectrum sources, with no impact on image quality. Limits of the spread spectrum input
clock are:
• 5% maximum clock modulation
• 35 KHz maximum modulation frequency
• Accepts triangle wave modulation, as well as sine or modified triangle modulations.
Stream/Standby Control
The sensor supports two standby modes: Hard Standby and Soft Standby. In both
modes, external clock can be optionally disabled to further minimize power consumption. If this is done, then the “Power-Up Sequence” on page 54 must be followed.
Soft Standby
Soft Standby is a low power state that is controlled through register R0x301A[2].
Depending on the value of R0x301A[4], the sensor will go to standby after completion of
the current frame readout (default behavior) or after the completion of the current row
readout. When the sensor comes back from Soft Standby, previously written register
settings are still maintained. Soft standby will not occur if the TRIGGER pin is held high.
A specific sequence needs to be followed to enter and exit from Soft Standby.
Entering Soft Standby:
1. Set R0x301A[2] = 0 and drive the TRIGGER pin LOW.
2. External clock can be turned off to further minimize power consumption (Optional)
Exiting Soft Standby:
1. Enable external clock if it was turned off
2. R0x301A[2] = 1 or drive the TRIGGER pin HIGH.
MT9M024_DS Rev. G Pub. 4/15 EN
28
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Features
Hard Standby
Hard Standby puts the sensor in lower power state; previously written register settings
are still maintained.
A specific sequence needs to be followed to enter and exit from Hard Standby.
Entering Hard Standby:
1. R0x301A[8] = 1
2. Assert STANDBY pin
3. External clock can be turned off to further minimize power consumption (Optional)
Exiting Hard Standby:
1. Enable external clock if it was turned off
2. De-assert STANDBY pin
3. Set R0x301A[8] = 0
Window Control
Registers x_addr_start, x_addr_end, y_addr_start, and y_addr_end control the size and
starting coordinates of the image window.
The exact window height and width out of the sensor is determined by the difference
between the Y address start and end registers or the X address start and end registers,
respectively.
The MT9M024 allows different window sizes for context A and context B.
Blanking Control
Horizontal blank and vertical blank times are controlled by the line_length_pck and
frame_length_lines registers, respectively.
• Horizontal blanking is specified in terms of pixel clocks. It is calculated by subtracting
the X window size from the line_length_pck register. The minimum horizontal
blanking is 370 pixel clocks.
• Vertical blanking is specified in terms of numbers of lines. It is calculated by
subtracting the Y window size from the frame_length_lines register. The minimum
vertical blanking is 26 lines.
The actual imager timing can be calculated using Table 3 on page 15 and Table 4 on
page 16, which describe the Line Timing and FV/LV signals.
When in HDR mode, the maximum size is 1280 x 960.
MT9M024_DS Rev. G Pub. 4/15 EN
29
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Features
Readout Modes
Digital Binning
By default, the resolution of the output image is the full width and height of the FOV as
defined above. The output resolution can be reduced by digital binning. For RGB and
monochrome mode, this is set by the register R0x3032. For Context A, use bits [1:0], for
Context B, use bits [5:4]. Available settings are:
00 = No binning
01 = Horizontal binning
10 = Horizontal and vertical binning
Binning gives the advantage of reducing noise at the cost of reduced resolution. When
both horizontal and vertical binning are used, a 2x improvement in SNR is achieved,
therefore improving low light performance. Binning results in a smaller resolution
image, but the FOVs between the binned and unbinned images are the same.
Bayer Space Resampling
All of the pixels in the FOV contribute to the output image in digital binning mode. This
can result in a more pleasing output image with reduced subsampling artifacts. It also
improves low-light performance. For RGB mode, resampling can be enabled by setting
of register 0x306E[4] = 1.
Mirror
Column Mirror Image
By setting R0x3040[14] = 1, the readout order of the columns is reversed, as shown in
Figure 19. The starting Bayer color pixel is maintained in this mode by a 1-pixel shift in
the imaging array.
When using horizontal mirror mode, the user must retrigger column correction. Please
refer to the column correction section to see the procedure for column correction retriggering. Bayer resampling must be enabled, by setting bit 4 of register 0x306E[4] = 1.
Figure 19:
Eight Pixels in Normal and Column Mirror Readout Modes
LV
Normal readout
DOUT[11:0]
G0[11:0] R0[11:0] G1[11:0] R1[11:0] G2[11:0] R2[11:0] G3[11:0] R3[11:0]
Reverse readout
DOUT[11:0]
G3[11:0] R3[11:0] G2[11:0] R2[11:0] G1[11:0] R1[11:0] G0[11:0] R0[11:0]
Row Mirror Image
By setting R0x3040[15] = 1, the readout order of the rows is reversed as shown in
Figure 20. The starting Bayer color pixel is maintained in this mode by a 1-pixel shift in
the imaging array. When using horizontal mirror mode, the user must retrigger column
correction. Please refer to the column correction section to see the procedure for
column correction retriggering.
MT9M024_DS Rev. G Pub. 4/15 EN
30
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Features
Figure 20:
Six Rows in Normal and Row Mirror Readout Modes
FV
Normal readout
Row0 [11:0] Row1 [11:0] Row2 [11:0] Row3 [11:0] Row4 [11:0] Row5 [11:0]
DOUT[11:0]
Reverse readout
DOUT[11:0]
Row5 [11:0] Row4[11:0] Row3 [11:0] Row2[11:0] Row1 [11:0]
Row0[11:0]
Maintaining a Constant Frame Rate
Maintaining a constant frame rate while continuing to have the ability to adjust certain
parameters is the desired scenario. This is not always possible, however, because register
updates are synchronized to the read pointer, and the shutter pointer for a frame is
usually active during the readout of the previous frame. Therefore, any register changes
that could affect the row time or the set of rows sampled causes the shutter pointer to
start over at the beginning of the next frame.
By default, the following register fields cause a “bubble” in the output rate (that is, the
vertical blank increases for one frame) if they are written in video mode, even if the new
value would not change the resulting frame rate. The following list shows only a few
examples of such registers; a full listing can be seen in the MT9M024 Register Reference.
• x_addr_start
• x_addr_end
• y_addr_start
• y_addr_end
• frame_length_lines
• line_length_pclk
• coarse_integration_time
• fine_integration_time
• read_mode
The size of this bubble is (Integration_Time × tROW ), calculating the row time according
to the new settings.
The Coarse_Integration_Time and Fine_Integration_Time fields may be written to
without causing a bubble in the output rate under certain circumstances. Because the
shutter sequence for the next frame often is active during the output of the current
frame, this would not be possible without special provisions in the hardware. Writes to
these registers take effect two frames after the frame they are written, which allows the
integration time to increase without interrupting the output or producing a corrupt
frame (as long as the change in integration time does not affect the frame time).
Synchronizing Register Writes to Frame Boundaries
Changes to most register fields that affect the size or brightness of an image take effect
on two frames after the one during which they are written. These fields are noted as
“synchronized to frame boundaries” in the MT9M024 Register Reference. To ensure that
a register update takes effect on the next frame, the write operation must be completed
after the leading edge of FV and before the trailing edge of FV.
MT9M024_DS Rev. G Pub. 4/15 EN
31
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Features
As a special case, in single frame mode, register writes that occur after FV but before the
next trigger will take effect immediately on the next frame, as if there had been a Restart.
However, if the trigger for the next frame occurs during FV, register writes take effect as
with video mode.
Fields not identified as being frame-synchronized are updated immediately after the
register write is completed. The effect of these registers on the next frame can be difficult
to predict if they affect the shutter pointer.
Restart
To restart the MT9M024 at any time during the operation of the sensor, write a “1” to the
Restart register (R0x301A[1] = 1). This has two effects: first, the current frame is interrupted immediately. Second, any writes to frame-synchronized registers and the shutter
width registers take effect immediately, and a new frame starts (in video mode). The
current row completes before the new frame is started, so the time between issuing the
Restart and the beginning of the next frame can vary by about tROW.
Image Acquisition Modes
The MT9M024 supports two image acquisition modes: video(master) and single frame.
Video
The video mode takes pictures by scanning the rows of the sensor twice. On the first
scan, each row is released from reset, starting the exposure. On the second scan, the row
is sampled, processed, and returned to the reset state. The exposure for any row is therefore the time between the first and second scans. Each row is exposed for the same duration, but at slightly different point in time, which can cause a shear in moving subjects as
is typical with electronic rolling shutter sensors.
Single Frame
The single-frame mode operates similar to the video mode. It also scans the rows of the
sensor twice, first to reset the rows and second to read the rows. Unlike video mode
where a continuous stream of images are output from the image sensor, the single-frame
mode outputs a single frame in response to a high state placed on the TRIGGER input
pin. As long as the TRIGGER pin is held in a high state, new images will be read out. After
the TRIGGER pin is returned to a low state, the image sensor will not output any new
images and will wait for the next high state on the TRIGGER pin.
The TRIGGER pin state is detected during the vertical blanking period (i.e. the FV signal
is low). The pin is level sensitive rather than edge sensitive. As such, image integration
will only begin when the sensor detects that the TRIGGER pin has been held high for 3
consecutive clock cycles. If the trigger signal is applied to multiple sensors at the same
time, the single frame output of the sensors will be synchronized to within 1 PIXCLK if is
PLL disabled or 2 PIXCLKs if PLL is enabled.
During integration time of single-frame mode and video mode, the FLASH output pin is
at high.
Continuous Trigger
In certain applications, multiple sensors need to have their video streams synchronized
(E.g. surround view or panorama view applications). The TRIGGER pin can also be used
to synchronize output of multiple image sensors together and still get a video stream.
This is called continuous trigger mode. Continuous trigger is enabled by holding the
MT9M024_DS Rev. G Pub. 4/15 EN
32
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Features
TRIGGER pin high. Alternatively, the TRIGGER pin can be held high until the stream bit
is enabled (R0x301A[2]=1) then can be released for continuous synchronized video
streaming.
If the TRIGGER pins for all connected MT9M024 sensors are connected to the same
control signal, all sensors will receive the trigger pulse at the same time. If they are
configured to have the same frame timing, then the usage of the TRIGGER pin guarantees that all sensors will be synchronized within 1 PIXCLK cycle if PLL is disabled, or 2
PIXCLK cycles if PLL is enabled.
With continuous trigger mode, the application can now make use of the video streaming
mode while guaranteeing that all sensor outputs are synchronized. As long as the initial
trigger for the sensors takes place at the same time, all subsequent video streams will be
synchronous.
Temperature Sensor
The MT9M024 sensor has a built-in PTAT-based temperature sensor, accessible through
registers, that is capable of measuring die junction temperature.
The temperature sensor can be enabled by writing R0x30B4[0]=1 and R0x30B4[4]=1.
After this, the temperature sensor output value can be read from R0x30B2[10:0].
The value read out from the temperature sensor register is an ADC output value that
needs to be converted downstream to a final temperature value in degrees Celsius. Since
the PTAT device characteristic response is quite linear in the temperature range of operation required, a simple linear function in the format of listed in the equation below can
be used to convert the ADC output value to the final temperature in degrees Celsius.
Temperature = slope  R0x30B2  10:0  + T 0
(EQ 5)
For this conversion, a minimum of 2 known points are needed to construct the line
formula by identifying the slope and y-intercept "T0". These calibration values can be
read from registers R0x30C6 and R0x30C8 which correspond to value read at 70°C and
55°C respectively. Once read, the slope and y-intercept values can be calculated and
used in the above equation.
For more information on the temperature sensor registers, refer to the MT9M024
Register Reference.
MT9M024_DS Rev. G Pub. 4/15 EN
33
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Features
Automatic Exposure Control
The integrated automatic exposure control (AEC) is responsible for ensuring that
optimal settings of exposure and gain are computed and updated every other frame.
AEC can be enabled or disabled by R0x3100[0].
When AEC is disabled (R0x3100[0] = 0), the sensor uses the manual exposure value in
coarse and fine shutter width registers and the manual gain value in the gain registers.
When AEC is enabled (R0x3100[0]=1), the target luma value in linear mode is set by
R0x3102. For the MT9M024 this target luma has a default value of 0x0800 or about half
scale. For HDR mode, the luma target maximum auto exposure value is limited by
R0x311C; the minimum auto exposure is limited by R0x311E. These values are in units of
line-times.
The exposure control measures current scene luminosity by accumulating a histogram
of pixel values while reading out a frame. It then compares the current luminosity to the
desired output luminosity. Finally, the appropriate adjustments are made to the exposure time and gain. All pixels are used, regardless of color or mono mode. In HDR mode,
the coarse and fine integration time is the longest integration time of the three integration, the other two shorter integration are generated automatically base on the predefined exposure ratios. When using non-default HDR exposure ratios, auto_dg_en
should not be enabled (R0x3100[4] = 0) due to required digital gains as documented in
Table 7, “Digital Gain Setting for Each T1/T2 and T2/T3Ratio,” on page 19.
Embedded Data and Statistics
The MT9M024 has the capability to output image data and statistics embedded within
the frame timing. There are 2 types of information embedded within the frame readout:
1. Embedded Data: If enabled, these are displayed on the 2 rows immediately before the
first active pixel row is displayed.
2. Embedded Statistics: If enabled, these are displayed on the 2 rows immediately after
the last active pixel row is displayed.
Note:
Figure 21:
Embedded data and embedded statistics must be enabled or disabled together.
Frame Format with Embedded Data Lines Enabled
Register Data
Image
HBlank
Status & Statistics Data
VBlank
MT9M024_DS Rev. G Pub. 4/15 EN
34
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Features
Embedded Data
The embedded data contains the configuration of the image being displayed. This
includes all register settings used to capture the current frame. The registers embedded
in these rows are as follows:
Line 1: Registers R0x3000 to R0x312F
Line 2: Registers R0x3136 to R0x31BF, R0x31D0 to R0x31FF
Note:
All non-defined registers will have a value of 0.
In parallel mode, since the pixel word depth is 12-bits/pixel, the sensor 16-bit register
data will be transferred over 2 pixels where the register data will be broken up into 8msb
and 8lsb. The alignment of the 8bit data will be on the 8MSB bits of the 12-bit pixel word.
For example, if a register value of 0x1234 is to be transmitted, it will be transmitted over
2, 12-bit pixels as follows: 0x120, 0x340.
The first pixel of each line in the embedded data is a tag value of 0x0A0. This signifies
that all subsequent data is 8 bit data aligned to the MSB of the 12-bit pixel.
The figure below summarizes how the embedded data transmission looks like. It should
be noted that data, as shown in Figure 22, is aligned to the MSB of each word:
Figure 22:
Format of Embedded Data Output within a Frame
data_format_
code =8'h0A
8'hAA
{register_
address_MSB}
8'hA5
{register_
address_LSB}
8'h5A
{register_
value_MSB}
8'h5A
Data line 1
data_format_
code =8'h0A
Data line 2
8'hAA
{register_
value_LSB}
8'h5A
{register_
address_MSB}
8'hA5
{register_
value_LSB}
{register_
address_LSB}
8'h5A
{register_
value_MSB}
8'h5A
8'h5A
The data embedded in these rows are as follows:
• 0x0A0 - identifier
• 0xAA0
• Register Address MSB of the first register
• 0xA50
• Register Address LSB of the first register
• 0x5A0
• Register Value MSB of the first register addressed
• 0x5A0
• Register Value LSB of the first register addressed
• 0x5A0
• Register Value MSB of the register at first address + 2
• 0x5A0
• Register Value LSB of the register at first address + 2
• 0x5A0
• etc.
MT9M024_DS Rev. G Pub. 4/15 EN
35
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Features
Embedded Statistics
The embedded statistics contain frame identifiers and histogram information of the
image in the frame. This can be used by downstream auto-exposure algorithm blocks to
make decisions about exposure adjustment.
This histogram is divided into 244 bins with a bin spacing of 64 evenly spaced bins for
digital code values 0 to 212, 120 evenly spaced bins for values 212 to 216, 60 evenly spaced
bins for values 216 to 220. In HDR with a 16x exposure ratio, this approximately corresponds to the T1, T2, T3 exposures respectively.
The first pixel of each line in the embedded statistics is a tag value of 0x0B0. This signifies that all subsequent statistics data is 10 bit data aligned to the MSB of the 12-bit pixel.
The figure below summarizes how the embedded statistics transmission looks like. It
should be noted that data, as shown in Figure 23, is aligned to the msb of each word:
Figure 23:
Format of Embedded Statistics Output within a Frame
data_format_
code = 8'h0B
# words =
10'h1EC
stats line 1
data_format_
code = 8'h0B
# words =
10'h00C
{2'b00,frame
_count MSB}
{2'b00,frame
_count LSB}
histogram
bin1 [19:10]
histogram
bin1 [9:0]
mean
[19:10]
mean
[9:0]
lowEndMean
[19:10]
lowEndMean
[9:0]
{2'b00,frame
_ID MSB}
{2'b00,frame
_ID LSB}
histogram
bin0 [19:10]
histogram
bin0 [9:0]
histogram
bin243 [19:10]
histogram
bin243 [9:0]
8'h07
histBegin
[19:10]
histBegin
[9:0]
histEnd
[19:10]
histEnd
[9:0]
perc_lowEnd
[19:10]
perc_lowEnd
[9:0]
norm_abs_
dev [19:10]
norm_abs_
dev [9:0]
8'h07
stats line 2
8'h07
The statistics embedded in these rows are as follows:
Line 1:
• 0x0B0 - (identifier)
• Register 0x303A - frame_count
• Register 0x31D2 - frame ID
• Histogram data - histogram bins 0-243
Line 2:
• 0x0B0 (identifier)
• Mean
• Histogram Begin
• Histogram End
• Low End Histogram Mean
• Percentage of Pixels Below Low End Mean
• Normal Absolute Deviation
Gain
Digital Gain
Digital gain can be controlled globally by R0x305E (Context A) or R0x30C4 (Context B).
There are also registers that allow individual control over each Bayer color (GreenR,
GreenB, Red, Blue).
MT9M024_DS Rev. G Pub. 4/15 EN
36
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Features
The format for digital gain setting is xxx.yyyyy where 0b00100000 represents a 1x gain
setting and 0b00110000 represents a 1.5x gain setting. The step size for yyyyy is 0.03125
while the step size for xxx is 1. Therefore to set a gain of 2.09375 one would set digital
gain to 01000011.
Analog Gain
The MT9M024 has a column parallel architecture and therefore has an Analog gain stage
per column.
There are 2 stages of analog gain, the first stage can be set to 1x, 2x, 4x or 8x. This can be
set in R0x30B0[5:4](Context A) or R0x30B0[9:8] (Context B). The second stage is capable
of setting an additional 1x or 1.25x gain which can be set in R0x3EE4[9:8].
This allows the maximum possible analog gain to be set to 10x.
Black Level Correction
Black level correction is handled automatically by the image sensor. No adjustments are
provided except to enable or disable this feature. Setting R0x30EA[15] disables the automatic black level correction. Default setting is for automatic black level calibration to be
enabled.
The automatic black level correction measures the average value of pixels from a set of
optically black lines in the image sensor. The pixels are averaged as if they were lightsensitive and passed through the appropriate gain. This line average is then digitally
low-pass filtered over many frames to remove temporal noise and random instabilities
associated with this measurement. The new filtered average is then compared to a
minimum acceptable level, low threshold, and a maximum acceptable level, high
threshold. If the average is lower than the minimum acceptable level, the offset correction value is increased by a predetermined amount. If it is above the maximum level, the
offset correction value is decreased by a predetermined amount. The high and low
thresholds have been calculated to avoid oscillation of the black level from below to
above the targeted black level.
Row-wise Noise Correction
Row (Line)-wise Noise Correction is handled automatically by the image sensor. No
adjustments are provided except to enable or disable this feature. Clearing R0x3044[10]
disables the row noise correction. Default setting is for row noise correction to be
enabled.
Row-wise noise correction is performed by calculating an average from a set of optically
black pixels at the start of each line and then applying each average to all the active
pixels of the line.
Column Correction
The MT9M024 uses column parallel readout architecture to achieve fast frame rate.
Without any corrections, the consequence of this architecture is that different column
signal paths have slightly different offsets that might show up on the final image as
structured fixed pattern noise.
MT9M024 has column correction circuitry that measures this offset and removes it from
the image before output. This is done by sampling dark rows containing tied pixels and
measuring an offset coefficient per column to be corrected later in the signal path.
MT9M024_DS Rev. G Pub. 4/15 EN
37
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Features
Column correction can be enabled/disabled via R0x30D4[15]. Additionally, the number
of rows used for this offset coefficient measurement is set in R0x30D4[3:0]. By default
this register is set to 0x7, which means that 8 rows are used. This is the recommended
value. Other control features regarding column correction can be viewed in the
MT9M024 Register reference. Any changes to column correction settings need to be
done when the sensor streaming is disabled and the appropriate triggering sequence
must be followed as described below.
Column Correction Triggering
Column correction requires a special procedure to trigger depending on which state the
sensor is in.
Column Triggering on Startup
When streaming the sensor for the first time after powerup, a special sequence needs to
be followed to make sure that the column correction coefficients are internally calculated properly.
1. Follow proper power up sequence for power supplies and clocks.
2. Apply sequencer settings if needed (Linear or HDR mode).
3. Apply frame timing and PLL settings as required by application.
4. Set analog gain to 1x and low conversion gain (R0x30B0=0x1300)
5. Enable column correction and settings (R0x30D4=0xE007).
6. Disable auto re-trigger for change in conversion gain or col_gain, and enable column
correction always (R0x30BA = 0x0008).
7. Enable streaming (R0x301A[2]=1)or drive the TRIGGER pin HIGH.
8. Wait 9 frames to settle (First frame after coming up from standby is internally column
correction disabled).
9. Disable streaming (R0x301A[2]=0).
After this, the sensor has calculated the proper column correction coefficients and the
sensor is ready for streaming. Any other settings (including gain, integration time and
conversion gain etc.) can be done afterwards without affecting column correction.
Column Correction Retriggering Due to Mode Change
Since column offsets is sensitive to changes in the analog signal path, such changes
require column correction circuitry to be retriggered for the new path. Examples of such
mode changes include: horizontal mirror, vertical mirror, changes to column correction
settings.
When such changes take place, the following sequence needs to take place:
1. Disable streaming (R0x301A[2]=0) or drive the TRIGGER pin LOW.
2. Enable streaming (R0x301A[2]=1) or drive the TRIGGER pin HIGH.
3. Wait 9 frames to settle.
Note:
The above steps are not needed if the sensor is being reset (soft or hard reset) upon
the mode change.
Defective Pixel Correction
Defective Pixel Correction is intended to compensate for defective pixels by replacing
their value with a value based on the surrounding pixels, making the defect less noticeable to the human eye. The defect pixel correction feature supports up to 200 defects.
MT9M024_DS Rev. G Pub. 4/15 EN
38
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Features
The locations of defective pixels are stored in a table on chip during the manufacturing
process; this table is accessible through the two-wire serial interface. There is no provision for later augmenting the defect table entries.
The DPC algorithm is one-dimensional, calculating the resulting averaged pixel value
based on nearby pixels within a row. The algorithm distinguishes between color and
monochrome parts; for color parts, the algorithm uses nearest neighbor in the same
color plane.
At high gain, long exposure, and high temperature conditions, the performance of this
function can degrade.
Test Patterns
The MT9M024 has the capability of injecting a number of test patterns into the top of
the datapath to debug the digital logic. With one of the test patterns activated, any of the
datapath functions can be enabled to exercise it in a deterministic fashion. Test patterns
are selected by Test_Pattern_Mode register (R0x3070). Only one of the test patterns can
be enabled at a given point in time by setting the Test_Pattern_Mode register according
to Table 9. When test patterns are enabled the active area will receive the value specified
by the selected test pattern and the dark pixels will receive the value in Test_Pattern_Green (R0x3074 and R0x3078) for green pixels, Test_Pattern_Blue (R0x3076) for
blue pixels, and Test_Pattern_Red (R0x3072) for red pixels.
Note:
Table 9:
Turn off black level calibration (BLC) when Test Pattern is enabled.
Test Pattern Modes
Test_Pattern_Mode
Test Pattern Output
0
1
2
3
256
No test pattern (normal operation)
Solid color test pattern
100% color bar test pattern
Fade-to-gray color bar test pattern
Walking 1s test pattern (12-bit)
Color Field
When the color field mode is selected, the value for each pixel is determined by its color.
Green pixels will receive the value in Test_Pattern_Green, red pixels will receive the value
in Test_Pattern_Red, and blue pixels will receive the value in Test_Pattern_Blue.
Vertical Color Bars
When the vertical color bars mode is selected, a typical color bar pattern will be sent
through the digital pipeline.
Walking 1s
When the walking 1s mode is selected, a walking 1s pattern will be sent through the
digital pipeline. The first value in each row is 1.
MT9M024_DS Rev. G Pub. 4/15 EN
39
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Two-Wire Serial Register Interface
Two-Wire Serial Register Interface
The two-wire serial interface bus enables read/write access to control and status registers within the MT9M024.The interface protocol uses a master/slave model in which a
master controls one or more slave devices. The sensor acts as a slave device. The master
generates a clock (SCLK) that is an input to the sensor and is used to synchronize transfers. Data is transferred between the master and the slave on a bidirectional signal
(SDATA). SDATA is pulled up to VDD_IO off-chip by a 1.5k resistor. Either the slave or
master device can drive SDATA LOW—the interface protocol determines which device is
allowed to drive SDATA at any given time.
The protocols described in the two-wire serial interface specification allow the slave
device to drive SCLKLOW; the MT9M024 uses SCLK as an input only and therefore never
drives it LOW.
Protocol
Data transfers on the two-wire serial interface bus are performed by a sequence of lowlevel protocol elements:
1. a (repeated) start condition
2. a slave address/data direction byte
3. an (a no) acknowledge bit
4. a message byte
5. a stop condition
The bus is idle when both SCLK and SDATA are HIGH. Control of the bus is initiated with a
start condition, and the bus is released with a stop condition. Only the master can
generate the start and stop conditions.
Start Condition
A start condition is defined as a HIGH-to-LOW transition on SDATA while SCLK is HIGH.
At the end of a transfer, the master can generate a start condition without previously
generating a stop condition; this is known as a “repeated start” or “restart” condition.
Stop Condition
A stop condition is defined as a LOW-to-HIGH transition on SDATA while SCLK is HIGH.
Data Transfer
Data is transferred serially, 8 bits at a time, with the MSB transmitted first. Each byte of
data is followed by an acknowledge bit or a no-acknowledge bit. This data transfer
mechanism is used for the slave address/data direction byte and for message bytes.
One data bit is transferred during each SCLK clock period. SDATA can change when SCLK
is LOW and must be stable while SCLK is HIGH.
MT9M024_DS Rev. G Pub. 4/15 EN
40
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Two-Wire Serial Register Interface
Slave Address/Data Direction Byte
Bits [7:1] of this byte represent the device slave address and bit [0] indicates the data
transfer direction. A “0” in bit [0] indicates a WRITE, and a “1” indicates a READ. The
default slave addresses used by the MT9M024 are 0x20 (write address) and 0x21 (read
address) in accordance with the specification. Alternate slave addresses of 0x30 (write
address) and 0x31 (read address) can be selected by enabling and asserting the SADDR
input.
An alternate slave address can also be programmed through R0x31FC.
Message Byte
Message bytes are used for sending register addresses and register write data to the slave
device and for retrieving register read data.
Acknowledge Bit
Each 8-bit data transfer is followed by an acknowledge bit or a no-acknowledge bit in the
SCLK clock period following the data transfer. The transmitter (which is the master when
writing, or the slave when reading) releases SDATA. The receiver indicates an acknowledge bit by driving SDATA LOW. As for data transfers, SDATA can change when SCLK is
LOW and must be stable while SCLK is HIGH.
No-Acknowledge Bit
The no-acknowledge bit is generated when the receiver does not drive SDATA LOW
during the SCLK clock period following a data transfer. A no-acknowledge bit is used to
terminate a read sequence.
Typical Sequence
A typical READ or WRITE sequence begins by the master generating a start condition on
the bus. After the start condition, the master sends the 8-bit slave address/data direction
byte. The last bit indicates whether the request is for a read or a write, where a “0” indicates a write and a “1” indicates a read. If the address matches the address of the slave
device, the slave device acknowledges receipt of the address by generating an acknowledge bit on the bus.
If the request was a WRITE, the master then transfers the 16-bit register address to which
the WRITE should take place. This transfer takes place as two 8-bit sequences and the
slave sends an acknowledge bit after each sequence to indicate that the byte has been
received. The master then transfers the data as an 8-bit sequence; the slave sends an
acknowledge bit at the end of the sequence. The master stops writing by generating a
(re)start or stop condition.
If the request was a READ, the master sends the 8-bit write slave address/data direction
byte and 16-bit register address, the same way as with a WRITE request. The master then
generates a (re)start condition and the 8-bit read slave address/data direction byte, and
clocks out the register data, eight bits at a time. The master generates an acknowledge
bit after each 8-bit transfer. The slave’s internal register address is automatically incremented after every 8 bits are transferred. The data transfer is stopped when the master
sends a no-acknowledge bit.
MT9M024_DS Rev. G Pub. 4/15 EN
41
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Two-Wire Serial Register Interface
Single READ from Random Location
This sequence (Figure 24) starts with a dummy WRITE to the 16-bit address that is to be
used for the READ. The master terminates the WRITE by generating a restart condition.
The master then sends the 8-bit read slave address/data direction byte and clocks out
one byte of register data. The master terminates the READ by generating a no-acknowledge bit followed by a stop condition. Figure 24 shows how the internal register address
maintained by the MT9M024 is loaded and incremented as the sequence proceeds.
Figure 24:
Single READ from Random Location
Previous Reg Address, N
S
Slave Address
0 A Reg Address[15:8]
S = start condition
P = stop condition
Sr = restart condition
A = acknowledge
A = no-acknowledge
A
Reg Address, M
Reg Address[7:0]
A Sr
Slave Address
1 A
M+1
Read Data
A P
slave to master
master to slave
Single READ from Current Location
This sequence (Figure 25) performs a read using the current value of the MT9M024
internal register address. The master terminates the READ by generating a no-acknowledge bit followed by a stop condition. The figure shows two independent READ
sequences.
Figure 25:
Single READ from Current Location
Previous Reg Address, N
S
Slave Address
1 A
Reg Address, N+1
Read Data
A P
S
Slave Address
N+2
1 A
Read Data
A P
Sequential READ, Start from Random Location
This sequence (Figure 26) starts in the same way as the single READ from random location (Figure 24). Instead of generating a no-acknowledge bit after the first byte of data
has been transferred, the master generates an acknowledge bit and continues to
perform byte READs until “L” bytes have been read.
Figure 26:
Sequential READ, Start from Random Location
Previous Reg Address, N
S
Slave Address
0 A Reg Address[15:8]
M+1
Read Data
MT9M024_DS Rev. G Pub. 4/15 EN
M+2
A
A
Reg Address, M
Reg Address[7:0] A Sr
M+3
Read Data
A
42
Slave Address
M+L-2
Read Data
1 A
M+L-1
A
Read Data
M+1
Read Data
A
M+L
A P
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Two-Wire Serial Register Interface
Sequential READ, Start from Current Location
This sequence (Figure 27) starts in the same way as the single READ from current location (Figure 25). Instead of generating a no-acknowledge bit after the first byte of data
has been transferred, the master generates an acknowledge bit and continues to
perform byte READs until “L” bytes have been read.
Figure 27:
Sequential READ, Start from Current Location
Previous Reg Address, N
S
Slave Address
1 A
N+1
Read Data
A
N+2
Read Data
A
N+L-1
Read Data
A
Read Data
N+L
A P
Single WRITE to Random Location
This sequence (Figure 28) begins with the master generating a start condition. The slave
address/data direction byte signals a WRITE and is followed by the HIGH then LOW
bytes of the register address that is to be written. The master follows this with the byte of
write data. The WRITE is terminated by the master generating a stop condition.
Figure 28:
Single WRITE to Random Location
Previous Reg Address, N
S
0 A Reg Address[15:8]
Slave Address
A
Reg Address, M
Reg Address[7:0]
Write Data
A
M+1
A P
A
Sequential WRITE, Start at Random Location
This sequence (Figure 29) starts in the same way as the single WRITE to random location
(Figure 28). Instead of generating a no-acknowledge bit after the first byte of data has
been transferred, the master generates an acknowledge bit and continues to perform
byte WRITEs until “L” bytes have been written. The WRITE is terminated by the master
generating a stop condition.
Figure 29:
Sequential WRITE, Start at Random Location
Previous Reg Address, N
S
Slave Address
0 A Reg Address[15:8]
M+1
Write Data
MT9M024_DS Rev. G Pub. 4/15 EN
M+2
A
A
Reg Address, M
Reg Address[7:0]
M+3
Write Data
43
A
A
Write Data
M+L-2
Write Data
M+1
A
M+L-1
A
Write Data
M+L
A
P
A
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Spectral Characteristics
Spectral Characteristics
Figure 30:
Quantum Efficiency – Color Sensor
70
Quantum Efficiency (%)
60
red
green
blue
50
40
30
20
10
0
350 400 450 500 550 600 650 700 750 800 850
900 950 1000 1050
Wavelength (nm)
MT9M024_DS Rev. G Pub. 4/15 EN
44
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Spectral Characteristics
Figure 31:
Estimated Quantum Efficiency – Monochrome Sensor
MT9M024_DS Rev. G Pub. 4/15 EN
45
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Electrical Specifications
Electrical Specifications
Unless otherwise stated, the following specifications apply to the following conditions:
VDD = 1.8V – 0.10/+0.15; VDD_IO = VDD_PLL = VAA = VAA_PIX = 2.8V ± 0.3V;
TA = -30°C to +70°C; output load = 10pF;
frequency = 74.25 MHz; HiSPi off.
Two-Wire Serial Register Interface
The electrical characteristics of the two-wire serial register interface (SCLK, SDATA) are
shown in Figure 32 and Table 10.
Figure 32:
Two-Wire Serial Bus Timing Parameters
SDATA
tLOW
tf
tf
tSU;DAT
tr
tHD;STA
tr
tBUF
SCLK
tHD;STA
S
tHD;DAT
Note:
Table 10:
tHIGH
tSU;STA
tSU;STO
Sr
P
S
Read sequence: For an 8-bit READ, read waveforms start after WRITE command and register
address are issued.
Two-Wire Serial Bus Characteristics
f
EXTCLK = 27 MHz; VDD = 1.8V; VDD_IO = 2.8V; VAA = 2.8V; VAA_PIX = 2.8V;
VDD_PLL = 2.8V; VDD_DAC = 2.8V; TA = 25°C
Standard-Mode
Parameter
SCLK Clock Frequency
Fast-Mode
Symbol
Min
Max
Min
Max
Unit
fSCL
0
100
0
400
KHz
tHD;STA
4.0
-
0.6
-
S
4.7
-
1.3
-
S
Hold time (repeated) START condition.
After this period, the first clock pulse is
generated
LOW period of the SCLK clock
t
HIGH period of the SCLK clock
tHIGH
4.0
-
0.6
-
S
Set-up time for a repeated START
condition
tSU;STA
4.7
-
0.6
-
S
Data hold time:
tHD;DAT
04
3.455
06
0.95
S
Data set-up time
tSU;DAT
-
1006
-
nS
MT9M024_DS Rev. G Pub. 4/15 EN
LOW
250
46
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Electrical Specifications
Table 10:
Two-Wire Serial Bus Characteristics
f
EXTCLK = 27 MHz; VDD = 1.8V; VDD_IO = 2.8V; VAA = 2.8V; VAA_PIX = 2.8V;
VDD_PLL = 2.8V; VDD_DAC = 2.8V; TA = 25°C
Standard-Mode
Parameter
Symbol
Rise time of both SDATA and SCLK signals
t
Fall time of both SDATA and SCLK signals
t
Set-up time for STOP condition
Bus free time between a STOP and START
condition
Capacitive load for each bus line
Serial interface input pin capacitance
SDATA max load capacitance
SDATA pull-up resistor
Notes:
r
Min
Max
Fast-Mode
Min
Max
Unit
7
-
1000
20 + 0.1Cb
300
nS
f
-
300
20 + 0.1Cb7
300
nS
SU;STO
4.0
-
0.6
-
S
BUF
4.7
-
1.3
-
S
Cb
-
400
-
400
pF
CIN_SI
-
3.3
-
3.3
pF
t
t
CLOAD_SD
-
30
-
30
pF
RSD
1.5
4.7
1.5
4.7
K
This table is based on I2C standard (v2.1 January 2000). Philips Semiconductor.
Two-wire control is I2C-compatible.
All values referred to VIHmin = 0.9 VDD and VILmax = 0.1VDD levels. Sensor EXCLK = 27 MHz.
A device must internally provide a hold time of at least 300 ns for the SDATA signal to bridge the
undefined region of the falling edge of SCLK.
5. The maximum tHD;DAT has only to be met if the device does not stretch the LOW period (tLOW) of
the SCLK signal.
6. A Fast-mode I2C-bus device can be used in a Standard-mode I2C-bus system, but the requirement
tSU;DAT 250 ns must then be met. This will automatically be the case if the device does not stretch
the LOW period of the SCLK signal. If such a device does stretch the LOW period of the SCLK signal, it
must output the next data bit to the SDATA line tr max + tSU;DAT = 1000 + 250 = 1250 ns (according
to the Standard-mode I2C-bus specification) before the SCLK line is released.
7. Cb = total capacitance of one bus line in pF.
1.
2.
3.
4.
I/O Timing
By default, the MT9M024 launches pixel data, FV, and LV with the falling edge of PIXCLK.
The expectation is that the user captures DOUT[11:0], FV, and LV using the rising edge of
PIXCLK. This can be changed using register R0x3028.
See Figure 33 and Table 11 for I/O timing (AC) characteristics.
MT9M024_DS Rev. G Pub. 4/15 EN
47
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Electrical Specifications
Figure 33:
I/O Timing Diagram
tR
t RP
tF
t FP
90%
90%
10%
10%
t EXTCLK
EXTCLK
PIXCLK
t PD
Data[11:0]
Pxl _0
Pxl _1
Pxl _2
Pxl _n
t PLH
LINE_VALID/
FRAME_VALID
Table 11:
t PFL
t PFH
t PLL
FRAME_VALID trails
LINE_VALID by 6 PIXCLKs.
FRAME_VALID leads LINE_VALID by 6 PIXCLKs.
I/O Timing Characteristics (2.8V VDD_IO)1
Symbol
Definition
Min
Typ
Max
Unit
fEXTCLK
Input clock frequency
6
–
50
MHz
tEXTCLK
Input clock period
20
–
166
ns
tR
Input clock rise time
–
3
–
ns
tF
Input clock fall time
–
3
–
ns
tJITTER
Input clock jitter
–
–
600
ps
tRP
Pixclk rise time
PCLK slew rate = 6
1.2
–
2.9
ns
tFP
Pixclk fall time
PCLK slew rate = 6
1.2
–
2.9
ns
Pixclk duty cycle
45
50
55
%
fPIXCLK
PIXCLK frequency2
6
–
74.25
MHz
tPD
PIXCLK to data valid
PCLK slew rate = 6,
Parallel slew rate = 7
–2
–
2.5
ns
tPFH
PIXCLK to FV HIGH
PCLK slew rate = 6,
Parallel slew rate = 7
–2
–
2.5
ns
tPLH
PIXCLK to LV HIGH
PCLK slew rate = 6,
Parallel slew rate = 7
–2
–
2.5
ns
tPFL
PIXCLK to FV LOW
PCLK slew rate = 6,
Parallel slew rate = 7
–2
–
2.5
ns
tPLL
PIXCLK to LV LOW
PCLK slew rate = 6,
Parallel slew rate = 7
–2
–
2.5
ns
Notes:
MT9M024_DS Rev. G Pub. 4/15 EN
Condition
1. Minimum and maximum values are taken at the temperature and voltage limits; for instance, 70°C
at 2.5 V, and -30°C at 3.1 V. All values are taken at the 50% transition point. The loading used is 10
pF.
2. Jitter from PIXCLK is already taken into account as the data of all the output parameters.
48
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Electrical Specifications
I/O Timing Characteristics (1.8V VDD_IO)1
Table 12:
Symbol
Definition
Condition
Min
fEXTCLK
Input clock frequency
6
tEXTCLK
Input clock period
20
tR
Input clock rise time
-
tF
Input clock fall time
-
Typ
Max
Unit
-
50
MHz
-
166
ns
3
-
ns
3
-
ns
tJITTER
Input clock jitter
–
–
600
ps
tRP
Pixel rise time
PCLK slew rate = 6
1.8
-
4.8
ns
tFP
Pixel fall time
PCLK slew rate = 6
1.7
-
4.5
ns
45
50
55
%
74.25
MHz
Pixel duty cycle
2
6
fPIXCLK
PIXCLK frequency
tPD
PIXCLK to data valid
PCLK slew rate = 6,
Parallel slew rate = 7
–2.5
–
2
ns
tPFH
PIXCLK to FV HIGH
PCLK slew rate = 6,
Parallel slew rate = 7
–2.5
–
2
ns
tPLH
PIXCLK to LV HIGH
PCLK slew rate = 6,
Parallel slew rate = 7
–2.5
–
2
ns
tPFL
PIXCLK to FV LOW
PCLK slew rate = 6,
Parallel slew rate = 7
–2.5
–
2
ns
tPLL
PIXCLK to LV LOW
PCLK slew rate = 6,
Parallel slew rate = 7
–2.5
–
2
ns
Notes:
1. Minimum and maximum values are taken at the temperature and voltage limits; for instance, 70°C
at 1.7 V, and -30°C at 1.95V. All values are taken at the 50% transition point. The loading used is
10 pF.
2. Jitter from PIXCLK is already taken into account as the data of all the output parameters.
I/O Rise Slew Rate (2.8V VDD_IO)1
Table 13:
Parallel Slew Rate
(R0x306E[15:13])
Conditions
Min
Typ
Max
Units
7
6
5
4
3
2
1
0
Default
Default
Default
Default
Default
Default
Default
Default
1.08
0.77
0.58
0.44
0.32
0.23
0.16
0.10
1.77
1.26
0.95
0.70
0.51
0.37
0.25
0.15
2.72
1.94
1.46
1.08
0.78
0.56
0.38
0.22
V/ns
V/ns
V/ns
V/ns
V/ns
V/ns
V/ns
V/ns
Notes:
MT9M024_DS Rev. G Pub. 4/15 EN
1. Minimum and maximum values are taken at the temperature and voltage limits; for instance, 70°C
at 2.5V, and -30°C at 3.1 V. The loading used is 10 pF.
49
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Electrical Specifications
I/O Fall Slew Rate (2.8V VDD_IO)1
Table 14:
Parallel Slew Rate
(R0x306E[15:13])
Conditions
Min
Typ
Max
Units
7
6
5
4
3
2
1
0
Default
Default
Default
Default
Default
Default
Default
Default
1.00
0.76
0.60
0.46
0.35
0.25
0.17
0.11
1.62
1.24
0.98
0.75
0.56
0.40
0.27
0.16
2.41
1.88
1.50
1.16
0.86
0.61
0.41
0.24
V/ns
V/ns
V/ns
V/ns
V/ns
V/ns
V/ns
V/ns
Notes:
1. Minimum and maximum values are taken at the temperature and voltage limits; for instance, 70°C
at 2.5 V, and -30°C at 3.1V. The loading used is 10 pF.
I/O Rise Slew Rate (1.8V VDD_IO)1
Table 15:
Parallel Slew Rate
(R0x306E[15:13])
Conditions
7
6
5
4
3
2
1
0
Default
Default
Default
Default
Default
Default
Default
Default
Notes:
Min
Typ
Max
Units
0.41
0.30
0.24
0.19
0.14
0.10
0.07
0.04
0.65
0.47
0.37
0.28
0.21
0.15
0.10
0.06
1.10
0.79
0.61
0.46
0.34
0.24
0.16
0.10
V/ns
V/ns
V/ns
V/ns
V/ns
V/ns
V/ns
V/ns
1. Minimum and maximum values are taken at the temperature and voltage limits; for instance, 70°C
at 1.7 V, and -30°C at 1.95V. The loading used is 10 pF.
I/O Fall Slew Rate (1.8V VDD_IO)1
Table 16:
Parallel Slew Rate
(R0x306E[15:13])
Conditions
Min
Typ
Max
Units
7
6
5
4
3
2
1
0
Default
Default
Default
Default
Default
Default
Default
Default
0.42
0.32
0.26
0.20
0.16
0.12
0.08
0.05
0.68
0.51
0.41
0.32
0.24
0.18
0.12
0.07
1.11
0.84
0.67
0.52
0.39
0.28
0.19
0.11
V/ns
V/ns
V/ns
V/ns
V/ns
V/ns
V/ns
V/ns
Notes:
MT9M024_DS Rev. G Pub. 4/15 EN
1. Minimum and maximum values are taken at the temperature and voltage limits; for instance, 70°C
at 1.7 V, and -30°C at 1.95V. The loading used is 10 pF.
50
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Electrical Specifications
DC Electrical Characteristics
The DC electrical characteristics are shown in the tables below.
Table 17:
DC Electrical Characteristics
Symbol
Definition
VDD
Core digital voltage
Condition
Min
Typ
Max
Unit
1.7
1.8
1.95
V
VDD_IO
I/O digital voltage
1.7/2.5
1.9/3.1
V
2.5
1.8/
2.8
2.8
VAA
Analog voltage
VAA_PIX
3.1
V
VDD_PLL
Pixel supply voltage
2.5
2.8
3.1
V
PLL supply voltage
2.5
2.8
3.1
V
VDD_SLVS
HiSPi supply voltage for SLVS mode
0.3
0.4
0.6
V
VDD_SLVS
HiSPi supply voltage for HiVcm
mode
1.7
1.8
1.95
V
VIH
Input HIGH voltage
VDD_IO*0.7
–
–
V
VIL
Input LOW voltage
–
–
VDD_IO*0.3
V
–
–
20
A
No pull-up resistor; VIN = VDD_IO or
DGND
IIN
Input leakage current
VOH
Output HIGH voltage
VDD_IO-0.3
–
–
V
VOL
Output LOW voltage
–
–
0.4
V
IOH
Output HIGH current
At specified VOH
-22
–
–
mA
IOL
Output LOW current
At specified VOL
–
–
22
mA
Caution
Table 18:
Stresses greater than those listed in Table 14 may cause permanent damage to the device.
This is a stress rating only, and functional operation of the device at these or any other conditions above those indicated in the operational sections of this specification is not implied.
Absolute Maximum Ratings
Symbol
Parameter
VSUPPLY
Power supply voltage (all supplies)
ISUPPLY
Total power supply current
IGND
Total ground current
VIN
DC input voltage
VOUT
DC output voltage
–0.3
TSTG1
Storage temperature
–40
Notes:
MT9M024_DS Rev. G Pub. 4/15 EN
Minimum
Maximum
Unit
Symbol
–0.3
4.5
V
VSUPPLY
–
200
mA
ISUPPLY
–
200
mA
IGND
–0.3
VDD_IO + 0.3
V
VIN
VDD_IO + 0.3
V
VOUT
+150
°C
TSTG1
1. Exposure to absolute maximum rating conditions for extended periods may affect reliability.
2. To keep dark current and shot noise artifacts from impacting image quality, keep operating temperature at a minimum.
51
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Electrical Specifications
Table 19:
Operating Current Consumption in Parallel Output and Linear Mode
Definition
Condition
Digital operating current
Streaming, 1280x960 45 fps
I/O digital operating current
Streaming, 1280x960 45 fps
Symbol
Min
Typ
Max
Unit
IDD1
–
63
90
mA
IDD_IO
–
35
40
mA
Analog operating current
Streaming, 1280x960 45 fps
IAA
–
30
45
mA
Pixel supply current
Streaming, 1280x960 45 fps
IAA_PIX
–
10
15
mA
IDD_PLL
–
7
15
mA
IDD1
–
63
90
mA
IDD_IO
-
35
40
mA
IAA
–
30
45
mA
PLL supply current
Streaming, 1280x960 45 fps
Digital operating current
Streaming, 720p 60 fps
I/O digital operating current
Streaming, 720p 60 fps
Analog operating current
Streaming, 720p 60 fps
Pixel supply current
Streaming, 720p 60 fps
IAA_PIX
–
10
15
mA
PLL supply current
Streaming, 720p 60f ps
IDD_PLL
–
7
15
mA
Notes:
Table 20:
1. Operating currents are measured at the following conditions:
VAA = VAA_PIX = VDD_IO = VDD_PLL = 2.8 V
VDD =1.8 V
PLL Enabled and PIXCLK = 74.25 MHz
TA = 25°C
CLOAD = 10 pF Measured in dark
Operating Current Consumption in Parallel Output and HDR Mode
Definition
Condition
Digital operating current
Streaming, 1280x960 45 fps
I/O digital operating current
Streaming, 1280x960 45 fps
Symbol
Min
Typ
Max
Unit
IDD
–
95
115
mA
IDD_IO
–
35
40
mA
Analog operating current
Streaming, 1280x960 45 fps
IAA
–
65
75
mA
Pixel supply current
Streaming, 1280x960 45 fps
IAA_PIX
–
15
20
mA
PLL supply current
Streaming, 1280x960 45 fps
IDD_PLL
–
7
15
mA
Digital operating current
Streaming, 720p 60 fps
IDD
–
95
115
mA
I/O digital operating current
Streaming, 720p 60 fps
IDD_IO
–
35
40
mA
Analog operating current
Streaming, 720p 60 fps
IAA
–
61
75
mA
Pixel supply current
Streaming, 720p 60 fps
IAA_PIX
–
15
20
mA
PLL supply current
Streaming, 720p 60 fps
IDD_PLL
–
7
15
mA
Notes:
MT9M024_DS Rev. G Pub. 4/15 EN
1. Operating currents are measured at the following conditions:
VAA = VAA_PIX = VDD_IO = VDD_PLL = 2.8 V
VDD = 1.8 V
PLL Enabled and PIXCLK = 74.25 MHz
TA= 25°C
CLOAD = 10 pF Measured in dark
52
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Electrical Specifications
Table 21:
Operating Currents in HiSPi Output and Linear Mode
Definition
Condition
Symbol
Min
Typ
Max
Unit
Digital Operating Current
Streaming 1280x960 45 fps
IDD
–
95
115
mA
I/O digital operating current
Streaming 1280x960 45 fps
IDD_IO
–
100
150
A
Analog operating current
Streaming 1280x960 45 fps
IAA
–
30
45
mA
Pixel Supply Current
Streaming 1280x960 45 fps
IAA_PIX
–
10
15
mA
PLL Supply Current
Streaming 1280x960 45 fps
IDD_PLL
–
7
15
mA
Current LoVCM Mode
Streaming 1280x960 45 fps
IDD_SLVS
–
8
15
mA
–
16
25
mA
SLVS Supply Current
Current HiVCM Mode
Streaming 1280x960 45 fps
Digital Operating Current
Streaming 720p 60 fps
IDD
–
95
115
mA
I/O digital operating current
Streaming 720p 60 fps
IDD_IO
–
100
150
A
Analog operating current
Streaming 720p 60 fps
IAA
–
30
45
mA
Pixel Supply Current
Streaming 720p 60 fps
IAA_PIX
–
10
15
mA
PLL Supply Current
Streaming 720p 60 fps
IDD_PLL
–
7
15
mA
Current LoVCM Mode
Streaming 720p 60 fps
IDD_SLVS
–
8
15
mA
–
16
25
mA
SLVS Supply Current
Current HiVCM Mode
Streaming 1280x960 60 fps
Notes:
MT9M024_DS Rev. G Pub. 4/15 EN
1. Operating currents are measured at the following conditions:
VAA = VAA_PIX = VDD_IO = VDD_PLL = 2.8V
VDD = 1.8V
VDD_SLVS = 0.4V (LoVCM)
VDD_SLVS = 1.8V (HiVCM)
PLL Enabled and PIXCLK = 74.25 Mhz
TA = 25°C
Cload = 10pF Measured in dark
53
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Electrical Specifications
Table 22:
Operating Current in HiSPi Output and HDR Mode
Definition
Condition
Symbol
Min
Digital Operating Current
Streaming 1280x960 45 fps
IDD
–
I/O digital operating current
Streaming 1280x960 45 fps
IDD_IO
–
Typ
Max
Unit
115
130
mA
100
150
A
Analog operating current
Streaming 1280x960 45 fps
IAA
–
65
75
mA
Pixel Supply Current
Streaming 1280x960 45 fps
IAA_PIX
–
15
20
mA
PLL Supply Current
Streaming 1280x960 45 fps
IDD_PLL
–
7
15
mA
Current LoVCM Mode
Streaming 1280x960 45 fps
IDD_SLVS
–
8
15
mA
SLVS Supply Current
–
16
25
mA
Current HiVCM Mode
Streaming 1280x960 45 fps
Digital Operating Current
Streaming 720p 60 fps
IDD
–
115
130
mA
I/O digital operating current
Streaming 720p 60 fps
IDD_IO
–
100
150
A
Analog operating current
Streaming 720p 60 fps
IAA
–
65
75
mA
Pixel Supply Current
Streaming 720p 60 fps
IAA_PIX
–
15
20
mA
PLL Supply Current
Streaming 720p 60 fps
IDD_PLL
–
7
15
mA
Current LoVCM Mode
Streaming 720p 60 fps
IDD_SLVS
–
8
15
mA
–
16
25
mA
SLVS Supply Current
Current HiVCM Mode
Streaming 1280x960 60fps
Notes:
MT9M024_DS Rev. G Pub. 4/15 EN
1. Operating currents are measured at the following conditions:
VAA = VAA_PIX = VDD_IO = VDD_PLL = 2.8 V
VDD = 1.8 V
VDD_SLVS = 0.4 V (LoVCM)
VDD_SLVS = 1.8 V (HiVCM)
PLL Enabled and PIXCLK=74.25 MHz
TA = 25°C
Cload = 10 pF Measured in dark
54
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Electrical Specifications
Table 23:
Standby Current Consumption
Definition
Condition
Hard standby (clock off)
Hard standby (clock on)
Soft standby (clock off)
Soft standby (clock on)
Symbol
Min
Typ
Max
Unit
Analog, 2.8 V
–
–
Digital, 1.8 V
–
–
30
100
μA
85
2500
μA
Analog, 2.8 V
–
Digital, 1.8 V
–
–
30
100
μA
–
1.55
4
mA
Analog, 2.8 V
–
–
85
100
μA
Digital, 1.8 V
–
–
85
2500
μA
Analog, 2.8 V
–
–
30
100
μA
Digital, 1.8 V
–
–
1.55
4
mA
Notes:
Figure 34:
1. Analog – VAA + VAA_PIX + VDD_PLL
2. Digital – VDD + VDD_IO
Power Supply Rejection Ratio
P o w e r S u p p ly R e je c tio n R a t io
70
60
50
)
B4 0
(d
R
R
S30
P
20
10
0
1000
10000
100000
1000000
F r e q u e n cy ( H z )
MT9M024_DS Rev. G Pub. 4/15 EN
55
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Electrical Specifications
HiSPi Electrical Specifications
The HiSPi transmitter electrical specifications are listed at 700 MHz.
Table 24:
Input Voltage and Current (HiSPi Power Supply 0.4 V)
Measurement Conditions: Max Freq 700 MHz
Parameter
Symbol
Min
Typ
Max
Unit
IDD_SLVS
–
10
15
A
HiSPi common mode voltage
(driving 100 load)
VCMD
VDD_SLVS x 0.45
VDD_SLVS/2
VDD_SLVS x 0.55
V
HiSPi differential output voltage
(driving 100 load)
|VOD|
VDD_SLVS x 0.36
VDD_SLVS/2
VDD_SLVS x 1.64
V
Change in VCM between logic 1 and 0
VCM
25
mV
Change in |VOD| between logic 1 and
0
|VOD|
25
mV
Supply current (PWRHiSPi)
(driving 100 load)
Vod noise margin
NM
-30
30
Difference in VCM between any two
channels
|VCM|
50
mV
Difference in VOD between any two
channels
|VOD|
100
mV
Common-mode AC voltage (pk)
without VCM cap termination
VCM_ac
50
mV
Common-mode AC voltage (pk) with
VCM cap termination
VCM_ac
25
mV
Max overshoot peak |VOD|
VOD_ac
1.2*|VOD|
V
Max overshoot Vdiff pk-pk
Vdiff_pkpk
2.4*|VOD|
V
Eye Height
Veye
0.5*VDD_SLVS
Ro
35
Single-ended output impedance
Output impedance mismatch
Table 25:
50
Ro
70

20
%
Input Voltage and Current (HiSPi Power Supply 1.8 V)
Measurement Conditions: Max Freq 700 MHz
Symbol
Min
Typ
Max
Unit
IDD_HiVCM
–
15
25
mA
HiSPi common mode voltage (driving 100 load)
VCMD
0.76
0.9
1.07
V
HiSPi differential output voltage (driving 100
load)
|VOD|
200
280
350
V
Parameter
Supply current (PWRHiSPi)
(driving 100 load)
Change in VCM between logic 1 and 0
 VCM
25
Change in |VOD| between logic 1 and 0
VOD|
25
VOD noise margin
Difference in VCM between any two channels
NM
-30
30
VCM|
50
VOD|
100
Common-mode AC voltage (pk) without VCMcap
termination
VCM_ac
50
Common-mode AC voltage (pk) with VCM cap
termination
VCM_ac
30
Difference in VOD between any two channels
MT9M024_DS Rev. G Pub. 4/15 EN
56
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Electrical Specifications
Table 25:
Input Voltage and Current (HiSPi Power Supply 1.8 V)
Measurement Conditions: Max Freq 700 MHz
Symbol
Parameter
Min
Typ
Max
Max overshoot peak |VOD|
VOD_ac
1.2*|VOD|
Max overshoot Vdiff pk-pk
Vdiff_pkpk
2.4*|VOD|
Eye Height
Single-ended Output impedance
320
Ro
40
70
V
100
Ro
Output impedance mismatch
Figure 35:
Veye
Unit
20
%
Differential Output Voltage for Clock or Data Pairs
VDIFFmax
VDIFFmin
0V Diff)
Output Signal is 'Cp - Cn' or 'Dp - D
Table 26:
Rise and Fall Times
Measurement Conditions: HiSPi Power Supply 0.4V or 1.8V, Max Freq 700 MHz
Parameter
Symbol
Min
Data Rate
1/UI
Max setup time from transmitter
TxPRE
TxPost
0.3
–
–
UI
CLKJITTER
–
50
–
ps
Max hold time from transmitter
Clock jitter (RMS)
Typ
Max
Unit
280
–
700
Mb/s
0.3
–
–
UI1
Rise time (20% - 80%)
RISE
–
0.325UI
–
Fall time (20% - 80%)
FALL
150ps
0.3 UI
–
50
Clock duty
PLL_DUTY
45
Bitrate Period
tpw
1.43
Eye Width
teye
0.3
55
%
3.57
ns1
UI1, 2
ttotaljit
0.2
UI1, 2
Clock Period Jitter(RMS)
tckjit
50
ps2
Clock cycle to cycle jitter (RMS)
tcyjit
100
ps2
0.1
UI1, 2
2.1
UI1, 5
Data Total jitter (pk pk)@1e-9
Clock to Data Skew
tchskew
PHY-to-PHY Skew
tPHYskew
Notes:
MT9M024_DS Rev. G Pub. 4/15 EN
-0.1
1. One UI is defined as the normalized mean time between one edge and the following edge of the
clock.
2. Taken from 0V crossing point w/ DLL off.
3. Also defined with a maximum loading capacitance of 10pF on any pin. The loading capacitance
may also need to be less for higher bitrates so the rise and fall times do not exceed the maximum
0.3UI.
4. The absolute mean skew between the Clock lane and any Data Lane in the same PHY between any
edges.
5. The absolute mean skew between any Clock in one PHY and any Data lane in any other PHY
between any edges.
6. Differential skew is defined as the skew between complementary outputs. It is measured as the
absolute time between the two complementary edges at mean VCM point.
57
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Electrical Specifications
Figure 36:
Eye Diagram for Clock and Data Signals
RISE
80%
D A T A M A SK
V d i ff
20%
T x Pr e
T x Po s t
FALL
UI/ 2
UI/ 2
V d i ff
M a x V d i ff
C L O C K M A SK
T r i g ge r/ R efe re nce
C L K JIT T ER
Figure 37:
Skew Within the PHY and Output Channels
V C MD
t C M PSK EW
MT9M024_DS Rev. G Pub. 4/15 EN
t C HSKEW1 PHY
58
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Power-On Reset and Standby Timing
Power-On Reset and Standby Timing
Power-Up Sequence
The recommended power-up sequence for the MT9M024 is shown in Figure 29. The
available power supplies (VDD_IO, VDD, VDD_SLVS, VDD_PLL, VAA, VAA_PIX) must have
the separation specified below.
1. Turn on VDD_PLL power supply.
2. After 0–10s, turn on VAA and VAA_PIX power supply.
3. After 0–10s, turn on VDD_IO power supply.
4. After the last power supply is stable, enable EXTCLK.
5. Assert RESET_BAR for at least 1ms.
6. Wait 850000 EXTCLKs (for internal initialization into software standby).
7. Configure PLL, output, and image settings to desired values.
8. Wait 1ms for the PLL to lock.
9. Set streaming mode (R0x301A[2] = 1).
Figure 38:
Power Up
VDD_PLL (2.8)
VAA_PIX
VAA (2.8)
VDD_IO (1.8/2.8)
VDD (1.8)
t0
t1
t2
t3
VDD_SLVS (0.4)
EXTCLK
t4
RESET_B
tx
t5
Hard Reset
MT9M024_DS Rev. G Pub. 4/15 EN
59
Internal
Initialization
t6
Software
Standby
PLL Lock
Streaming
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Power-On Reset and Standby Timing
Table 27:
Power-Up Sequence
Definition
3
VDD_PLL to VAA/VAA_PIX
VAA/VAA_PIX to VDD_IO
VDD_IO to VDD
VDD to VDD_SLVS
Xtal settle time
Hard Reset
Internal Initialization
PLL Lock Time
Notes:
MT9M024_DS Rev. G Pub. 4/15 EN
Symbol
Minimum
Typical
Maximum
Unit
t0
t1
t2
t3
tx
t4
t5
t6
0
0
0
0
–
12
850000
1
10
10
10
10
301
–
–
–
–
–
–
–
–
–
–
–
s
s
s
s
ms
ms
EXTCLKS
ms
1. Xtal settling time is component-dependent, usually taking about 10 – 100 ms.
2. Hard reset time is the minimum time required after power rails are settled. In a circuit where Hard
reset is held down by RC circuit, then the RC time must include the all power rail settle time and
Xtal settle time.
3. It is critical that VDD_PLL is not powered up after the other power supplies. It must be powered
before or at least at the same time as the others. If the case happens that VDD_PLL is powered after
other supplies then sensor may have functionality issues and will experience high current draw on
this supply.
60
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Power-On Reset and Standby Timing
Power-Down Sequence
The recommended power-down sequence for the MT9M024 is shown in Figure 30. The
available power supplies (VDD_IO, VDD, VDD_SLVS, VDD_PLL, VAA, VAA_PIX) must have
the separation specified below. Power may be removed from all supplies simultaneously,
and a sudden loss of power on all rails does not cause damage or affect the lifetime of the
device.
1. Disable streaming if output is active by setting standby R0x301A[2] = 0
2. The soft standby state is reached after the current row or frame, depending on configuration, has ended.
3. Turn off VDD_SLVS.
4. Turn off VDD.
5. Turn off VDD_IO
6. Turn off VAA/VAA_PIX.
7. Turn off VDD_PLL.
Figure 39:
Power Down
VDD_SLVS (0.4)
t0
VDD (1.8)
t1
V DD_IO (1.8/2.8)
t2
VAA_PIX
VAA (2.8)
t3
VDD_PLL (2.8)
EXTCLK
t4
Power Down until next Power up cycle
Table 28:
Power-Down Sequence
Definition
Symbol
Minimum
Typical
Maximum
Unit
VDD_SLVS to VDD
VDD to VDD_IO
VDD_IO to VAA/VAA_PIX
VAA/VAA_PIX to VDD_PLL
PwrDn until Next PwrUp Time
t0
t1
t2
t3
t4
0
0
0
0
100
–
–
–
–
–
–
–
–
–
–
s
s
s
s
ms
Note:
MT9M024_DS Rev. G Pub. 4/15 EN
t4 is required between power down and next power up time; all decoupling caps from regulators
must be completely discharged.
61
©Semiconductor Components Industries, LLC,2015.
63-Ball iBGA Package Outline Drawing
Figure 40:
MT9M024_DS Rev. G Pub. 4/15 EN
Package Dimensions
62
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Package Dimensions
©Semiconductor Components Industries, LLC,2015
MT9M024_DS Rev. G Pub. 4/15 EN
63
©Semiconductor Components Industries, LLC,2015
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Package Dimensions
All dimensions are in millimeters.
Note:
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Revision History
Revision History
Rev. G . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4/15/15
• Updated “Ordering Information” on page 2
Rev. F . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3/27/15
• Converted to ON Semiconductor template
• Removed Confidential marking
Rev. E . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .10/22/13
• Updated temperature range in “General Description” on page 1
• Updated Figure 2: “Typical Configuration: Serial Four-Lane HiSPi Interface,” on
page 2
• Updated Figure 3: “Typical Configuration: Parallel Pixel Data Interface,” on page 3
• Updated “Pixel Array Structure” on page 7
• Updated Figure 6: “Pixel Color Pattern Detail (Top Right Corner),” on page 8
• Updated “Default Readout Order” on page 8
• Added “Digital Gain Control” on page 9
• Added “DLL Timing Adjustment” on page 13
• Updated “Exposure” on page 16
• Updated Equation 2 on page 16
• Updated Table 8, “Real-Time Context-Switch Registers,” on page 21
• Updated “PLL-Generated Master Clock” on page 22
• Updated “Hard Standby” on page 24
• Updated title of Figure 19: “Eight Pixels in Normal and Column Mirror Readout
Modes,” on page 25
• Added note at the end of “Embedded Data and Statistics” on page 29
• Updated “Embedded Data” on page 30
• Updated Figure 23: “Format of Embedded Statistics Output within a Frame,” on
page 31
• Updated “Column Triggering on Startup” on page 33
• Updated “Column Correction Retriggering Due to Mode Change” on page 33
• Updated “I/O Timing” on page 42
• Updated Figure 33: “I/O Timing Diagram,” on page 43
• Deleted Table 9, “I/O Timing Characteristics
• Added Table 11, “I/O Timing Characteristics (2.8V Vdd_IO)1,” on page 43
• Added Table 12, “I/O Timing Characteristics (1.8V Vdd_IO)1,” on page 44
• Added Table 13, “I/O Rise Slew Rate (2.8V Vdd_IO)1,” on page 44
• Added Table 14, “I/O Fall Slew Rate (2.8V Vdd_IO)1,” on page 45
• Added Table 15, “I/O Rise Slew Rate (1.8V Vdd_IO)1,” on page 45
• Updated Table 20, “Operating Current Consumption in Parallel Output and HDR
Mode,” on page 47
• Added Figure 34: “Power Supply Rejection Ratio,” on page 50
• Updated “Power-Up Sequence” on page 54
• Updated Table 27, “Power-Up Sequence,” on page 55
Rev. D . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4/10/12
• Updated Table 1, “Pin Descriptions, 9 x 9 mm, 63-ball iBGA,” on page 5
• Updated Figure 4: “9 x 9 mm 63-Ball IBGA Package,” on page 4
MT9M024_DS Rev. G Pub. 4/15 EN
64
©Semiconductor Components Industries, LLC,2015.
MT9M024: 1/3-Inch CMOS Digital Image Sensor
Revision History
•
•
•
•
•
•
•
Updated “Hard Standby” on page 24
Updated “Embedded Data and Statistics” on page 29
Updated Table 11, “I/O Timing Characteristics (2.8V Vdd_IO)1,” on page 43
Updated Table 24, “Input Voltage and Current (HiSPi Power Supply 0.4 V),” on page 51
Updated Table 25, “Input Voltage and Current (HiSPi Power Supply 1.8 V),” on page 51
Updated Table 26, “Rise and Fall Times,” on page 52
Deleted old Table 20, “Channel, PHY, and Intra-PHY Skew
Rev. C . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3/29/11
• Updated Table 1, “Key Parameters,” on page 1
• Updated Table 2, “Available Part Numbers,” on page 1
• Updated “Exposure” on page 16
• Updated “HDR Specific Exposure Settings” on page 19
• Updated “Motion Compensation” on page 20
• Updated “PLL-Generated Master Clock” on page 22
• Table 8, “Real-Time Context-Switch Registers,” on page 21Updated “Hard Standby”
on page 24
• Updated Figure 19: “Eight Pixels in Normal and Column Mirror Readout Modes,” on
page 25
• Updated Table 17, “DC Electrical Characteristics,” on page 46
• Updated notes for Table 19, “Operating Current Consumption in Parallel Output and
Linear Mode ,” on page 47 and Table 20, “Operating Current Consumption in Parallel
Output and HDR Mode,” on page 47
• Updated Table 22, “Operating Current in HiSPi Output and HDR Mode,” on page 49
• Updated Table 23, “Standby Current Consumption ,” on page 50
• Updated conditions for Table 26, “Rise and Fall Times,” on page 52 and Table 22,
“Channel, PHY, and Intra-PHY Skew,” on page 45
Rev. B . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .10/19/10
• Updated Table 1, “Key Parameters,” on page 1
• Updated Table 10, “Two-Wire Serial Bus Characteristics,” on page 41
• Updated storage temperature max in Table 18, “Absolute Maximum Ratings,” on
page 46
Rev. A . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .9/20/10
• Initial release
ON Semiconductor and the ON logo are registered trademarks of Semiconductor Components Industries, LLC (SCILLC) or its subsidiaries in the United States and/or other countries. SCILLC owns the
rights to a number of patents, trademarks, copyrights, trade secrets, and other intellectual property. A listing of SCILLC’s product/patent coverage may be accessed at www.onsemi.com/site/pdf/
Patent-Marking.pdf. SCILLC reserves the right to make changes without further notice to any products herein. SCILLC makes no warranty, representation or guarantee regarding the suitability of its
products for any particular purpose, nor does SCILLC assume any liability arising out of the application or use of any product or circuit, and specifically disclaims any and all liability, including
without limitation special, consequential or incidental damages. “Typical” parameters which may be provided in SCILLC data sheets and/or specifications can and do vary in different applications
and actual performance may vary over time. All operating parameters, including “Typicals” must be validated for each customer application by customer’s technical experts. SCILLC does not convey
any license under its patent rights nor the rights of others. SCILLC products are not designed, intended, or authorized for use as components in systems intended for surgical implant into the body,
or other applications intended to support or sustain life, or for any other application in which the failure of the SCILLC product could create a situation where personal injury or death may occur.
Should Buyer purchase or use SCILLC products for any such unintended or unauthorized application, Buyer shall indemnify and hold SCILLC and its officers, employees, subsidiaries, affiliates, and
distributors harmless against all claims, costs, damages, and expenses, and reasonable attorney fees arising out of, directly or indirectly, any claim of personal injury or death associated with such
unintended or unauthorized use, even if such claim alleges that SCILLC was negligent regarding the design or manufacture of the part. SCILLC is an Equal Opportunity/Affirmative Action Employer.
This literature is subject to all applicable copyright laws and is not for resale in any manner.
MT9M024_DS Rev. G Pub. 4/15 EN
65
©Semiconductor Components Industries, LLC,2015 .