1/4-Inch SOC VGA CMOS Active-Pixel Digital Image Sensor

MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor
Features
1/4-Inch SOC VGA CMOS Active-Pixel Digital
Image Sensor
MT9V111 Datasheet, Rev. N
For the latest data sheet revision, please visit www.onsemi.com
Features
Table 1:
• System-On-a-Chip (SOC)—Completely integrated
camera system
• Ultra low-power, low cost CMOS image sensor
• Superior low-light performance
• Up to 30 fps progressive scan at 27 MHz for highquality video at VGA resolution
• On-chip Image Flow Processor (IFP) performs
sophisticated processing: color recovery and
correction, sharpening, gamma, lens shading
correction, on-the-fly defect correction, 2X fixed
zoom
• Image decimation to arbitrary size with smooth,
continuous zoom and pan
• Automatic exposure, white balance and black
compensation, flicker avoidance, color saturation,
and defect identification and correction, auto frame
rate, back light compensation
• Xenon and LED-type flash support
• Two-wire serial programming interface
• ITU_R BT.656 (YCbCr), YUV, 565RGB, 555RGB, and
444RGB output data formats
Parameter
Optical Format
Active Imager Size
Active Pixels
Pixel Size
Color Filter Array
Shutter Type
Maximum Data Rate/
Master Clock
Frame
Rate
VGA (640 x 480)
CIF (352 x 288)
QVGA (320 x 240)
ADC Resolution
Responsivity
Dynamic Range
SNRMAX
Supply Voltage
Power Consumption
Operating Temperature
Packaging
Applications
•
•
•
•
Key Performance Parameters
Value
1/4-inch (4:3)
3.58mm(H) x 2.69mm(V)
4.48mm (Diagonal)
640H x 480V (VGA)
5.6 um x 5.6 um
RGB Bayer Pattern
Electronic Rolling Shutter (ERS)
1213.5 MPS/2427 MHz
15 fps at 12 MHz (default),
programmable up to 30 fps
at 27 MHz
Programmable up to 60 fps
Programmable up to 90 fps
10-bit, on-chip
1.9 V/lux-sec (550nm)
60 dB
45 dB
2.8V +0.25V
<80 mW at 2.8 V, 15 fps at 12 MHz
-20°C to +60°C
44-Ball ICSP, wafer or die
Cellular phones
PDAs
PC Camera
Toys and other battery-powered products
General Description
The ON SemiconductorMT9V111 is a 1/4-inch VGA-format CMOS active-pixel digital image sensor, the result
of combining the MT9V011 image sensor core with ON
Semiconductor's third-generation digital image flow
processor technology. The MT9V111 has an active imaging pixel array of 649 x 489, capturing high-quality color
images at VGA resolution. The sensor is a complete
camera-on-a-chip solution and is designed specifically
to meet the demands of battery-powered products such
as cellular phones, PDAs, and toys. It incorporates
sophisticated camera functions on-chip and is programmable through a simple two-wire serial interface.
MT9V111_DS Rev. N 5/15 EN
1
©Semiconductor Components Industries, LLC 2015,
MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor
Ordering Information
Ordering Information
Table 2:
Available Part Numbers
Part Number
Product Description
Orderable Product Attribute Description
MT9V111D00ATCK82AC1-305
VGA 1/4" SOC
Die Sales, 305m Thickness
MT9V111D00STCK82AC1K-305
VGA 1/11" SOC
Die Sales, 305m Thickness
MT9V111IA7ATC-DP
VGA 1/13" SOC
Dry Pack with Protective Film
MT9V111IA7ATC-DR
VGA 1/4" SOC
Dry Pack without Protective Film
MT9V111IA7ATC-TP
VGA 1/4" CIS SOC
Tape & Reel with Protective Film
MT9V111IA7ATC-TR
VGA 1/4" SOC
Tape & Reel without Protective Film
MT9V111_DS Rev. N 5/15 EN
2
©Semiconductor Components Industries, LLC,2015.
MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor
Table of Contents
Table of Contents
Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1
General Description . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1
Ordering Information. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2
General Description . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .6
Ball Assignment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .8
Image Flow Processor. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .10
Output Data Ordering . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .12
Sensor Core Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .13
Electrical Specifications. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .15
Propagation Delays. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .17
Appendix A – Sensor Timing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .20
Serial Bus Description . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .21
Two-wire Serial Interface Sample Write and Read Sequences
(with Saddr = 1) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .23
Appendix B – Overview of Programming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .27
Revision History. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .31
MT9V111_DS Rev. N 5/15 EN
3
©Semiconductor Components Industries, LLC,2015.
MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor
List of Figures
List of Figures
Figure 1:
Figure 2:
Figure 3:
Figure 4:
Figure 5:
Figure 6:
Figure 7:
Figure 8:
Figure 9:
Figure 10:
Figure 11:
Figure 12:
Figure 13:
Figure 14:
Figure 15:
Figure 16:
Figure 17:
Figure 18:
Figure 19:
Figure 20:
Figure 21:
Figure 22:
Figure 23:
Figure 24:
Figure 25:
Figure 26:
Chip Block Diagram . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .6
Internal Register Grouping . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .7
Typical Configuration (Connection) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .7
44-Ball ICSP Package . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .8
Image Flow Processor Block Diagram . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .11
Sensor Core Block Diagram . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .13
Pixel Array Description . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .13
Pixel Color Pattern Detail (Top Right Corner) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .14
Spatial Illustration of Image Readout. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .14
Propagation Delays for PIXCLK and Data Out Signals . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .17
Propagation Delays for FRAME_VALID and LINE_VALID Signals. . . . . . . . . . . . . . . . . . . . . . . . . . . . . .17
Data Output Timing Diagram . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .18
Spectral Response. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .19
Die Center - Image CenterOffset . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .19
Row Timing and FRAME_VALID/LINE_VALID Signals . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .20
Timing Diagram Showing a Write to Reg0x09 with Value 0x0284 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .23
Timing Diagram Showing a Read from Reg0x09; Returned Value 0x0284 . . . . . . . . . . . . . . . . . . . . . . .23
Timing Diagram Showing a Bytewise Write to Reg0x09 with Value 0x0284. . . . . . . . . . . . . . . . . . . . . .24
Timing Diagram Showing a Bytewise Read from Reg0x09; Returned Value 0x0284 . . . . . . . . . . . . . .24
Serial Host Interface Start Condition Timing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .25
Serial Host Interface Stop Condition Timing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .25
Serial Host Interface Data Timing for Write . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .25
Serial Host Interface Data Timing for Read . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .25
Acknowledge Signal Timing After an 8-bit Write to the Sensor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26
Acknowledge Signal Timing After an 8-bit Read from the Sensor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26
44-Ball ICSP Package Outline Drawing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .30
MT9V111_DS Rev. N 5/15 EN
4
©Semiconductor Components Industries, LLC,2015.
MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor
List of Tables
List of Tables
Table 1:
Table 2:
Table 2:
Table 3:
Table 4:
Table 5:
Table 6:
Table 7:
Table 8:
Table 9:
Table 10:
Table 11:
Table 12:
Table 13:
Table 14:
Table 15:
Key Performance Parameters. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1
Available Part Numbers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2
Ball Description. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .8
YUV/YCbCr Output Data Ordering. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .12
RGB Output Data Ordering in Default Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .12
Byte Ordering in 8 + 2 Bypass Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .12
DC Electrical Characteristics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .15
AC Electrical Characteristics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .16
Frame Time . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .20
Frame Time—Larger than One Frame . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .20
Non-Default Register Settings Optimizing 15 fps at 12 MHz Operation . . . . . . . . . . . . . . . . . . . . . . . .27
Non-Default Register Settings Optimizing 30 fps at 27 MHz Operation . . . . . . . . . . . . . . . . . . . . . . . .27
Relation Between IFP R55[9:5] Setting and Frame Rate Range . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .27
Decimation, Zoom, and Pan . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .28
YCbCr Settings. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .29
YUV Settings. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .29
MT9V111_DS Rev. N 5/15 EN
5
©Semiconductor Components Industries, LLC,2015.
MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor
General Description
General Description
This SOC VGA CMOS image sensor features ON Semiconductor’s breakthrough, lownoise CMOS imaging technology that achieves CCD image quality (based on signal-tonoise ratio and low-light sensitivity) while maintaining the inherent size, cost and integration advantages of CMOS.
The MT9V111 is a fully-automatic, single-chip camera, requiring only a power supply,
lens and clock source for basic operation. Output video is streamed via a parallel eightbit DOUT port as shown in Figure 1. Output pixel clock is used to latch the data, while
FRAME_VALID and LINE_VALID signals indicate the active video. The sensor can be put
in an ultra-low power sleep mode by asserting the STANDBY pin. Output pads can also
be tri-stated by de-asserting the OE# pin. The MT9V111 internal registers can be configured using a two-wire serial interface.
The MT9V111 can be programmed to output progressive scan images up to 30 fps in an
8-bit ITU_R BT.656 (YCbCr) formerly CCIR656, YUV, 565RGB, 555RGB, or 444RGB
formats. The FRAME_VALID and LINE_VALID signals are output on dedicated pins,
along with a pixel clock that is synchronous with valid data.
Figure 1:
Chip Block Diagram
SCLK
SDATA
SADDR
CLK
STANDBY
OE#
VDD/DGND
VAA/AGND
VAAPIX
Communication Bus
Image Flow Processor
Sensor Core
. Based on MT9V011
. 668H x 496V (VGA+ Reference)
. 1/4-inch optical format
. Auto Black compensation
. Programmable analog gain
. Programmable exposure
. Low power, 10-bit ADCs
. Color correction, gamma,
DOUT(7:0)
lens shading correction
. Auto exposure, white balance
. Interpolation and defect
correction
. Flicker avoidance
PIXCLK
FRAME_VALID
LINE_VALID
FLASH
SRAM Line Buffers
The MT9V111 can accept the input clock of up to 27 MHz, delivering 30 fps. With poweron defaults (see Appendix B for recommended defaults), the camera is configured to
deliver 15 fps at 12 MHz and automatically slows down the frame rate in low-light conditions to achieve longer exposures and better image quality.
Internally, the MT9V111 consists of a sensor core and an image flow processor. The
sensor core functions to capture raw Bayer-encoded images that are input into the IFP
as shown in Figure 1. The IFP processes the incoming stream to create interpolated,
color-corrected output and controls the sensor core to maintain the desirable exposure
and color balance.
Sensor core and IFP registers are grouped into two separate address spaces, as shown in
Figure 2. The internal registers can be accessed via the two-wire serial interface.
Selecting the desired address space can be accomplished by programming register R1
which remains present in both register sets.
MT9V111_DS Rev. N 5/15 EN
6
©Semiconductor Components Industries, LLC,2015.
MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor
General Description
Figure 2:
Internal Register Grouping
Note:
R0
R1
R0
R1
Sensor Core
Registers
(R2..R255)
IFP
Registers
(R2..R255)
R1=4
R1=1
Program R1 to select the desired space (4 = sensor core registes, 1 = IFP/SOC registers).
Figure 3 shows MT9V111 typical connections. For low-noise operation, the MT9V111
requires separate supplies for analog and digital power. Incoming digital and analog
ground conductors can be tied together right next to the die. Both power supply rails
should be decoupled to ground using capacitors. The use of inductance filters is not
recommended.
Figure 3:
Typical Configuration (Connection)
VDD
VDD
VAA
VAAPIX
ADC_TEST
VAA
1.5KΩ
SADDR
1.5KΩ
1KΩ
RESET#
Two-wire
serial bus
{
Master
Clock
DOUT(7:0)
FRAME_VALID
LINE_VALID
PIXCLK
SDATA
SCLK
{
10µF
To CMOS
camera port
CLKIN
FLASH
To Xenon flash
trigger or LED enable
SCAN_EN
DGND
Note:
MT9V111_DS Rev. N 5/15 EN
AGND
STANDBY
DGND
OE#
AGND
1.5K resistor value is recommended, but may be greater for slower two-wire speed.
7
©Semiconductor Components Industries, LLC,2015.
MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor
Ball Assignment
Ball Assignment
Figure 4:
44-Ball ICSP Package
1
2
3
4
5
6
7
A
DGND
DOUT2
DOUT4
DGND
DOUT6
VDD
DGND
B
DOUT1
VDD
DOUT3
VDD
DOUT7
VDD
VDD
C
NC
DOUT0
DOUT5
VDD
SCAN
DGND
D
DGND
_EN
OE#
NC
E
PIXCLK FLASH
F
FRAME_
VALID
VDD
SCLK
G
DGND
CLKIN
SDATA
DGND
VDD
RESET# STAND
SADDR
AGND
ADC_
TEST
VAAPIX
DGND
VAA
VAA
AGND
LINE_
VALID
BY
Top View
(Ball Down)
Table 2:
Ball Description
Ball
Numbers
Name
Type
G2
CLKIN
Input
Master Clock into sensor. Default is 12 MHz (27 MHz maximum).
F3
SCLK
Input
Serial Clock.
F4
SADDR
Input
Serial Interface address select: Reg0xB8 when HIGH (default).
Reg0x90 when LOW.
Description
F6
ADC_TEST
Input
Tie to VAAPIX (factory use only).
E6
RESET#
Input
Asynchronous reset of sensor when LOW. All registers assume factory defaults.
E7
STANDBY
Input
When HIGH puts the imager in ultra-low power standby mode.
D6
OE#
Input
Output_Enable_Bar pin. When HIGH tri-state all outputs except SDATA (tie LOW for
normal operation).
C6
SCAN_EN
Input
G3
SDATA
I/O
Tie to Digital ground.
Serial data I/O.
E2
FLASH
Output
Flash Strobe.
E1
PIXCLK
Output
Pixel Clock Out. Pixel data output are valid during rising edge of this clock. IFP
Reg0x08 [9] inverts polarity.
Frequency = Master Clock.
E3
LINE_VALID
Output
Active HIGH during line of selectable valid pixel data.
F1
FRAME_VALID
Output
Active HIGH during frame of valid pixel data.
B5
DOUT7
Output
ITU_R BT.656/RGB data bit 7 (MSB).
MT9V111_DS Rev. N 5/15 EN
8
©Semiconductor Components Industries, LLC,2015.
MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor
Ball Assignment
Table 2:
Ball Description (continued)
Ball
Numbers
Name
Type
A5
DOUT6
Output
ITU_R BT.656/RGB data bit 6.
Description
C3
DOUT5
Output
ITU_R BT.656/RGB data bit 5.
A3
DOUT4
Output
ITU_R BT.656/RGB data bit 4.
B3
DOUT3
Output
ITU_R BT.656/RGB data bit 3.
A2
DOUT2
Output
ITU_R BT.656/RGB data bit 2.
B1
DOUT1
Output
ITU_R BT.656/RGB data bit 1.
C2
DOUT0
Output
ITU_R BT.656/RGB data bit 0 (LSB).
A6,B2,B4,B6
,
B7,C5,E5,F2
G5,G6
VDD
Supply
VAA
Supply
F7
VAAPIX
Supply
Pixel Array Power (2.8V).
F5,G7
AGND
Supply
Analog Ground.
A1,D1,A4,A
7,C7,D7,G1,
G4
C1,D2
DGND
Supply
MT9V111_DS Rev. N 5/15 EN
Digital Power (2.8V).
Analog Power (2.8V).
Digital Ground.
NC

No connect.
9
©Semiconductor Components Industries, LLC,2015.
MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor
Image Flow Processor
Image Flow Processor
Overview of Architecture
The image flow processor consists of a color processing pipeline and a measurement
and control logic block as shown in Figure 5. The stream of raw data from the sensor
enters the pipeline and undergoes a number of transformations. Image stream
processing starts from conditioning the black level and applying a digital gain. The lens
shading block compensates for signal loss caused by the lens. Next, the data is interpolated to recover missing color components for each pixel and defective pixels are
corrected. The resulting interpolated RGB data passes through the current color correction matrix (CCM), gamma, and saturation corrections and is formatted for final output.
The measurement and control logic continuously accumulates statistics about image
brightness and color. Indoor 50/60 Hz flicker is detected and automatically updated
when possible. Based on these measurements the IFP calculates updated values for
exposure time and sensor analog gains, which are sent to the sensor core via the
communication bus.
Color correction is achieved through linear transformation of the image with a 3 x 3
color correction matrix. Color saturation can be adjusted in the range from zero (black
and white) to 1.25 (125% of full color saturation).
Gamma correction compensates for non-linear dependence of the display device output
vs. driving signal (e.g. monitor brightness vs. CRT voltage).
Output and Formatting
Processed video can be output in the form of a standard ITU_R BT.656 or RGB stream.
ITU_R BT.656 (default) stream contains 4:2:2 data with optional embedded synchronization codes. This kind of output is typically suitable for subsequent display by standard
video equipment. For JPEG/MPEG compression, YUV/ encoding is suitable. RGB functionality is provided to support LCD devices. The MT9V111 can be configured to output
16-bit RGB (RGB565), 15-bit RGB (RGB555) as well as two types of 12-bit RGB (RGB444).
The user can configure internal registers to swap odd and even bytes, chrominance
channels and luminance and chrominance components to facilitate interface to application processors.
MT9V111_DS Rev. N 5/15 EN
10
©Semiconductor Components Industries, LLC,2015.
MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor
Image Flow Processor
Figure 5:
Image Flow Processor Block Diagram
IMAGE SENSOR
LENS CORRECTION
DEMOSAICING
AE, AWB,
FLICKER AVOIDANCE
COLOR CORRECTION
FLASH CONTROL
GAMMA CORRECTION
OUTPUT FORMATTING
The MT9V111 features smooth, continuous zoom and pan. This functionality is available when the IFP output is downsized in the decimation block. The decimation block
can downsize the original VGA image to any integer size, including QVGA, QQVGA, CIF
and QCIF with no loss to the field of view. The user can program the desired size of the
output image in terms of horizontal and vertical pixel count. In addition the user can
program the size of a region for downsizing. Continuous zoom is achieved every time the
region of interest is less than the entire VGA image. The maximum zoom factor is equal
to the ratio of VGA to the size of the region of interest. For example, an image rendered
on a 160x120 display can be zoomed by 640/160=480/120=4 times. Continuous pan is
achieved by adjusting the starting coordinates of the region of interest.
Also a fixed 2X up-zoom is implemented by means of windowing down the sensor core.
In this mode the IFP receives a QVGA-sized input data and outputs a VGA-size image.
The sub-window can be panned both vertically and horizontally by programming sensor
core registers.
The MT9V111 supports both LED and Xenon-type flash light sources using a dedicated
output pad. For Xenon devices the pad generates a strobe to fire when the imager's
shutter is fully open. For LED the pad can be asserted or de-asserted asynchronously.
Flash modes are configured and engaged over the two-wire serial interface using IFP
Reg0x98.
MT9V111_DS Rev. N 5/15 EN
11
©Semiconductor Components Industries, LLC,2015.
MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor
Output Data Ordering
Output Data Ordering
In YCbCr the first and second bytes can be swapped. Luma/chroma bytes can be
swapped as well. R and B channels are bit-wise swapped when chroma swap is enabled.
See IFP Reg0x3A for channel swapping configuration.
Table 3:
YUV/YCbCr Output Data Ordering
Mode
1st Byte
2nd Byte
Default (no swap)
Cbi
Swapped CrCb
Cri
Swapped YC
Swapped CrCb, YC
Table 4:
3rd Byte
4th Byte
Yi
Cri
Yi+1
Yi
Cbi
Yi+1
Yi
Cbi
Yi+1
Cri
Yi
Cri
Yi+1
Cbi
RGB Output Data Ordering in Default Mode
Mode (Swap Disabled)
Byte
D7
D6
D5
D4
D3
D2
D1
D0
RGB 565
First
Second
First
Second
First
Second
First
Second
R7
G4
0
G4
R7
B7
0
G7
R6
G3
R7
G3
R6
B6
0
G6
R5
G2
R6
G2
R5
B5
0
G5
R4
B7
R5
B7
R4
B4
0
G4
R3
B6
R4
B6
G7
0
R7
B7
G7
B5
R3
B5
G6
0
R6
B6
G6
B4
G7
B4
G5
0
R5
B5
G5
B3
G6
B3
G4
0
R4
B4
RGB 555
RGB 444x
RGB x444
A bypass mode is available whereby raw Bayer 10-bits data is output as two bytes. See
IFP Reg8[7].
Table 5:
Byte Ordering in 8 + 2 Bypass Mode
Byte Ordering
8+2 Bypass
MT9V111_DS Rev. N 5/15 EN
First
Second
D9
0
D8
0
D7
0
12
D6
0
D5
0
D4
0
D3
D1
D2
D0
©Semiconductor Components Industries, LLC,2015.
MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor
Sensor Core Overview
Sensor Core Overview
The sensor consists of a pixel array of 668 x 496 total, analog readout chain, 10-bit ADC
with programmable gain and black offset, and timing and control.
Note: See Sensor Core (MT9V011) data sheet for more details.
Figure 6:
Sensor Core Block Diagram
Control Register
Active Pixel
Sensor Array
Communication
Bus to IFP
Timing and Control
Clock
Sync. Signals
Analog Processing
10-bit Data
to IFP
ADC
The sensor core’s pixel array is configured as 668 columns by 496 rows (shown in
Figure 7). The first 18 columns and the first 6 rows of pixels are optically black and can be
used to monitor the black level. The last column and the last row of pixels are also optically black. The black row data is used internally for the automatic black level adjustment. There are 649 columns by 489 rows of optically active pixels, which provides a
four-pixel boundary around the VGA (640 x 480) image to avoid boundary affects during
color interpolation and correction. The additional active column and additional active
row are used to allow horizontally and vertically mirrored readout to also start on the
same color pixel, as shown in Figure 7.
Figure 7:
Pixel Array Description
(0, 0)
6 black rows
1 black column
VGA (640 x 480)
+ 4 pixel boundary for
color correction
+ additional active column
+ additional active row
= 649 x 489 active pixels
(667,495)
18 black columns
1 black row
The sensor core uses the RGB Bayer color pattern (shown in Figure 8). Even-numbered
rows contain green and red color pixels, and odd-numbered rows contain blue and
green color pixels. Even-numbered columns contain green and blue color pixels; oddnumbered columns contain red and green color pixels.
MT9V111_DS Rev. N 5/15 EN
13
©Semiconductor Components Industries, LLC,2015.
MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor
Sensor Core Overview
Figure 8:
Pixel Color Pattern Detail (Top Right Corner)
column readout direction
..
.
row
readout
direction
...
black pixels
G
R
G
R
G
R
G
B
G
B
G
B
G
B
G
R
G
R
G
R
G
B
G
B
G
B
G
B
G
R
G
R
G
R
G
B
G
B
G
B
G
B
Pixel
(18,6)
(First Optical
clear pixel)
..
.
The sensor core image data is read-out in a progressive scan. Valid image data is
surrounded by horizontal and vertical blanking, as shown in Figure 9. The amount of
horizontal and vertical blanking is programmable through the sensor core registers
Reg0x05 and Reg0x06, respectively. LINE_VALID is HIGH during the shaded region of the
figure. See “Appendix A – Sensor Timing” on page 20 for the description of
FRAME_VALID timing.
Figure 9:
Spatial Illustration of Image Readout
P0,0 P0,1 P0,2.....................................P0,n-1 P0,n
P1,0 P1,1 P1,2.....................................P1,n-1 P1,n
00 00 00 .................. 00 00 00
00 00 00 .................. 00 00 00
VALID IMAGE
HORIZONTAL
BLANKING
Pm-1,0 Pm-1,1.....................................Pm-1,n-1 Pm-1,n 00 00 00 .................. 00 00 00
Pm,0 Pm,1.....................................Pm,n-1 Pm,n
00 00 00 .................. 00 00 00
Notes:
MT9V111_DS Rev. N 5/15 EN
00 00 00 ..................................... 00 00 00
00 00 00 ..................................... 00 00 00
00 00 00 .................. 00 00 00
00 00 00 .................. 00 00 00
VERTICAL BLANKING
VERTICAL/HORIZONTAL
BLANKING
00 00 00 ..................................... 00 00 00
00 00 00 ..................................... 00 00 00
00 00 00 .................. 00 00 00
00 00 00 .................. 00 00 00
1. Do not change these registers. Contact ON Semiconductor support for settings different from
defaults.
2. IFP controls these registers when AE, AWE, or flicker avoidance are enabled.
14
©Semiconductor Components Industries, LLC,2015.
MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor
Electrical Specifications
Electrical Specifications
The recommended die operating temperature ranges from -20°C to +40°C. The sensor
image quality may degrade above +40°C.
Table 6:
DC Electrical Characteristics
VDD = VAA = 2.8 ± 0.25V; TA = 25°C
Symbol
Definition
VIH
Input High Voltage
VIL
Input Low Voltage
IIN
Input Leakage Current
Condition
No Pull-up Resistor; VIN = VDD or
DGND
MAX
Unit
VDD - 0.25
MIN
TYP
VDD + 0.25
V
-0.3
0.8
V
-5
5.0
A
VOH
Output High Voltage
VOL
Output Low Voltage
0.2
V
IOH
Output High Current
15.0
mA
IOL
Output Low Current
20.0
mA
IOZ
Tri-state Output Leakage Current
5.0
A
IAA
Analog Operating Supply Current
IDD
Digital Operating Supply Current
IAA Standby
Analog Standby Supply Current
IDD Standby Digital Standby Supply Current
Notes:
MT9V111_DS Rev. N 5/15 EN
VDD - 0.2
Default settings, CLOAD = 10pF
CLKIN = 12 MHz
CLKIN = 27 MHz
Default settings, CLOAD = 10pF
CLKIN = 12 MHz
CLKIN = 27 MHz
STDBY = VDD
STDBY = VDD
V
10.0
10.0
20.0
20.0
25.0
25.0
mA
5.0
10.0
0.0
8.0
15.0
2.5
20.0
20.0
5.0
mA
0.0
2.5
5.0
A
A
1. To place the chip in standby mode, first raise STANDBY to VDD, then wait two master clock cycles
before turning off the master clock. Two master clock cycles are required to place the analog circuitry into standby, low-power mode.
2. When STANDBY is de-asserted, standby mode is exited immediately (within several master clocks),
but the current frame and the next two frames will be invalid. The fourth frame will contain a valid
image.
15
©Semiconductor Components Industries, LLC,2015.
MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor
Electrical Specifications
Table 7:
AC Electrical Characteristics
VDD = VAA = 2.8 ± 0.25V; TA = 25°C
Symbol
fCLKIN
Definition
Condition
Input Clock Frequency
Clock Duty Cycle
t
R
t
F
45
Input Clock Rise Time
Input Clock Fall Time
CLKIN to PIXCLK propagation delay:
LOW-to-HIGH
HIGH-to-LOW
CLOAD = 10pF
t
PIXCLK to DOUT(7:0) at 27 MHz
Setup Time
Hold Time
CLOAD = 10pF
tDSETUP
PIXCLK to DOUT(7:0) at 12 MHz
Setup Time
Hold Time
CLOAD = 10pF
t
PLHP
PHLP
t
DSETUP
tDHOLD
tDHOLD
tOH
tPLHF,L
tPHLF,L
tOUTR
tOUTF
MIN
Data Hold Time from PIXCLK falling edge
CLKIN to FRAME_VALID and LINE_VALID propagation delay:
LOW-to-HIGH
HIGH-to-LOW
TYP
MAX
Unit
12
27
MHz
50
55
ns
2.0
ns
12
10
ns
13.0
13.0
ns
25.0
25.0
ns
9.0
ns
CLOAD = 10pF
ns
Output Rise Time
CLOAD = 10pF
9.0
7.5
7.0
Output Fall Time
CLOAD = 10pF
9.0
Notes:
MT9V111_DS Rev. N 5/15 EN
%
2.0
ns
ns
1. For 30 fps operation with a 27 MHz clock, it is very important to have a precise duty cycle equal to
50%. With a slower frame rate and a slower clock the clock duty cycle can be relaxed.
16
©Semiconductor Components Industries, LLC,2015.
MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor
Propagation Delays
Propagation Delays
Propagation Delays for PIXCLK and Data Out Signals
The typical output delay, relative to the master clock edge, is 7.5 ns. Note that the data
outputs change on the falling edge of the master clock, with the pixel clock rising on the
subsequent rising edge of the master clock.
Propagation Delays for FRAME_VALID and LINE_VALID Signals
The LINE_VALID and FRAME_VALID signals change on the same falling master clock
edge as the data output. The LINE_VALID goes HIGH on the same falling master clock
edge as the output of the first valid pixel's data and returns LOW on the same master
clock falling edge as the end of the output of the last valid pixel's data.
As shown in Figure 12, Data Output Timing Diagram, on page 18, FRAME_VALID goes
HIGH 6 pixel clocks prior to the time that the first LINE_VALID goes HIGH. It returns
LOW at a time corresponding to 6 pixel clocks after the last LINE_VALID goes LOW.
Figure 10:
Propagation Delays for PIXCLK and Data Out Signals
tR
tF
CLKIN
tPHLP
tPLHP
PIXCLK
tPLHD, tPHLD
DOUT (7:0)
Figure 11:
DOUT (7:0)
DOUT (7:0)
tOH
DOUT (7:0)
DOUT (7:0)
Propagation Delays for FRAME_VALID and LINE_VALID Signals
tPLHF,L
MT9V111_DS Rev. N 5/15 EN
tPHLF,L
CLKIN
CLKIN
FRAME_VALID
LINE_VALID
FRAME_VALID
LINE_VALID
17
©Semiconductor Components Industries, LLC,2015.
MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor
Propagation Delays
Figure 12:
Data Output Timing Diagram
PIXCLK
FRAME_VALID
tLVHOLD
tLVSETUP
LINE_VALID
DOUT(7:0)
tFVHOLD
tFVSETUP
tDSETUP
Cb0 Y0
Cr0 Y1
Ylast
Cb0
Ylast
Cb0
tDHOLD
Note:
PIXCLK = MAX 27 MHz
tFVSETUP = / setup time for FRAME_VALID before rising edge of PIXCLK / = 18ns
tFVHOLD = / hold time for FRAME_VALID after rising edge of PIXCLK / = 18ns
tLVSETUP = / setup time for LINE_VALID before rising edge of PIXCLK / = 18ns
tLVHOLD = / hold time for LINE_VALID after rising edge of PIXCLK / = 18ns
tDSETUP = / setup time for DOUT before rising edge of PIXCLK / = 13ns
tDHOLD = / hold time for DOUT after rising edge of PIXCLK / = 13ns
Frame start: FF00 00A0
Line start: FF00 0080
Line end: FF00 0090
Frame end: FF00 00B0
MT9V111_DS Rev. N 5/15 EN
18
©Semiconductor Components Industries, LLC,2015.
MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor
Propagation Delays
Figure 13:
Spectral Response
Relative Response
1.2
Blue
Green (B)
Green (R)
1.0
Relative Response
Red
0.8
0.6
0.4
0.2
0.0
350
450
550
650
750
850
950
1050
Wavelength (nm)
Figure 14:
Die Center - Image CenterOffset
- Direction
+ Direction
0
11.0um
Die
Center
+ Direction
ARRAY
0
-91.3um
- Direction
Pixel Array Center
Pixel (0, 0)
Note:
MT9V111_DS Rev. N 5/15 EN
Not to scale.
19
©Semiconductor Components Industries, LLC,2015.
MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor
Appendix A – Sensor Timing
Appendix A – Sensor Timing
Figure 15:
Row Timing and FRAME_VALID/LINE_VALID Signals
...
FRAME_VALID
...
LINE_VALID
...
Number of master clocks
Note:
Table 8:
P1
A
Q
A
Q
A
P2
The signals in Figure 15 are defined in Table 8.
Frame Time
Parameter
Name
Equation (Master Clocks)
Default Timing
At 12 MHz
A
Active Data Time
(Reg0x04 - 7) x 2
= 1,280 pixel clocks
= 1,280 master clocks
= 106.7us
P1
Frame Start Blanking
(Reg0x05 + 112) x 2
= 300 pixel clocks
= 300 master clocks
= 25.0us
P2
Frame End Blanking
14 CLKS
= 14 pixel clocks
= 14 master clocks
= 1.17us
Q
Horizontal Blanking
(Reg0x05 + 121) x 2
(MIN Reg0x05 value = 9)
= 318 pixel clocks
= 318 master clocks
= 26.5us
A+Q
Row Time
(Reg0x04 + Reg0x05 +114) x 2
= 1,598 pixel clocks
= 1,598 master clocks
= 133.2us
V
Vertical Blanking
(Reg0x06 + 9) x (A + Q) + (Q - P1 - P2)
= 20, 778 pixel clocks
= 20,778 master clocks
= 1.73ms
Nrows x (A + Q)
Frame Valid Time
(Reg0x03 - 7) x (A + Q) - (Q - P1 - P2)
= 767,036 pixel clocks
= 767,036 master clocks
= 63.92ms
F
Total Frame Time
(Reg0x03 + Reg0x06 + 2) x (A + Q)
= 787,814 pixel clocks
= 787,814 master clocks
= 65.65ms
Note:
In order to avoid flicker, frame time is 65.65ms.
Sensor timing is shown above in terms of master clock cycle. The vertical blanking and
total frame time equations assume that the number of integration rows (bits 11 through
0 of Reg0x09) is less than the number of active row plus blanking rows (Reg0x03 + 1 +
Reg0x06 + 1). If this is not the case, the number of integration rows must be used instead
to determine the frame time, as shown in Table 9.
Table 9:
Frame Time—Larger than One Frame
Parameter
Name
Equation (Master Clocks)
Default Timing
V’
Vertical Blanking (long integration time)
(Reg0x09 - Reg0x03) x (A + Q)
F’
Total Frame Time (long integration time)
(Reg0x09 + 1) x (A + Q)
–
–
MT9V111_DS Rev. N 5/15 EN
20
©Semiconductor Components Industries, LLC,2015.
MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor
Serial Bus Description
Serial Bus Description
Registers are written to and read from the MT9V111 through the two-wire serial interface bus. The sensor is a serial interface slave and is controlled by the serial clock (SCLK),
which is driven by the serial interface master. Data is transferred into and out of the
MT9V111 through the serial data (SDATA) line. The SDATA line is pulled up to 2.8V offchip by a 1.5K resistor. Either the slave or master device can pull the SDATA line down—
the serial interface protocol determines which device is allowed to pull the SDATA line
down at any given time. The registers are 16 bits wide and can be accessed through 16bit or eight-bit two-wire serial bus sequences.
Protocol
The two-wire serial interface defines several different transmission codes, as follows:
• a start bit
• the slave device eight-bit address. SADDR is used to select between two different
addresses in case of conflict with another device. If SADDR is LOW, the slave address is
0x90; if SADDR is HIGH, the slave address is 0xB8.
• a(n) (no) acknowledge bit
• an eight-bit message
• a stop bit
Sequence
A typical read or write sequence begins by the master sending a start bit. After the start
bit, the master sends the slave device's eight-bit address. The last bit of the address
determines if the request will be a read or a write, where a "0" indicates a write and a "1"
indicates a read. The slave device acknowledges its address by sending an acknowledge
bit back to the master.
If the request was a write, the master then transfers the 8-bit register address to which a
write should take place. The slave sends an acknowledge bit to indicate that the register
address has been received. The master then transfers the data eight bits at a time, with
the slave sending an acknowledge bit after each 8 bits. The MT9V111 uses 16-bit data for
its internal registers, thus requiring two eight-bit transfers to write to one register. After
16 bits are transferred, the register address is automatically incremented, so that the next
16 bits are written to the next register address. The master stops writing by sending a
start or stop bit.
A typical read sequence is executed as follows. First the master sends the write-mode
slave address and eight-bit register address, just as in the write request. The master then
sends a start bit and the read-mode slave address. The master then clocks out the
register data eight bits at a time. The master sends an acknowledge bit after each eightbit transfer. The register address is auto-incremented after every 16 bits is transferred.
The data transfer is stopped when the master sends a no-acknowledge bit.
The MT9V111 allows for eight-bit data transfers through the two-wire serial interface by
writing (or reading) the most significant eight bits to the register and then writing (or
reading) the least significant eight bits to Reg0x7F (127).
Bus Idle State
The bus is idle when both the data and clock lines are HIGH. Control of the bus is initiated with a start bit, and the bus is released with a stop bit. Only the master can generate
the start and stop bits.
MT9V111_DS Rev. N 5/15 EN
21
©Semiconductor Components Industries, LLC,2015.
MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor
Serial Bus Description
Start Bit
The start bit is defined as a HIGH-to-LOW transition of the data line while the clock line
is HIGH.
Stop Bit
The stop bit is defined as a LOW-to-HIGH transition of the data line while the clock line
is HIGH.
Slave Address
The 8-bit address of a two-wire serial interface device consists of seven bits of address
and 1 bit of direction. A “0” in the least significant bit (LSB) of the address indicates write
mode, and a “1” indicates read mode. The write address of the sensor is 0xB8, while the
read address is 0xB9; this only applies when SADDR is set HIGH.
Data Bit Transfer
One data bit is transferred during each clock pulse. The serial interface clock pulse is
provided by the master. The data must be stable during the HIGH period of the serial
clock—it can only change when the two-wire serial interface clock is LOW. Data is transferred eight bits at a time, followed by an acknowledge bit.
Acknowledge Bit
The master generates the acknowledge clock pulse. The transmitter (which is the master
when writing, or the slave when reading) releases the data line, and the receiver indicates an acknowledge bit by pulling the data line LOW during the acknowledge clock
pulse.
No-Acknowledge Bit
The no-acknowledge bit is generated when the data line is not pulled down by the
receiver during the acknowledge clock pulse. A no-acknowledge bit is used to terminate
a read sequence.
MT9V111_DS Rev. N 5/15 EN
22
©Semiconductor Components Industries, LLC,2015.
MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor
Two-wire Serial Interface Sample Write and Read Sequences (with Saddr = 1)
Two-wire Serial Interface Sample Write and Read Sequences
(with SADDR = 1)
16-Bit Write Sequence
A typical write sequence for writing 16 bits to a register is shown in Figure 16. A start bit
given by the master, followed by the write address, starts the sequence. The image sensor
will then give an acknowledge bit and expects the register address to come first, followed
by the 16-bit data. After each eight-bit the image sensor will give an acknowledge bit. All
16 bits must be written before the register will be updated. After 16 bits are transferred,
the register address is automatically incremented, so that the next 16 bits are written to
the next register. The master stops writing by sending a start or stop bit.
Figure 16:
Timing Diagram Showing a Write to Reg0x09 with Value 0x0284
SCLK
SDATA
Reg0x09
0xB8 ADDR
START
ACK
0000 0010
ACK
1000 0100
ACK
STOP
ACK
16-Bit Read Sequence
A typical read sequence is shown in Figure . First the master has to write the register
address, as in a write sequence. Then a start bit and the read address specifies that a read
is about to happen from the register. The master then clocks out the register data eight
bits at a time. The master sends an acknowledge bit after each eight-bit transfer. The
register address is auto-incremented after every 16 bits is transferred. The data transfer
is stopped when the master sends a no-acknowledge bit.
Figure 17:
Timing Diagram Showing a Read from Reg0x09; Returned Value 0x0284
SCLK
SDATA
0xB8 ADDR
START
MT9V111_DS Rev. N 5/15 EN
Reg 0x09
ACK
0xB9 ADDR
ACK
ACK
23
1000 0100
0000 0010
ACK
STOP
NACK
©Semiconductor Components Industries, LLC,2015.
MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor
Two-wire Serial Interface Sample Write and Read Sequences (with Saddr = 1)
Eight-Bit Write Sequence
All registers in the camera are treated and accessed as 16-bit, even when some registers
do not have all 16-bits used. However, certain hosts only support 8-bit serial communication access. The camera provides a special accommodation for these hosts.
To be able to write one byte at a time to the register a special register address is added.
The 8-bit write is done by first writing the upper 8 bits to the desired register and then
writing the lower 8 bits to the special register address (Reg0x7F). The register is not
updated until all 16 bits have been written. It is not possible to just update half of a
register. In Figure 18, a typical sequence for 8-bit writing is shown. The second byte is
written to the special register (Reg0x7F).
Figure 18:
Timing Diagram Showing a Bytewise Write to Reg0x09 with Value 0x0284
SCLK
SDATA
0xB8 ADDR
0000 0010
Reg0x09
0xB8 ADDR
1000 0100
Reg0x7F
STOP
START
START
ACK
ACK
ACK
ACK
ACK
ACK
Eight-Bit Read Sequence
To read one byte at a time the same special register address is used for the lower byte.
The upper 8 bits are read from the desired register. By following this with a read from the
special register (Reg0x7F) the lower 8 bits are accessed, as shown in Figure 19 The master
sets the no-acknowledge bits.
Figure 19:
Timing Diagram Showing a Bytewise Read from Reg0x09; Returned Value 0x0284
SCLK
SDATA
0xB8 ADDR
0xB9 ADDR
Reg0x09
0000 0010
START
START
ACK
ACK
NACK
ACK
SCLK
SDATA
0xB8 ADDR
0xB9 ADDR
Reg0x7F
1000 0100
STOP
START
START
MT9V111_DS Rev. N 5/15 EN
ACK
ACK
ACK
24
NACK
©Semiconductor Components Industries, LLC,2015.
MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor
Two-wire Serial Interface Sample Write and Read Sequences (with Saddr = 1)
Two-wire Serial Bus Timing
The two-wire serial interface operation requires a certain minimum of master clock
cycles between transitions. These are specified below in master clock cycles.
Figure 20:
Serial Host Interface Start Condition Timing
5
4
SCLK
SDATA
Figure 21:
Serial Host Interface Stop Condition Timing
5
4
SCLK
SDATA
Note:
Figure 22:
All timing are in units of master clock cycle.
Serial Host Interface Data Timing for Write
4
Note:
Figure 23:
4
SDATA is driven by an off-chip transmitter.
Serial Host Interface Data Timing for Read
5
Note:
MT9V111_DS Rev. N 5/15 EN
SDATA is pulled LOW by the sensor, or allowed to be pulled HIGH by a pull-up resistor off-chip.
25
©Semiconductor Components Industries, LLC,2015.
MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor
Two-wire Serial Interface Sample Write and Read Sequences (with Saddr = 1)
Figure 24:
Acknowledge Signal Timing After an 8-bit Write to the Sensor
3
6
SCLK
Sensor pulls down
SDATA pin
SDATA
Figure 25:
Acknowledge Signal Timing After an 8-bit Read from the Sensor
6
7
SCLK
SDATA
Note:
MT9V111_DS Rev. N 5/15 EN
Sensor tri-states SDATA pin
(turns off pull down)
After a read, the master receiver must pull down SDATA to acknowledge receipt of data bits. When
read sequence is complete, the master must generate a no acknowledge by leaving SDATA to float
HIGH. On the following cycle, a start or stop bit may be used.
26
©Semiconductor Components Industries, LLC,2015.
MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor
Appendix B – Overview of Programming
Appendix B – Overview of Programming
Default Sensor Configuration
In its default configuration, the sensor outputs up to 15 fps at 12 MHz master clock
frequency. Auto exposure, automatic white balance, 60Hz flicker avoidance, defect
correction, and automatic noise suppression in low light conditions are enabled. The
frame rate is controlled by AE and can be slowed down to 5 fps in low light. Lens shading
correction is disabled. Gamma correction uses gamma = 0.6. Image data are output in
YCbCr ITU_R.BT.656 VGA format, with Y, Cb, and Cr values ranging from 16 to 240.
The use of the non-default register settings shown in Table 10 are recommended to optimize sensor performance in the above configuration.
Table 10:
Non-Default Register Settings Optimizing 15 fps at 12 MHz Operation
Core:
R5 = 46, R7[4] = 0, R33 = 58369, R47 = 63414
IFP:
R51= 5137, R56 = 2168, R57= 290, R59 = 1068, R62 = 4095, R64 = 7696, R65 = 5143, R66 =
4627,
R67 = 4370, R68 = 28944, R69 = 29811
Note:
Table 11:
Non-default register settings required for an optimal 30 fps, 27 MHz operation are shown in
Table 11
Non-Default Register Settings Optimizing 30 fps at 27 MHz Operation
Note:
Core:
R5 = 132, R6 = 10, R7[4] = 0, R33 = 58369
IFP:
R51 = 5137, R57 = 290, R59 = 1068, R62 = 4095, R89 = 504, R90 = 605, R92 = 8222, R93 =
10021,
R100 = 4477
To obtain register settings for other frame rates and clock speeds, please contact a ON Semiconductor FAE.
Auto Exposure
Target image brightness and accuracy of AE are set by IFP R46[7:0] and R46[15:8],
respectively. For example, to overexpose images, set IFP R46[7:0] = 120. To change image
brightness on LCD in RGB preview mode, use IFP R52[15:8]. AE logic can be
programmed to keep the frame rate constant or vary it within certain range, by writing to
IFP R55[9:5] one of the values tabulated in Table 12.
Table 12:
Relation Between IFP R55[9:5] Setting and Frame Rate Range
Minimum Frame Rate
Maximum Frame Rate = 15 fps
Maximum Frame Rate = 30
fps
30 fps
15 fps
7.5 fps
5 fps
N/A
8
16
24
4
8
16
24
The speed of AE is set using IFP R47. The speed should be high in preview modes and
lower for video output to avoid sudden changes in brightness between frames.
Auto exposure is disabled by setting IFP R6[14] = 0. When AE, AWB, and flicker avoidance
are all disabled (IFP R6[14] = 0, IFP R6[1] = 0, and IFP R8[11] = 0), exposure and analog
gains can be adjusted manually (see core registers R9, R12, and R43 through R46).
MT9V111_DS Rev. N 5/15 EN
27
©Semiconductor Components Industries, LLC,2015.
MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor
Appendix B – Overview of Programming
Automatic White Balance
AWB can be disabled by setting IFP R6[1]=0. Use IFP R37[2:0] and R37[6:3] to speed up
AWB response. Please note that speeding AWB up may result in color oscillation. If
necessary, AWB range can be restricted by changing the upper limit in IFP R36[14:8] and
lower limit in IFP R36[6:0].
Flicker Avoidance
Use IFP R91 to choose automatic/manual, 50Hz/60Hz flicker avoidance and IFP R8[11]
= 0 to disable this feature.
Flash
For flash programming, see IFP R152 description.
Decimation, Zoom, and Pan
For output decimation programming, see IFP R165 description. Table 13 provides a few
examples.
Table 13:
Decimation, Zoom, and Pan
Note:
Ifp Registers
CIF Output (Correct Aspect Ratio)
QVGA Output
2:1 Zoom
QVGA Output
1:1 Zoom
R165
R166
R167
R168
R169
R170
26
586
352
0
480
288
160
320
320
120
240
240
0
640
320
0
480
240
For fixed 2x upsize zoom, set core R30[0] = 1.
Interpolation
Use IFP R5[2:0] to adjust image sharpness. By default, sharpness is automatically
reduced in low-light conditions (see IFP R5[3]). For RGB565 16-bit capture, set IFP
R6[12] = 0 and IFP R5[3] = 0 to avoid contouring.
Special Effects
To switch from color to gray scale output, set IFP R8[5] = 1. Contact a ON Semiconductor
FAE for register settings producing other special effects (e.g. sepia output).
Image Mirroring
To mirror images horizontally, set core R32[14] = 1 and IFP R8[0] = 1. To flip images vertically, set core R32[15] = 1 and IFP R8[1] = 1.
Test Pattern
See IFP R72 and IFP Reg58[5:3] description.
MT9V111_DS Rev. N 5/15 EN
28
©Semiconductor Components Industries, LLC,2015.
MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor
Appendix B – Overview of Programming
Gamma Correction
See Table 14 and Table for register settings required to setup non-default gamma correction. Please note that these settings determine output signal range. Use YCbCr settings
with ITU_R BTU-compatible devices. Use YUV settings for JPEG capture and RGB
preview; switching to YUV mode requires setting IFP R52 = 0 and IFP R53 = 65281.
Table 14:
Table 15:
YCbCr Settings
Gamma
0.45
0.5
0.55
0.6
(Default)
0.7
1.0
IFP R83
IFP R84
IFP R85
IFP R86
IFP R87
12836
23876
39039
49326
57552
10781
21563
37495
48553
57551
8984
19508
35952
47780
57549
7700
17709
34409
47008
57548
5389
14627
31581
45207
57545
2052
8208
24640
41088
57536
Gamma
0.45
0.5
0.55
0.6
0.7
1.0
IFP R83
IFP R84
IFP R85
IFP R86
IFP R87
14377
26957
44432
56005
65260
12321
24643
42631
54976
65259
10267
22331
40831
54202
65257
8726
20276
39031
53173
65255
6159
16680
35945
51371
65252
2308
9234
27720
46481
65241
YUV Settings
MT9V111_DS Rev. N 5/15 EN
29
©Semiconductor Components Industries, LLC,2015.
MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor
Appendix B – Overview of Programming
Figure 26:
44-Ball ICSP Package Outline Drawing
0.95 (FOR REFERENCE ONLY)
1.17 ±0.10
B
SEATING PLANE
0.10 A
A
0.22
(FOR REFERENCE ONLY)
0.175
(FOR REFERENCE ONLY)
0.575 ±0.050
4.50
0.375 ±0.075
BALL A1
BALL A1 ID
0.75 TYP
BALL A7
44X Ø0.35
BALL A1
CORNER
5.30 CTR
PIXEL
(0,0)
3.500 ±0.075
DIMENSIONS APPLY TO SOLDER
BALLS POST REFLOW. THE PREREFLOW DIAMETER IS Ø0.33
3.400 ±0.075
3.50 ±0.05
CL
4.50
2.688
5.30
CTR
CTR
7.00 ±0.075
0.100
(FOR REFERENCE
ONLY)
OPTICAL
CENTER
PACKAGE
CENTER
2.25
0.75 TYP
CL
2.25
3.50 ±0.05
OPTICAL AREA
3.584 CTR
MAXIMUM ROTATION OF OPTICAL AREA RELATIVE TO PACKAGE EDGES: 1º
MAXIMUM TILT OF OPTICAL AREA RELATIVE TO B : 0.3º
MAXIMUM TILT OF OPTICAL AREA RELATIVE TO TOP OF COVER GLASS: 0.3º
7.00 ±0.075
SOLDER BALL MATERIAL: 62% Sn, 36% Pb, 2%Ag
OR 96.5% Sn, 3%Ag, 0.5% Cu
SOLDER MASK DEFINED BALL PADS: Ø 0.27
LID MATERIAL: BOROSILICATE GLASS 0.40 THICKNESS
IMAGE SENSOR DIE
SUBSTRATE MATERIAL: PLASTIC LAMINATE
ENCAPSULANT: EPOXY
Notes:
MT9V111_DS Rev. N 5/15 EN
1. All dimensions in millimeters.
2. ICSP package information is preliminary.
30
©Semiconductor Components Industries, LLC,2015.
MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor
Revision History
Revision History
Rev. N . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4/16/15
• Updated “Ordering Information” on page 2
Rev. M. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3/27/15
• Converted to ON Semiconductor template
Rev. L . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5/3/11
• Updated trademarks
• Applied updated template
Rev. K . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6/10
• Updated to non-confidential
Rev. J. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5/10
• Updated to Aptina template
• Transfered registers to a separate document
Rev. H, Production . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6/06
• Updated Table 6, “IFP Register List,” on page 12
Rev. G, Production . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1/05
• Modified tOH definition in Table 7, “AC Electrical Characteristics,” on page 16
• Updated Figure 10, Propagation Delays for PIXCLK and Data Out Signals, on page 17
Rev. F, Production . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8/04
• Updated 44-Ball ICSP Package Outline Drawing
Rev. E . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7/04
• Replaced 28-Pin PLCC package information with the 44-Ball ICSP
• Updated Table 12 (Frame Time)
• Updated Electrical Specifications
Rev. D, Preliminary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3/04
• Modify for external web posting - streamlined register descriptions
• Add Appendix B
Rev. C, Preliminary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2/04
• Added Key Performance Parameter Table, Update Register Tables, Update Electrical
Specification Table, Added Figures (Image Center Offset, Die Placement, 28-Pin PLCC
Package Outline Drawing and Spectral
Response)
Rev. B, Preliminary, Draft . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1/04
• Format edits on 1/15/04
MT9V111_DS Rev. N 5/15 EN
31
©Semiconductor Components Industries, LLC,2015.
MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor
Revision History
Rev. A, Preliminary, Draft . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .12/03
• Initial Release of document
A-Pix is a trademark of Semiconductor Components Industries, LLC (SCILLC) or its subsidiaries in the United States and/or other countries.
ON Semiconductor and the ON logo are registered trademarks of Semiconductor Components Industries, LLC (SCILLC) or its subsidiaries in the United States and/or other countries. SCILLC owns the
rights to a number of patents, trademarks, copyrights, trade secrets, and other intellectual property. A listing of SCILLC’s product/patent coverage may be accessed at www.onsemi.com/site/pdf/
Patent-Marking.pdf. SCILLC reserves the right to make changes without further notice to any products herein. SCILLC makes no warranty, representation or guarantee regarding the suitability of its
products for any particular purpose, nor does SCILLC assume any liability arising out of the application or use of any product or circuit, and specifically disclaims any and all liability, including
without limitation special, consequential or incidental damages. “Typical” parameters which may be provided in SCILLC data sheets and/or specifications can and do vary in different applications
and actual performance may vary over time. All operating parameters, including “Typicals” must be validated for each customer application by customer’s technical experts. SCILLC does not convey
any license under its patent rights nor the rights of others. SCILLC products are not designed, intended, or authorized for use as components in systems intended for surgical implant into the body,
or other applications intended to support or sustain life, or for any other application in which the failure of the SCILLC product could create a situation where personal injury or death may occur.
Should Buyer purchase or use SCILLC products for any such unintended or unauthorized application, Buyer shall indemnify and hold SCILLC and its officers, employees, subsidiaries, affiliates, and
distributors harmless against all claims, costs, damages, and expenses, and reasonable attorney fees arising out of, directly or indirectly, any claim of personal injury or death associated with such
unintended or unauthorized use, even if such claim alleges that SCILLC was negligent regarding the design or manufacture of the part. SCILLC is an Equal Opportunity/Affirmative Action Employer.
This literature is subject to all applicable copyright laws and is not for resale in any manner.
MT9V111_DS Rev. N 5/15 EN
32
©Semiconductor Components Industries, LLC,2015 .